2025-06-02T17:16:59,951 Created temporary directory: /tmp/pip-build-tracker-9xs3db0_
2025-06-02T17:16:59,952 Initialized build tracking at /tmp/pip-build-tracker-9xs3db0_
2025-06-02T17:16:59,953 Created build tracker: /tmp/pip-build-tracker-9xs3db0_
2025-06-02T17:16:59,953 Entered build tracker: /tmp/pip-build-tracker-9xs3db0_
2025-06-02T17:16:59,954 Created temporary directory: /tmp/pip-wheel-ivq31ibr
2025-06-02T17:16:59,959 Created temporary directory: /tmp/pip-ephem-wheel-cache-tqg_6_4m
2025-06-02T17:17:00,019 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2025-06-02T17:17:00,021 2 location(s) to search for versions of deepspeed:
2025-06-02T17:17:00,021 * https://pypi.org/simple/deepspeed/
2025-06-02T17:17:00,021 * https://www.piwheels.org/simple/deepspeed/
2025-06-02T17:17:00,022 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2025-06-02T17:17:00,023 Getting page https://pypi.org/simple/deepspeed/
2025-06-02T17:17:00,025 Found index url https://pypi.org/simple/
2025-06-02T17:17:00,177 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2025-06-02T17:17:00,191   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-02T17:17:00,192   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2025-06-02T17:17:00,193   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-02T17:17:00,193   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2025-06-02T17:17:00,194   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-02T17:17:00,195   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2025-06-02T17:17:00,196   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-02T17:17:00,196   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2025-06-02T17:17:00,197   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-02T17:17:00,198   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2025-06-02T17:17:00,198   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2025-06-02T17:17:00,199   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2025-06-02T17:17:00,200   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2025-06-02T17:17:00,201   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2025-06-02T17:17:00,201   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2025-06-02T17:17:00,202   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2025-06-02T17:17:00,202   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2025-06-02T17:17:00,203   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2025-06-02T17:17:00,203   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2025-06-02T17:17:00,204   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2025-06-02T17:17:00,205   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2025-06-02T17:17:00,205   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2025-06-02T17:17:00,206   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2025-06-02T17:17:00,207   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2025-06-02T17:17:00,207   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2025-06-02T17:17:00,208   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2025-06-02T17:17:00,209   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2025-06-02T17:17:00,209   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2025-06-02T17:17:00,210   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2025-06-02T17:17:00,211   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2025-06-02T17:17:00,212   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2025-06-02T17:17:00,212   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2025-06-02T17:17:00,213   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2025-06-02T17:17:00,214   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2025-06-02T17:17:00,214   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2025-06-02T17:17:00,215   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2025-06-02T17:17:00,216   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2025-06-02T17:17:00,216   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2025-06-02T17:17:00,217   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2025-06-02T17:17:00,218   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2025-06-02T17:17:00,218   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2025-06-02T17:17:00,219   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2025-06-02T17:17:00,220   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2025-06-02T17:17:00,221   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2025-06-02T17:17:00,221   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2025-06-02T17:17:00,222   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2025-06-02T17:17:00,223   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2025-06-02T17:17:00,223   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2025-06-02T17:17:00,224   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2025-06-02T17:17:00,225   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2025-06-02T17:17:00,226   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2025-06-02T17:17:00,227   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2025-06-02T17:17:00,228   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2025-06-02T17:17:00,228   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2025-06-02T17:17:00,229   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2025-06-02T17:17:00,230   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2025-06-02T17:17:00,231   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2025-06-02T17:17:00,231   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2025-06-02T17:17:00,232   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2025-06-02T17:17:00,233   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2025-06-02T17:17:00,234   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2025-06-02T17:17:00,235   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2025-06-02T17:17:00,235   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2025-06-02T17:17:00,236   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2025-06-02T17:17:00,237   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2025-06-02T17:17:00,237   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2025-06-02T17:17:00,238   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2025-06-02T17:17:00,239   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2025-06-02T17:17:00,240   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2025-06-02T17:17:00,241   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2025-06-02T17:17:00,241   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2025-06-02T17:17:00,242   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2025-06-02T17:17:00,243   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2025-06-02T17:17:00,244   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2025-06-02T17:17:00,244   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2025-06-02T17:17:00,245   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2025-06-02T17:17:00,246   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2025-06-02T17:17:00,246   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2025-06-02T17:17:00,247   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2025-06-02T17:17:00,248   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2025-06-02T17:17:00,249   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2025-06-02T17:17:00,249   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2025-06-02T17:17:00,250   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2025-06-02T17:17:00,251   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2025-06-02T17:17:00,252   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2025-06-02T17:17:00,252   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2025-06-02T17:17:00,253   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2025-06-02T17:17:00,254   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2025-06-02T17:17:00,255   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2025-06-02T17:17:00,256   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2025-06-02T17:17:00,256   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2025-06-02T17:17:00,257   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2025-06-02T17:17:00,258   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2025-06-02T17:17:00,258   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2025-06-02T17:17:00,259   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2025-06-02T17:17:00,260   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2025-06-02T17:17:00,260   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-02T17:17:00,261   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2025-06-02T17:17:00,262   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-02T17:17:00,298   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2025-06-02T17:17:00,299   Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1
2025-06-02T17:17:00,300   Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2
2025-06-02T17:17:00,301   Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3
2025-06-02T17:17:00,302   Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4
2025-06-02T17:17:00,303   Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0
2025-06-02T17:17:00,304   Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1
2025-06-02T17:17:00,304   Found link https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.2
2025-06-02T17:17:00,305   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/52/23/cfe2166f06f1817b73b8695addd2fded55f4189322bcf181cfb7feaba550/deepspeed-0.16.3-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-02T17:17:00,306   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/ce/92/853de2a32b3f9c0945e0c9e145eddac98e570c1faebcd58aa85e6dcd89ba/deepspeed-0.16.3-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-02T17:17:00,307   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/55/8f/57ee424e114478a667c604b2f3f05bbc1addc0afc089b9ab6a64b233063d/deepspeed-0.16.3-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-02T17:17:00,307   Found link https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.3
2025-06-02T17:17:00,308   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/3d/65/1a6394f5d6dee851e9ea59e385f6d6428e3bfe36f83c06e0336e14dcfd11/deepspeed-0.16.4-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-02T17:17:00,309   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a3/aa/bb67b63cc25c5e29e4ca3f8b155e0faf74d5a33acf2ec67e249206a36b0f/deepspeed-0.16.4-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-02T17:17:00,310   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d4/59/fd251661b78b049eed7ee46f0d8d51c69ae7fbb710716a1ebcc796a6b0fd/deepspeed-0.16.4-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-02T17:17:00,310   Found link https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.4
2025-06-02T17:17:00,311   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/15/b0/be6cc74fd1e23da20d6c34db923858a8ae5017d39a13dedc188a935c646a/deepspeed-0.16.5-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-02T17:17:00,312   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/0b/78/9a87d137f83f53dd57f425ac174723c746c53029bf6cdce22eb9e805e3f0/deepspeed-0.16.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-02T17:17:00,313   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/80/f8/a9b1fca237fe8ea25f866956778280d0b735350f29fb6f4e0b548aa02a5f/deepspeed-0.16.5-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-02T17:17:00,313   Found link https://files.pythonhosted.org/packages/0d/88/96569b2acb3219c9c72068f9b952c59beffe366e7d1edd9e922e5c68f08b/deepspeed-0.16.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.5
2025-06-02T17:17:00,314   Found link https://files.pythonhosted.org/packages/cb/a3/1d758fcbcdb3f5ecf4e71907e293f17bae8a9f448b112e65c6195e90c2d3/deepspeed-0.16.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.6
2025-06-02T17:17:00,315   Found link https://files.pythonhosted.org/packages/06/b3/a3903de5c5b707170c5c27e1a40f4ef613f14d241bd84d8b151a2a8786f6/deepspeed-0.16.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.7
2025-06-02T17:17:00,316   Found link https://files.pythonhosted.org/packages/e1/27/f857569546dc97f64169df1cc35d1ec5161766c4a0ec32f2af5d39614a51/deepspeed-0.16.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.8
2025-06-02T17:17:00,317   Found link https://files.pythonhosted.org/packages/4f/5c/7542904cddfaa50a9a7ae6770349d468773359f5af1718865452cea8729d/deepspeed-0.16.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.9
2025-06-02T17:17:00,317   Found link https://files.pythonhosted.org/packages/1e/35/eef570f4da4a39d0e7f2e72757295fdba3718a8eca60d8d6dcfeb9e6f26d/deepspeed-0.17.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.0
2025-06-02T17:17:00,318   Found link https://files.pythonhosted.org/packages/38/10/a7f63e086c1e1c12e290c98363c748ef5ddd6313fde739d2aeccd5ed0cd4/deepspeed-0.17.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.1
2025-06-02T17:17:00,319   Found link https://files.pythonhosted.org/packages/8c/45/1ddcf8f8500d90fad9f3396bfb1295462d46a747ddcbfafcd7714d46827e/deepspeed-0.17.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.2
2025-06-02T17:17:00,320   Found link https://files.pythonhosted.org/packages/9e/6b/89faa30a38405cd2d7a81790b262673ca4c8e8ec97c2f8c433da04d7a002/deepspeed-0.17.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.3
2025-06-02T17:17:00,320   Found link https://files.pythonhosted.org/packages/84/b3/02d000bfd0d6f0ba3f5dac487e4151b3e9b4b3ee71336882102dc9ad79ad/deepspeed-0.17.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.4
2025-06-02T17:17:00,321 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2025-06-02T17:17:00,322 Getting page https://www.piwheels.org/simple/deepspeed/
2025-06-02T17:17:00,324 Found index url https://www.piwheels.org/simple/
2025-06-02T17:17:00,495 WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-02T17:17:01,154 WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-02T17:17:02,319 WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-02T17:17:04,487 WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-02T17:17:08,652 WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-02T17:17:08,829 Could not fetch URL https://www.piwheels.org/simple/deepspeed/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='www.piwheels.org', port=443): Max retries exceeded with url: /simple/deepspeed/ (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))) - skipping
2025-06-02T17:17:08,831 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2025-06-02T17:17:08,832 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2025-06-02T17:17:08,864 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2025-06-02T17:17:08,867 Collecting deepspeed==0.16.7
2025-06-02T17:17:08,869   Created temporary directory: /tmp/pip-unpack-jqlcw3ly
2025-06-02T17:17:09,017   Downloading deepspeed-0.16.7.tar.gz (1.5 MB)
2025-06-02T17:17:11,845   Added deepspeed==0.16.7 from https://files.pythonhosted.org/packages/06/b3/a3903de5c5b707170c5c27e1a40f4ef613f14d241bd84d8b151a2a8786f6/deepspeed-0.16.7.tar.gz to build tracker '/tmp/pip-build-tracker-9xs3db0_'
2025-06-02T17:17:11,848   Running setup.py (path:/tmp/pip-wheel-ivq31ibr/deepspeed_ebcef5369f4049c9957d9a03e0240d63/setup.py) egg_info for package deepspeed
2025-06-02T17:17:11,849   Created temporary directory: /tmp/pip-pip-egg-info-k7u2ktji
2025-06-02T17:17:11,850   Preparing metadata (setup.py): started
2025-06-02T17:17:11,851   Running command python setup.py egg_info
2025-06-02T17:17:12,949   fatal: not a git repository (or any of the parent directories): .git
2025-06-02T17:17:13,429   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-06-02T17:17:13,430    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-06-02T17:17:13,430   DS_BUILD_OPS=0
2025-06-02T17:17:13,431   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-06-02T17:17:13,431   version=0.16.7, git_hash=unknown, git_branch=unknown
2025-06-02T17:17:13,432   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-06-02T17:17:13,432   ext_modules=[]
2025-06-02T17:17:13,433   running egg_info
2025-06-02T17:17:13,458   creating /tmp/pip-pip-egg-info-k7u2ktji/deepspeed.egg-info
2025-06-02T17:17:13,459   writing /tmp/pip-pip-egg-info-k7u2ktji/deepspeed.egg-info/PKG-INFO
2025-06-02T17:17:13,495   writing dependency_links to /tmp/pip-pip-egg-info-k7u2ktji/deepspeed.egg-info/dependency_links.txt
2025-06-02T17:17:13,497   writing entry points to /tmp/pip-pip-egg-info-k7u2ktji/deepspeed.egg-info/entry_points.txt
2025-06-02T17:17:13,516   writing requirements to /tmp/pip-pip-egg-info-k7u2ktji/deepspeed.egg-info/requires.txt
2025-06-02T17:17:13,517   writing top-level names to /tmp/pip-pip-egg-info-k7u2ktji/deepspeed.egg-info/top_level.txt
2025-06-02T17:17:13,519   writing manifest file '/tmp/pip-pip-egg-info-k7u2ktji/deepspeed.egg-info/SOURCES.txt'
2025-06-02T17:17:13,783   reading manifest file '/tmp/pip-pip-egg-info-k7u2ktji/deepspeed.egg-info/SOURCES.txt'
2025-06-02T17:17:13,785   reading manifest template 'MANIFEST.in'
2025-06-02T17:17:13,787   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-06-02T17:17:13,788   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-06-02T17:17:15,886   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-06-02T17:17:17,154   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-06-02T17:17:17,983   warning: no files found matching '*.tr' under directory 'csrc'
2025-06-02T17:17:18,152   warning: no files found matching '*.cc' under directory 'csrc'
2025-06-02T17:17:18,219   warning: no files found matching '*.py' under directory 'benchmarks'
2025-06-02T17:17:18,228   adding license file 'LICENSE'
2025-06-02T17:17:18,274   writing manifest file '/tmp/pip-pip-egg-info-k7u2ktji/deepspeed.egg-info/SOURCES.txt'
2025-06-02T17:17:18,277   deepspeed build time = 5.3220534324646 secs
2025-06-02T17:17:18,394   Preparing metadata (setup.py): finished with status 'done'
2025-06-02T17:17:18,400   Source in /tmp/pip-wheel-ivq31ibr/deepspeed_ebcef5369f4049c9957d9a03e0240d63 has version 0.16.7, which satisfies requirement deepspeed==0.16.7 from https://files.pythonhosted.org/packages/06/b3/a3903de5c5b707170c5c27e1a40f4ef613f14d241bd84d8b151a2a8786f6/deepspeed-0.16.7.tar.gz
2025-06-02T17:17:18,401   Removed deepspeed==0.16.7 from https://files.pythonhosted.org/packages/06/b3/a3903de5c5b707170c5c27e1a40f4ef613f14d241bd84d8b151a2a8786f6/deepspeed-0.16.7.tar.gz from build tracker '/tmp/pip-build-tracker-9xs3db0_'
2025-06-02T17:17:18,476 Created temporary directory: /tmp/pip-unpack-tm2loi5w
2025-06-02T17:17:18,477 Created temporary directory: /tmp/pip-unpack-zclzft0h
2025-06-02T17:17:18,478 Building wheels for collected packages: deepspeed
2025-06-02T17:17:18,482   Created temporary directory: /tmp/pip-wheel-ohf83971
2025-06-02T17:17:18,483   DEPRECATION: Building 'deepspeed' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'deepspeed'. Discussion can be found at https://github.com/pypa/pip/issues/6334
2025-06-02T17:17:18,484   Building wheel for deepspeed (setup.py): started
2025-06-02T17:17:18,485   Destination directory: /tmp/pip-wheel-ohf83971
2025-06-02T17:17:18,486   Running command python setup.py bdist_wheel
2025-06-02T17:17:18,982   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-06-02T17:17:18,985    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-06-02T17:17:19,117   DS_BUILD_OPS=0
2025-06-02T17:17:19,251   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-06-02T17:17:19,271   fatal: not a git repository (or any of the parent directories): .git
2025-06-02T17:17:19,272   version=0.16.7, git_hash=unknown, git_branch=unknown
2025-06-02T17:17:19,273   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-06-02T17:17:19,274   ext_modules=[]
2025-06-02T17:17:19,680   running bdist_wheel
2025-06-02T17:17:19,815   running build
2025-06-02T17:17:19,816   running build_py
2025-06-02T17:17:19,848   creating build/lib/deepspeed
2025-06-02T17:17:19,850   copying deepspeed/__init__.py -> build/lib/deepspeed
2025-06-02T17:17:19,853   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2025-06-02T17:17:19,855   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2025-06-02T17:17:19,857   copying deepspeed/constants.py -> build/lib/deepspeed
2025-06-02T17:17:19,859   copying deepspeed/env_report.py -> build/lib/deepspeed
2025-06-02T17:17:19,862   creating build/lib/deepspeed/sequence
2025-06-02T17:17:19,863   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2025-06-02T17:17:19,866   copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence
2025-06-02T17:17:19,869   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2025-06-02T17:17:19,872   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2025-06-02T17:17:19,875   creating build/lib/deepspeed/nvme
2025-06-02T17:17:19,876   copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme
2025-06-02T17:17:19,878   copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme
2025-06-02T17:17:19,880   copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme
2025-06-02T17:17:19,883   copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme
2025-06-02T17:17:19,885   copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme
2025-06-02T17:17:19,887   copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme
2025-06-02T17:17:19,889   copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme
2025-06-02T17:17:19,892   copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme
2025-06-02T17:17:19,894   copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme
2025-06-02T17:17:19,896   copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme
2025-06-02T17:17:19,898   copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme
2025-06-02T17:17:19,900   copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme
2025-06-02T17:17:19,902   creating build/lib/deepspeed/nebula
2025-06-02T17:17:19,903   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2025-06-02T17:17:19,906   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2025-06-02T17:17:19,907   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2025-06-02T17:17:19,911   creating build/lib/deepspeed/utils
2025-06-02T17:17:19,912   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,915   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,917   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,919   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,921   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,923   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,926   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,928   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,931   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,933   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,936   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,938   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,941   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,943   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,946   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,949   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,952   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,955   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2025-06-02T17:17:19,958   creating build/lib/deepspeed/accelerator
2025-06-02T17:17:19,960   copying deepspeed/accelerator/sdaa_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-02T17:17:19,962   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-02T17:17:19,965   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2025-06-02T17:17:19,967   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-02T17:17:19,969   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-02T17:17:19,972   copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-02T17:17:19,975   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-02T17:17:19,978   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-02T17:17:19,981   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-02T17:17:19,984   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-02T17:17:19,987   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-02T17:17:19,991   creating build/lib/deepspeed/monitor
2025-06-02T17:17:19,992   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2025-06-02T17:17:19,995   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2025-06-02T17:17:19,997   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2025-06-02T17:17:19,999   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2025-06-02T17:17:20,001   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2025-06-02T17:17:20,004   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2025-06-02T17:17:20,006   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2025-06-02T17:17:20,008   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2025-06-02T17:17:20,011   creating build/lib/deepspeed/autotuning
2025-06-02T17:17:20,012   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2025-06-02T17:17:20,014   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2025-06-02T17:17:20,016   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2025-06-02T17:17:20,020   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2025-06-02T17:17:20,022   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2025-06-02T17:17:20,025   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2025-06-02T17:17:20,029   creating build/lib/deepspeed/ops
2025-06-02T17:17:20,031   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2025-06-02T17:17:20,033   creating build/lib/deepspeed/profiling
2025-06-02T17:17:20,035   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2025-06-02T17:17:20,037   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2025-06-02T17:17:20,039   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2025-06-02T17:17:20,042   creating build/lib/deepspeed/compression
2025-06-02T17:17:20,043   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2025-06-02T17:17:20,046   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2025-06-02T17:17:20,048   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2025-06-02T17:17:20,051   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2025-06-02T17:17:20,053   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2025-06-02T17:17:20,056   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2025-06-02T17:17:20,059   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2025-06-02T17:17:20,061   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2025-06-02T17:17:20,065   creating build/lib/deepspeed/moe
2025-06-02T17:17:20,066   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2025-06-02T17:17:20,068   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2025-06-02T17:17:20,070   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2025-06-02T17:17:20,073   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2025-06-02T17:17:20,076   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2025-06-02T17:17:20,079   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2025-06-02T17:17:20,082   creating build/lib/deepspeed/compile
2025-06-02T17:17:20,084   copying deepspeed/compile/config.py -> build/lib/deepspeed/compile
2025-06-02T17:17:20,086   copying deepspeed/compile/inductor.py -> build/lib/deepspeed/compile
2025-06-02T17:17:20,089   copying deepspeed/compile/patch_compiled_func.py -> build/lib/deepspeed/compile
2025-06-02T17:17:20,091   copying deepspeed/compile/__init__.py -> build/lib/deepspeed/compile
2025-06-02T17:17:20,093   copying deepspeed/compile/init_z1.py -> build/lib/deepspeed/compile
2025-06-02T17:17:20,096   copying deepspeed/compile/graph_param.py -> build/lib/deepspeed/compile
2025-06-02T17:17:20,098   copying deepspeed/compile/partitioner.py -> build/lib/deepspeed/compile
2025-06-02T17:17:20,101   copying deepspeed/compile/list_schedule.py -> build/lib/deepspeed/compile
2025-06-02T17:17:20,104   copying deepspeed/compile/patch_fake_tensor.py -> build/lib/deepspeed/compile
2025-06-02T17:17:20,106   copying deepspeed/compile/util.py -> build/lib/deepspeed/compile
2025-06-02T17:17:20,109   copying deepspeed/compile/init_z3.py -> build/lib/deepspeed/compile
2025-06-02T17:17:20,111   copying deepspeed/compile/fx.py -> build/lib/deepspeed/compile
2025-06-02T17:17:20,113   copying deepspeed/compile/backend.py -> build/lib/deepspeed/compile
2025-06-02T17:17:20,117   creating build/lib/deepspeed/launcher
2025-06-02T17:17:20,118   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2025-06-02T17:17:20,120   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2025-06-02T17:17:20,123   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2025-06-02T17:17:20,125   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2025-06-02T17:17:20,129   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2025-06-02T17:17:20,131   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2025-06-02T17:17:20,135   creating build/lib/deepspeed/runtime
2025-06-02T17:17:20,136   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,139   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,142   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,144   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,146   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,149   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,151   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,154   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,157   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,161   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,164   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,172   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,175   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,177   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,181   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,185   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,188   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,192   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2025-06-02T17:17:20,195   creating build/lib/deepspeed/checkpoint
2025-06-02T17:17:20,196   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2025-06-02T17:17:20,199   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2025-06-02T17:17:20,202   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2025-06-02T17:17:20,204   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2025-06-02T17:17:20,207   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-02T17:17:20,210   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2025-06-02T17:17:20,213   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-02T17:17:20,216   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2025-06-02T17:17:20,219   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-02T17:17:20,222   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2025-06-02T17:17:20,225   creating build/lib/deepspeed/pipe
2025-06-02T17:17:20,227   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2025-06-02T17:17:20,230   creating build/lib/deepspeed/elasticity
2025-06-02T17:17:20,232   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2025-06-02T17:17:20,235   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2025-06-02T17:17:20,237   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2025-06-02T17:17:20,240   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2025-06-02T17:17:20,242   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2025-06-02T17:17:20,245   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2025-06-02T17:17:20,249   creating build/lib/deepspeed/inference
2025-06-02T17:17:20,250   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2025-06-02T17:17:20,253   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2025-06-02T17:17:20,256   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2025-06-02T17:17:20,260   creating build/lib/deepspeed/model_implementations
2025-06-02T17:17:20,261   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2025-06-02T17:17:20,266   creating build/lib/deepspeed/module_inject
2025-06-02T17:17:20,267   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2025-06-02T17:17:20,271   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2025-06-02T17:17:20,273   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2025-06-02T17:17:20,276   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2025-06-02T17:17:20,278   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2025-06-02T17:17:20,280   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2025-06-02T17:17:20,283   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2025-06-02T17:17:20,285   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2025-06-02T17:17:20,288   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2025-06-02T17:17:20,290   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2025-06-02T17:17:20,293   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2025-06-02T17:17:20,296   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2025-06-02T17:17:20,299   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2025-06-02T17:17:20,302   creating build/lib/deepspeed/linear
2025-06-02T17:17:20,303   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2025-06-02T17:17:20,306   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2025-06-02T17:17:20,308   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2025-06-02T17:17:20,310   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2025-06-02T17:17:20,312   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2025-06-02T17:17:20,316   creating build/lib/deepspeed/comm
2025-06-02T17:17:20,317   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2025-06-02T17:17:20,319   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2025-06-02T17:17:20,321   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2025-06-02T17:17:20,325   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2025-06-02T17:17:20,327   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2025-06-02T17:17:20,329   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2025-06-02T17:17:20,331   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2025-06-02T17:17:20,334   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2025-06-02T17:17:20,336   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2025-06-02T17:17:20,340   creating build/lib/deepspeed/autotuning/tuner
2025-06-02T17:17:20,341   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2025-06-02T17:17:20,343   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2025-06-02T17:17:20,345   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-02T17:17:20,348   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2025-06-02T17:17:20,350   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-02T17:17:20,352   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-02T17:17:20,355   creating build/lib/deepspeed/ops/fp_quantizer
2025-06-02T17:17:20,357   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-02T17:17:20,359   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-02T17:17:20,361   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-02T17:17:20,364   copying deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-02T17:17:20,367   creating build/lib/deepspeed/ops/quantizer
2025-06-02T17:17:20,368   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2025-06-02T17:17:20,370   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2025-06-02T17:17:20,373   creating build/lib/deepspeed/ops/random_ltd
2025-06-02T17:17:20,374   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2025-06-02T17:17:20,376   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2025-06-02T17:17:20,379   creating build/lib/deepspeed/ops/lion
2025-06-02T17:17:20,380   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2025-06-02T17:17:20,383   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2025-06-02T17:17:20,385   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2025-06-02T17:17:20,388   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2025-06-02T17:17:20,391   creating build/lib/deepspeed/ops/lamb
2025-06-02T17:17:20,392   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2025-06-02T17:17:20,394   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2025-06-02T17:17:20,398   creating build/lib/deepspeed/ops/sparse_attention
2025-06-02T17:17:20,399   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-02T17:17:20,401   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-02T17:17:20,404   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-02T17:17:20,407   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-02T17:17:20,409   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-02T17:17:20,412   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-02T17:17:20,416   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-02T17:17:20,419   creating build/lib/deepspeed/ops/gds
2025-06-02T17:17:20,420   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2025-06-02T17:17:20,424   creating build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,425   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,427   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,429   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,431   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,433   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,435   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,437   copying deepspeed/ops/op_builder/dc.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,439   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,442   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,444   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,446   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,448   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,450   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,452   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,455   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,458   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,461   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,463   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,466   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,468   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,470   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,472   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,475   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,477   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,479   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-06-02T17:17:20,482   creating build/lib/deepspeed/ops/transformer
2025-06-02T17:17:20,483   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2025-06-02T17:17:20,485   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2025-06-02T17:17:20,489   creating build/lib/deepspeed/ops/adagrad
2025-06-02T17:17:20,491   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2025-06-02T17:17:20,493   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2025-06-02T17:17:20,496   creating build/lib/deepspeed/ops/deepspeed4science
2025-06-02T17:17:20,497   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2025-06-02T17:17:20,500   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2025-06-02T17:17:20,503   creating build/lib/deepspeed/ops/compile
2025-06-02T17:17:20,504   copying deepspeed/ops/compile/__init__.py -> build/lib/deepspeed/ops/compile
2025-06-02T17:17:20,507   creating build/lib/deepspeed/ops/aio
2025-06-02T17:17:20,508   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2025-06-02T17:17:20,511   creating build/lib/deepspeed/ops/adam
2025-06-02T17:17:20,512   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2025-06-02T17:17:20,514   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2025-06-02T17:17:20,517   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2025-06-02T17:17:20,519   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2025-06-02T17:17:20,522   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-02T17:17:20,523   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-02T17:17:20,526   creating build/lib/deepspeed/ops/op_builder/mlu
2025-06-02T17:17:20,527   copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-02T17:17:20,529   copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-02T17:17:20,532   copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-02T17:17:20,534   copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-02T17:17:20,536   copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-02T17:17:20,538   copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-02T17:17:20,541   creating build/lib/deepspeed/ops/op_builder/sdaa
2025-06-02T17:17:20,542   copying deepspeed/ops/op_builder/sdaa/no_impl.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-02T17:17:20,544   copying deepspeed/ops/op_builder/sdaa/__init__.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-02T17:17:20,546   copying deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-02T17:17:20,549   copying deepspeed/ops/op_builder/sdaa/builder.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-02T17:17:20,551   copying deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-02T17:17:20,554   creating build/lib/deepspeed/ops/op_builder/hpu
2025-06-02T17:17:20,555   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-02T17:17:20,557   copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-02T17:17:20,559   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-02T17:17:20,562   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-02T17:17:20,564   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-02T17:17:20,566   copying deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-02T17:17:20,568   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-02T17:17:20,571   creating build/lib/deepspeed/ops/op_builder/cpu
2025-06-02T17:17:20,572   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-02T17:17:20,574   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-02T17:17:20,577   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-02T17:17:20,579   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-02T17:17:20,581   copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-02T17:17:20,583   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-02T17:17:20,586   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-02T17:17:20,588   creating build/lib/deepspeed/ops/op_builder/npu
2025-06-02T17:17:20,590   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-02T17:17:20,592   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-02T17:17:20,594   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-02T17:17:20,596   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-02T17:17:20,598   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-02T17:17:20,601   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-02T17:17:20,603   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-02T17:17:20,606   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-02T17:17:20,608   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-02T17:17:20,611   creating build/lib/deepspeed/ops/op_builder/xpu
2025-06-02T17:17:20,612   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-02T17:17:20,614   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-02T17:17:20,616   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-02T17:17:20,619   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-02T17:17:20,621   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-02T17:17:20,623   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-02T17:17:20,626   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-02T17:17:20,628   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-02T17:17:20,630   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-02T17:17:20,633   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-02T17:17:20,636   creating build/lib/deepspeed/ops/transformer/inference
2025-06-02T17:17:20,637   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-02T17:17:20,640   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-02T17:17:20,642   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-02T17:17:20,645   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-02T17:17:20,647   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-02T17:17:20,650   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-02T17:17:20,653   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-02T17:17:20,656   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-02T17:17:20,659   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-02T17:17:20,661   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-02T17:17:20,664   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,665   copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,668   copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,670   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,672   copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,674   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,676   copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,679   copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,681   copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,683   copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,685   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,687   copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,689   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,692   copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,694   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,696   copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,699   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,701   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,704   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,706   copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,709   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,711   copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,713   copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,716   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:20,719   creating build/lib/deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:20,721   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:20,723   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:20,726   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:20,729   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:20,732   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:20,735   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:20,738   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:20,741   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:20,743   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:20,746   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:20,749   creating build/lib/deepspeed/profiling/flops_profiler
2025-06-02T17:17:20,750   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2025-06-02T17:17:20,753   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2025-06-02T17:17:20,757   creating build/lib/deepspeed/compile/profilers
2025-06-02T17:17:20,758   copying deepspeed/compile/profilers/comm_profile.py -> build/lib/deepspeed/compile/profilers
2025-06-02T17:17:20,761   copying deepspeed/compile/profilers/__init__.py -> build/lib/deepspeed/compile/profilers
2025-06-02T17:17:20,763   copying deepspeed/compile/profilers/graph_profile.py -> build/lib/deepspeed/compile/profilers
2025-06-02T17:17:20,766   creating build/lib/deepspeed/compile/passes
2025-06-02T17:17:20,767   copying deepspeed/compile/passes/__init__.py -> build/lib/deepspeed/compile/passes
2025-06-02T17:17:20,770   copying deepspeed/compile/passes/zero1_compile.py -> build/lib/deepspeed/compile/passes
2025-06-02T17:17:20,772   copying deepspeed/compile/passes/prefetch.py -> build/lib/deepspeed/compile/passes
2025-06-02T17:17:20,775   copying deepspeed/compile/passes/zero3_compile.py -> build/lib/deepspeed/compile/passes
2025-06-02T17:17:20,778   copying deepspeed/compile/passes/offload_activation.py -> build/lib/deepspeed/compile/passes
2025-06-02T17:17:20,780   copying deepspeed/compile/passes/selective_gather.py -> build/lib/deepspeed/compile/passes
2025-06-02T17:17:20,783   copying deepspeed/compile/passes/offload_parameters.py -> build/lib/deepspeed/compile/passes
2025-06-02T17:17:20,786   copying deepspeed/compile/passes/offload_adam_states.py -> build/lib/deepspeed/compile/passes
2025-06-02T17:17:20,790   creating build/lib/deepspeed/runtime/checkpoint_engine
2025-06-02T17:17:20,791   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-02T17:17:20,794   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-02T17:17:20,796   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-02T17:17:20,798   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-02T17:17:20,802   creating build/lib/deepspeed/runtime/fp16
2025-06-02T17:17:20,803   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2025-06-02T17:17:20,806   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2025-06-02T17:17:20,808   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-06-02T17:17:20,812   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-06-02T17:17:20,816   creating build/lib/deepspeed/runtime/activation_checkpointing
2025-06-02T17:17:20,817   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-02T17:17:20,820   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-02T17:17:20,822   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-02T17:17:20,827   creating build/lib/deepspeed/runtime/tensor_parallel
2025-06-02T17:17:20,828   copying deepspeed/runtime/tensor_parallel/config.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-02T17:17:20,831   copying deepspeed/runtime/tensor_parallel/__init__.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-02T17:17:20,833   copying deepspeed/runtime/tensor_parallel/tp_manager.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-02T17:17:20,836   creating build/lib/deepspeed/runtime/compression
2025-06-02T17:17:20,837   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2025-06-02T17:17:20,840   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2025-06-02T17:17:20,842   creating build/lib/deepspeed/runtime/domino
2025-06-02T17:17:20,843   copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino
2025-06-02T17:17:20,846   copying deepspeed/runtime/domino/async_linear.py -> build/lib/deepspeed/runtime/domino
2025-06-02T17:17:20,849   copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino
2025-06-02T17:17:20,853   creating build/lib/deepspeed/runtime/pipe
2025-06-02T17:17:20,854   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2025-06-02T17:17:20,858   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2025-06-02T17:17:20,860   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2025-06-02T17:17:20,865   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2025-06-02T17:17:20,868   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2025-06-02T17:17:20,871   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2025-06-02T17:17:20,875   creating build/lib/deepspeed/runtime/swap_tensor
2025-06-02T17:17:20,876   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-02T17:17:20,879   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-02T17:17:20,882   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-02T17:17:20,885   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-02T17:17:20,888   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-02T17:17:20,890   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-02T17:17:20,893   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-02T17:17:20,896   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-02T17:17:20,899   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-02T17:17:20,902   creating build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,904   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,906   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,909   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,911   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,916   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,919   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,925   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,928   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,932   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,935   copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,937   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,943   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,945   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,948   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,951   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,955   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,957   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2025-06-02T17:17:20,960   creating build/lib/deepspeed/runtime/comm
2025-06-02T17:17:20,961   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2025-06-02T17:17:20,964   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2025-06-02T17:17:20,967   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2025-06-02T17:17:20,969   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2025-06-02T17:17:20,972   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2025-06-02T17:17:20,975   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2025-06-02T17:17:20,979   creating build/lib/deepspeed/runtime/data_pipeline
2025-06-02T17:17:20,980   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-02T17:17:20,983   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-02T17:17:20,985   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-02T17:17:20,988   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-02T17:17:20,991   creating build/lib/deepspeed/runtime/fp16/onebit
2025-06-02T17:17:20,993   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-02T17:17:20,996   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-02T17:17:20,998   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-02T17:17:21,001   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-02T17:17:21,005   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-02T17:17:21,006   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-02T17:17:21,008   copying deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-02T17:17:21,011   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-02T17:17:21,015   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-02T17:17:21,017   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-02T17:17:21,020   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-02T17:17:21,024   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-02T17:17:21,025   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-02T17:17:21,027   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-02T17:17:21,030   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-02T17:17:21,032   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-02T17:17:21,035   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-02T17:17:21,039   creating build/lib/deepspeed/inference/v2
2025-06-02T17:17:21,040   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2025-06-02T17:17:21,043   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2025-06-02T17:17:21,045   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2025-06-02T17:17:21,048   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2025-06-02T17:17:21,050   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2025-06-02T17:17:21,052   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2025-06-02T17:17:21,055   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2025-06-02T17:17:21,058   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2025-06-02T17:17:21,060   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2025-06-02T17:17:21,064   creating build/lib/deepspeed/inference/quantization
2025-06-02T17:17:21,065   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2025-06-02T17:17:21,067   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2025-06-02T17:17:21,070   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2025-06-02T17:17:21,072   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2025-06-02T17:17:21,075   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2025-06-02T17:17:21,078   creating build/lib/deepspeed/inference/v2/modules
2025-06-02T17:17:21,080   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2025-06-02T17:17:21,083   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2025-06-02T17:17:21,085   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2025-06-02T17:17:21,088   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2025-06-02T17:17:21,091   creating build/lib/deepspeed/inference/v2/ragged
2025-06-02T17:17:21,093   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-02T17:17:21,096   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-02T17:17:21,099   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-02T17:17:21,102   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-02T17:17:21,105   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-02T17:17:21,108   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-02T17:17:21,111   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-02T17:17:21,115   creating build/lib/deepspeed/inference/v2/kernels
2025-06-02T17:17:21,116   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2025-06-02T17:17:21,119   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2025-06-02T17:17:21,122   creating build/lib/deepspeed/inference/v2/checkpoint
2025-06-02T17:17:21,124   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-02T17:17:21,126   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-02T17:17:21,129   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-02T17:17:21,132   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-02T17:17:21,135   creating build/lib/deepspeed/inference/v2/model_implementations
2025-06-02T17:17:21,137   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-02T17:17:21,140   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-02T17:17:21,143   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-02T17:17:21,146   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-02T17:17:21,150   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-02T17:17:21,153   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-02T17:17:21,156   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-02T17:17:21,160   creating build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:21,161   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:21,164   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:21,167   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:21,169   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:21,172   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:21,175   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:21,178   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:21,180   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:21,184   creating build/lib/deepspeed/inference/v2/modules/implementations
2025-06-02T17:17:21,185   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2025-06-02T17:17:21,188   creating build/lib/deepspeed/inference/v2/modules/configs
2025-06-02T17:17:21,190   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-02T17:17:21,193   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-02T17:17:21,196   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-02T17:17:21,198   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-02T17:17:21,201   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-02T17:17:21,204   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-02T17:17:21,206   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-02T17:17:21,209   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-02T17:17:21,211   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-02T17:17:21,213   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-02T17:17:21,216   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-02T17:17:21,219   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-02T17:17:21,220   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-02T17:17:21,223   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-02T17:17:21,226   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-02T17:17:21,227   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-02T17:17:21,230   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-02T17:17:21,233   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-02T17:17:21,235   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-02T17:17:21,238   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-02T17:17:21,240   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-02T17:17:21,242   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-02T17:17:21,245   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-02T17:17:21,248   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-02T17:17:21,250   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-02T17:17:21,252   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-02T17:17:21,256   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-02T17:17:21,257   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-02T17:17:21,260   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-02T17:17:21,263   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-02T17:17:21,266   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-02T17:17:21,268   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-02T17:17:21,271   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-02T17:17:21,272   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-02T17:17:21,275   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-02T17:17:21,277   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-02T17:17:21,280   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-02T17:17:21,282   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-02T17:17:21,284   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-02T17:17:21,287   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-02T17:17:21,290   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-02T17:17:21,291   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-02T17:17:21,294   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-02T17:17:21,296   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-02T17:17:21,298   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-02T17:17:21,301   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-02T17:17:21,303   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-02T17:17:21,306   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-02T17:17:21,308   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-02T17:17:21,310   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-02T17:17:21,312   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-02T17:17:21,316   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-02T17:17:21,317   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-02T17:17:21,320   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-02T17:17:21,323   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:21,324   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:21,327   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:21,329   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:21,332   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:21,335   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:21,338   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-02T17:17:21,339   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-02T17:17:21,342   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-02T17:17:21,346   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-02T17:17:21,347   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-02T17:17:21,350   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-02T17:17:21,353   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-02T17:17:21,354   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-02T17:17:21,357   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-02T17:17:21,360   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-02T17:17:21,362   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-02T17:17:21,364   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-02T17:17:21,367   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-02T17:17:21,369   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-02T17:17:21,372   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-02T17:17:21,375   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-02T17:17:21,376   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-02T17:17:21,379   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-02T17:17:21,382   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-02T17:17:21,383   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-02T17:17:21,386   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-02T17:17:21,389   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-02T17:17:21,391   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-02T17:17:21,394   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-02T17:17:21,397   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-02T17:17:21,398   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-02T17:17:21,401   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-02T17:17:21,404   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:21,406   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:21,408   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:21,411   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:21,413   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:21,416   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-02T17:17:21,418   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-02T17:17:21,421   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-02T17:17:21,423   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-02T17:17:21,426   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-02T17:17:21,430   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-02T17:17:21,432   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-02T17:17:21,435   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-02T17:17:21,438   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-02T17:17:21,441   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-02T17:17:21,445   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-02T17:17:21,447   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-02T17:17:21,450   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-02T17:17:21,452   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-02T17:17:21,455   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-02T17:17:21,459   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-02T17:17:21,460   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-02T17:17:21,463   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-02T17:17:21,466   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-02T17:17:21,468   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-02T17:17:21,472   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-02T17:17:21,474   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-02T17:17:21,477   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-02T17:17:21,479   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-02T17:17:21,482   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-02T17:17:21,486   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-02T17:17:21,488   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-02T17:17:21,491   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-02T17:17:21,493   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-02T17:17:21,496   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-02T17:17:21,500   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-02T17:17:21,501   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-02T17:17:21,504   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-02T17:17:21,506   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-02T17:17:21,509   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-02T17:17:21,513   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-02T17:17:21,515   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-02T17:17:21,517   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-02T17:17:21,520   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-02T17:17:21,522   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-02T17:17:21,526   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:21,528   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:21,531   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:21,533   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:21,536   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:21,538   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:21,541   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:21,543   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:21,546   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:21,549   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:21,552   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-02T17:17:21,554   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-02T17:17:21,557   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-02T17:17:21,560   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-02T17:17:21,562   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-02T17:17:21,566   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-02T17:17:21,568   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-02T17:17:21,571   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-02T17:17:21,574   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-02T17:17:21,576   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-02T17:17:21,581   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:21,583   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:21,586   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:21,589   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:21,591   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:21,594   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:21,597   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:21,600   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:21,603   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:21,606   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:21,610   creating build/lib/deepspeed/model_implementations/diffusers
2025-06-02T17:17:21,612   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-02T17:17:21,614   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-02T17:17:21,617   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-02T17:17:21,621   creating build/lib/deepspeed/model_implementations/transformers
2025-06-02T17:17:21,623   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-02T17:17:21,626   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-02T17:17:21,629   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-02T17:17:21,632   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-02T17:17:21,635   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-02T17:17:21,638   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-02T17:17:21,640   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-02T17:17:21,643   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-02T17:17:21,645   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-02T17:17:21,648   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-02T17:17:21,652   creating build/lib/deepspeed/model_implementations/features
2025-06-02T17:17:21,653   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2025-06-02T17:17:21,656   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2025-06-02T17:17:21,660   creating build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,662   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,665   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,668   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,670   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,673   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,676   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,678   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,681   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,685   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,688   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,692   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,694   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,698   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,700   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,703   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,707   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,711   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,714   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,717   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2025-06-02T17:17:21,721   creating build/lib/deepspeed/module_inject/containers/features
2025-06-02T17:17:21,723   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-02T17:17:21,725   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-02T17:17:21,728   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-02T17:17:21,731   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-02T17:17:21,734   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-02T17:17:21,738   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-02T17:17:21,741   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-02T17:17:21,745   running egg_info
2025-06-02T17:17:21,776   writing deepspeed.egg-info/PKG-INFO
2025-06-02T17:17:21,812   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2025-06-02T17:17:21,814   writing entry points to deepspeed.egg-info/entry_points.txt
2025-06-02T17:17:21,833   writing requirements to deepspeed.egg-info/requires.txt
2025-06-02T17:17:21,835   writing top-level names to deepspeed.egg-info/top_level.txt
2025-06-02T17:17:21,989   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-06-02T17:17:22,093   reading manifest template 'MANIFEST.in'
2025-06-02T17:17:22,095   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-06-02T17:17:22,096   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-06-02T17:17:24,176   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-06-02T17:17:25,418   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-06-02T17:17:26,426   warning: no files found matching '*.tr' under directory 'csrc'
2025-06-02T17:17:26,588   warning: no files found matching '*.cc' under directory 'csrc'
2025-06-02T17:17:26,649   warning: no files found matching '*.py' under directory 'benchmarks'
2025-06-02T17:17:26,656   adding license file 'LICENSE'
2025-06-02T17:17:26,714   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-06-02T17:17:26,723   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2025-06-02T17:17:26,724   !!

2025-06-02T17:17:26,725           ********************************************************************************
2025-06-02T17:17:26,726           ############################
2025-06-02T17:17:26,726           # Package would be ignored #
2025-06-02T17:17:26,727           ############################
2025-06-02T17:17:26,727           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2025-06-02T17:17:26,728           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:26,729           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:26,730           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2025-06-02T17:17:26,730           to the `packages` configuration field.

2025-06-02T17:17:26,732           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:26,732           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:26,733           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:26,734           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:26,735           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:26,736           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2025-06-02T17:17:26,737           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2025-06-02T17:17:26,737           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:26,738           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:26,738           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:26,739           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:26,740           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:26,741           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:26,742                 even if it does not contain any `.py` files.
2025-06-02T17:17:26,742                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:26,743                 directory, all directories are treated like packages.
2025-06-02T17:17:26,743           ********************************************************************************

2025-06-02T17:17:26,744   !!
2025-06-02T17:17:26,745     check.warn(importable)
2025-06-02T17:17:26,745   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2025-06-02T17:17:26,745   !!

2025-06-02T17:17:26,747           ********************************************************************************
2025-06-02T17:17:26,747           ############################
2025-06-02T17:17:26,748           # Package would be ignored #
2025-06-02T17:17:26,749           ############################
2025-06-02T17:17:26,749           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2025-06-02T17:17:26,750           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:26,751           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:26,752           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2025-06-02T17:17:26,752           to the `packages` configuration field.

2025-06-02T17:17:26,754           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:26,754           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:26,755           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:26,756           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:26,757           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:26,758           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2025-06-02T17:17:26,758           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2025-06-02T17:17:26,759           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:26,760           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:26,760           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:26,761           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:26,762           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:26,764           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:26,765                 even if it does not contain any `.py` files.
2025-06-02T17:17:26,765                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:26,765                 directory, all directories are treated like packages.
2025-06-02T17:17:26,766           ********************************************************************************

2025-06-02T17:17:26,767   !!
2025-06-02T17:17:26,767     check.warn(importable)
2025-06-02T17:17:26,768   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2025-06-02T17:17:26,768   !!

2025-06-02T17:17:26,769           ********************************************************************************
2025-06-02T17:17:26,770           ############################
2025-06-02T17:17:26,770           # Package would be ignored #
2025-06-02T17:17:26,771           ############################
2025-06-02T17:17:26,771           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2025-06-02T17:17:26,772           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:26,773           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:26,773           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2025-06-02T17:17:26,774           to the `packages` configuration field.

2025-06-02T17:17:26,775           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:26,776           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:26,776           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:26,777           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:26,779           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:26,780           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2025-06-02T17:17:26,781           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2025-06-02T17:17:26,781           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:26,782           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:26,782           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:26,784           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:26,785           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:26,786           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:26,787                 even if it does not contain any `.py` files.
2025-06-02T17:17:26,787                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:26,788                 directory, all directories are treated like packages.
2025-06-02T17:17:26,789           ********************************************************************************

2025-06-02T17:17:26,790   !!
2025-06-02T17:17:26,791     check.warn(importable)
2025-06-02T17:17:26,791   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2025-06-02T17:17:26,792   !!

2025-06-02T17:17:26,793           ********************************************************************************
2025-06-02T17:17:26,793           ############################
2025-06-02T17:17:26,794           # Package would be ignored #
2025-06-02T17:17:26,795           ############################
2025-06-02T17:17:26,796           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2025-06-02T17:17:26,796           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:26,797           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:26,798           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2025-06-02T17:17:26,798           to the `packages` configuration field.

2025-06-02T17:17:26,799           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:26,799           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:26,800           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:26,800           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:26,801           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:26,802           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2025-06-02T17:17:26,803           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2025-06-02T17:17:26,803           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:26,804           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:26,804           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:26,805           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:26,806           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:26,808           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:26,809                 even if it does not contain any `.py` files.
2025-06-02T17:17:26,809                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:26,810                 directory, all directories are treated like packages.
2025-06-02T17:17:26,811           ********************************************************************************

2025-06-02T17:17:26,812   !!
2025-06-02T17:17:26,812     check.warn(importable)
2025-06-02T17:17:26,813   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2025-06-02T17:17:26,813   !!

2025-06-02T17:17:26,814           ********************************************************************************
2025-06-02T17:17:26,815           ############################
2025-06-02T17:17:26,815           # Package would be ignored #
2025-06-02T17:17:26,816           ############################
2025-06-02T17:17:26,816           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2025-06-02T17:17:26,817           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:26,818           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:26,819           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2025-06-02T17:17:26,819           to the `packages` configuration field.

2025-06-02T17:17:26,821           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:26,821           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:26,822           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:26,823           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:26,824           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:26,825           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2025-06-02T17:17:26,826           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2025-06-02T17:17:26,827           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:26,827           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:26,828           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:26,829           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:26,830           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:26,831           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:26,832                 even if it does not contain any `.py` files.
2025-06-02T17:17:26,832                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:26,833                 directory, all directories are treated like packages.
2025-06-02T17:17:26,833           ********************************************************************************

2025-06-02T17:17:26,834   !!
2025-06-02T17:17:26,835     check.warn(importable)
2025-06-02T17:17:26,835   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2025-06-02T17:17:26,835   !!

2025-06-02T17:17:26,836           ********************************************************************************
2025-06-02T17:17:26,837           ############################
2025-06-02T17:17:26,837           # Package would be ignored #
2025-06-02T17:17:26,838           ############################
2025-06-02T17:17:26,839           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2025-06-02T17:17:26,839           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:26,840           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:26,841           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2025-06-02T17:17:26,842           to the `packages` configuration field.

2025-06-02T17:17:26,843           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:26,843           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:26,844           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:26,845           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:26,847           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:26,848           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2025-06-02T17:17:26,848           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2025-06-02T17:17:26,849           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:26,849           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:26,850           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:26,851           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:26,852           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:26,854           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:26,855                 even if it does not contain any `.py` files.
2025-06-02T17:17:26,856                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:26,856                 directory, all directories are treated like packages.
2025-06-02T17:17:26,857           ********************************************************************************

2025-06-02T17:17:26,858   !!
2025-06-02T17:17:26,859     check.warn(importable)
2025-06-02T17:17:26,859   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2025-06-02T17:17:26,860   !!

2025-06-02T17:17:26,861           ********************************************************************************
2025-06-02T17:17:26,861           ############################
2025-06-02T17:17:26,862           # Package would be ignored #
2025-06-02T17:17:26,862           ############################
2025-06-02T17:17:26,863           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2025-06-02T17:17:26,863           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:26,865           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:26,865           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2025-06-02T17:17:26,865           to the `packages` configuration field.

2025-06-02T17:17:26,866           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:26,867           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:26,867           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:26,868           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:26,869           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:26,870           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2025-06-02T17:17:26,871           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2025-06-02T17:17:26,872           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:26,872           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:26,873           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:26,874           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:26,875           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:26,877           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:26,878                 even if it does not contain any `.py` files.
2025-06-02T17:17:26,878                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:26,879                 directory, all directories are treated like packages.
2025-06-02T17:17:26,880           ********************************************************************************

2025-06-02T17:17:26,881   !!
2025-06-02T17:17:26,881     check.warn(importable)
2025-06-02T17:17:26,882   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2025-06-02T17:17:26,882   !!

2025-06-02T17:17:26,883           ********************************************************************************
2025-06-02T17:17:26,884           ############################
2025-06-02T17:17:26,884           # Package would be ignored #
2025-06-02T17:17:26,885           ############################
2025-06-02T17:17:26,885           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2025-06-02T17:17:26,886           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:26,887           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:26,888           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2025-06-02T17:17:26,889           to the `packages` configuration field.

2025-06-02T17:17:26,890           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:26,890           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:26,891           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:26,891           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:26,892           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:26,893           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2025-06-02T17:17:26,894           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2025-06-02T17:17:26,894           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:26,894           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:26,895           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:26,896           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:26,897           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:26,898           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:26,899                 even if it does not contain any `.py` files.
2025-06-02T17:17:26,899                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:26,900                 directory, all directories are treated like packages.
2025-06-02T17:17:26,900           ********************************************************************************

2025-06-02T17:17:26,902   !!
2025-06-02T17:17:26,902     check.warn(importable)
2025-06-02T17:17:26,903   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2025-06-02T17:17:26,904   !!

2025-06-02T17:17:26,905           ********************************************************************************
2025-06-02T17:17:26,906           ############################
2025-06-02T17:17:26,906           # Package would be ignored #
2025-06-02T17:17:26,907           ############################
2025-06-02T17:17:26,907           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2025-06-02T17:17:26,908           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:26,909           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:26,910           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2025-06-02T17:17:26,911           to the `packages` configuration field.

2025-06-02T17:17:26,912           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:26,912           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:26,913           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:26,914           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:26,915           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:26,917           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2025-06-02T17:17:26,917           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2025-06-02T17:17:26,918           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:26,919           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:26,919           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:26,921           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:26,922           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:26,923           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:26,924                 even if it does not contain any `.py` files.
2025-06-02T17:17:26,924                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:26,925                 directory, all directories are treated like packages.
2025-06-02T17:17:26,925           ********************************************************************************

2025-06-02T17:17:26,926   !!
2025-06-02T17:17:26,926     check.warn(importable)
2025-06-02T17:17:26,927   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2025-06-02T17:17:26,927   !!

2025-06-02T17:17:26,928           ********************************************************************************
2025-06-02T17:17:26,928           ############################
2025-06-02T17:17:26,929           # Package would be ignored #
2025-06-02T17:17:26,929           ############################
2025-06-02T17:17:26,930           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2025-06-02T17:17:26,930           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:26,931           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:26,931           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2025-06-02T17:17:26,932           to the `packages` configuration field.

2025-06-02T17:17:26,933           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:26,934           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:26,934           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:26,935           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:26,937           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:26,938           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2025-06-02T17:17:26,938           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2025-06-02T17:17:26,939           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:26,939           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:26,940           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:26,941           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:26,942           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:26,944           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:26,944                 even if it does not contain any `.py` files.
2025-06-02T17:17:26,945                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:26,945                 directory, all directories are treated like packages.
2025-06-02T17:17:26,946           ********************************************************************************

2025-06-02T17:17:26,947   !!
2025-06-02T17:17:26,947     check.warn(importable)
2025-06-02T17:17:26,948   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2025-06-02T17:17:26,949   !!

2025-06-02T17:17:26,950           ********************************************************************************
2025-06-02T17:17:26,951           ############################
2025-06-02T17:17:26,951           # Package would be ignored #
2025-06-02T17:17:26,952           ############################
2025-06-02T17:17:26,953           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2025-06-02T17:17:26,953           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:26,954           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:26,954           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2025-06-02T17:17:26,955           to the `packages` configuration field.

2025-06-02T17:17:26,956           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:26,956           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:26,957           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:26,957           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:26,958           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:26,959           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2025-06-02T17:17:26,960           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2025-06-02T17:17:26,960           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:26,960           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:26,961           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:26,962           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:26,963           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:26,965           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:26,965                 even if it does not contain any `.py` files.
2025-06-02T17:17:26,966                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:26,967                 directory, all directories are treated like packages.
2025-06-02T17:17:26,967           ********************************************************************************

2025-06-02T17:17:26,969   !!
2025-06-02T17:17:26,969     check.warn(importable)
2025-06-02T17:17:26,970   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2025-06-02T17:17:26,970   !!

2025-06-02T17:17:26,972           ********************************************************************************
2025-06-02T17:17:26,972           ############################
2025-06-02T17:17:26,973           # Package would be ignored #
2025-06-02T17:17:26,973           ############################
2025-06-02T17:17:26,974           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2025-06-02T17:17:26,974           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:26,975           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:26,976           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2025-06-02T17:17:26,976           to the `packages` configuration field.

2025-06-02T17:17:26,978           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:26,978           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:26,979           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:26,980           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:26,981           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:26,982           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2025-06-02T17:17:26,983           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2025-06-02T17:17:26,983           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:26,984           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:26,985           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:26,986           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:26,986           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:26,988           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:26,988                 even if it does not contain any `.py` files.
2025-06-02T17:17:26,989                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:26,989                 directory, all directories are treated like packages.
2025-06-02T17:17:26,990           ********************************************************************************

2025-06-02T17:17:26,990   !!
2025-06-02T17:17:26,991     check.warn(importable)
2025-06-02T17:17:26,991   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2025-06-02T17:17:26,992   !!

2025-06-02T17:17:26,993           ********************************************************************************
2025-06-02T17:17:26,993           ############################
2025-06-02T17:17:26,994           # Package would be ignored #
2025-06-02T17:17:26,994           ############################
2025-06-02T17:17:26,995           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2025-06-02T17:17:26,996           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:26,997           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:26,998           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2025-06-02T17:17:26,998           to the `packages` configuration field.

2025-06-02T17:17:27,000           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,000           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,001           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,002           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,004           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,005           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2025-06-02T17:17:27,006           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2025-06-02T17:17:27,007           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,007           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,008           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,009           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,010           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,012           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,012                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,013                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,013                 directory, all directories are treated like packages.
2025-06-02T17:17:27,014           ********************************************************************************

2025-06-02T17:17:27,015   !!
2025-06-02T17:17:27,016     check.warn(importable)
2025-06-02T17:17:27,016   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.compile' is absent from the `packages` configuration.
2025-06-02T17:17:27,017   !!

2025-06-02T17:17:27,018           ********************************************************************************
2025-06-02T17:17:27,019           ############################
2025-06-02T17:17:27,019           # Package would be ignored #
2025-06-02T17:17:27,020           ############################
2025-06-02T17:17:27,020           Python recognizes 'deepspeed.ops.csrc.compile' as an importable package[^1],
2025-06-02T17:17:27,021           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,022           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,022           package, please make sure that 'deepspeed.ops.csrc.compile' is explicitly added
2025-06-02T17:17:27,022           to the `packages` configuration field.

2025-06-02T17:17:27,023           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,024           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,024           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,025           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,026           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,027           If you don't want 'deepspeed.ops.csrc.compile' to be distributed and are
2025-06-02T17:17:27,028           already explicitly excluding 'deepspeed.ops.csrc.compile' via
2025-06-02T17:17:27,028           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,029           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,029           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,031           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,032           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,034           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,034                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,035                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,036                 directory, all directories are treated like packages.
2025-06-02T17:17:27,036           ********************************************************************************

2025-06-02T17:17:27,037   !!
2025-06-02T17:17:27,038     check.warn(importable)
2025-06-02T17:17:27,039   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2025-06-02T17:17:27,039   !!

2025-06-02T17:17:27,040           ********************************************************************************
2025-06-02T17:17:27,041           ############################
2025-06-02T17:17:27,041           # Package would be ignored #
2025-06-02T17:17:27,042           ############################
2025-06-02T17:17:27,043           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2025-06-02T17:17:27,043           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,044           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,045           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2025-06-02T17:17:27,046           to the `packages` configuration field.

2025-06-02T17:17:27,047           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,048           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,048           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,050           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,051           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,052           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2025-06-02T17:17:27,052           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2025-06-02T17:17:27,052           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,053           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,053           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,054           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,055           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,057           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,058                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,058                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,059                 directory, all directories are treated like packages.
2025-06-02T17:17:27,059           ********************************************************************************

2025-06-02T17:17:27,060   !!
2025-06-02T17:17:27,061     check.warn(importable)
2025-06-02T17:17:27,062   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2025-06-02T17:17:27,062   !!

2025-06-02T17:17:27,063           ********************************************************************************
2025-06-02T17:17:27,064           ############################
2025-06-02T17:17:27,064           # Package would be ignored #
2025-06-02T17:17:27,065           ############################
2025-06-02T17:17:27,065           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2025-06-02T17:17:27,066           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,067           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,068           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2025-06-02T17:17:27,069           to the `packages` configuration field.

2025-06-02T17:17:27,070           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,071           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,071           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,072           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,073           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,074           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2025-06-02T17:17:27,075           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2025-06-02T17:17:27,075           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,076           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,076           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,078           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,079           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,081           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,081                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,082                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,083                 directory, all directories are treated like packages.
2025-06-02T17:17:27,083           ********************************************************************************

2025-06-02T17:17:27,084   !!
2025-06-02T17:17:27,085     check.warn(importable)
2025-06-02T17:17:27,085   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2025-06-02T17:17:27,085   !!

2025-06-02T17:17:27,086           ********************************************************************************
2025-06-02T17:17:27,087           ############################
2025-06-02T17:17:27,087           # Package would be ignored #
2025-06-02T17:17:27,087           ############################
2025-06-02T17:17:27,088           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2025-06-02T17:17:27,088           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,089           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,093           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2025-06-02T17:17:27,094           to the `packages` configuration field.

2025-06-02T17:17:27,095           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,095           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,096           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,097           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,098           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,099           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2025-06-02T17:17:27,100           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2025-06-02T17:17:27,100           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,101           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,102           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,103           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,104           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,106           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,107                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,107                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,108                 directory, all directories are treated like packages.
2025-06-02T17:17:27,108           ********************************************************************************

2025-06-02T17:17:27,109   !!
2025-06-02T17:17:27,110     check.warn(importable)
2025-06-02T17:17:27,111   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2025-06-02T17:17:27,111   !!

2025-06-02T17:17:27,112           ********************************************************************************
2025-06-02T17:17:27,113           ############################
2025-06-02T17:17:27,113           # Package would be ignored #
2025-06-02T17:17:27,114           ############################
2025-06-02T17:17:27,114           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2025-06-02T17:17:27,115           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,116           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,116           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2025-06-02T17:17:27,117           to the `packages` configuration field.

2025-06-02T17:17:27,118           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,119           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,119           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,120           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,121           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,122           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2025-06-02T17:17:27,122           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2025-06-02T17:17:27,123           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,123           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,124           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,124           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,125           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,127           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,127                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,128                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,128                 directory, all directories are treated like packages.
2025-06-02T17:17:27,129           ********************************************************************************

2025-06-02T17:17:27,130   !!
2025-06-02T17:17:27,131     check.warn(importable)
2025-06-02T17:17:27,131   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2025-06-02T17:17:27,132   !!

2025-06-02T17:17:27,133           ********************************************************************************
2025-06-02T17:17:27,134           ############################
2025-06-02T17:17:27,134           # Package would be ignored #
2025-06-02T17:17:27,135           ############################
2025-06-02T17:17:27,136           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2025-06-02T17:17:27,136           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,137           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,138           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2025-06-02T17:17:27,139           to the `packages` configuration field.

2025-06-02T17:17:27,140           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,140           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,141           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,142           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,143           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,144           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2025-06-02T17:17:27,145           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2025-06-02T17:17:27,145           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,146           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,147           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,147           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,148           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,150           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,150                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,150                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,151                 directory, all directories are treated like packages.
2025-06-02T17:17:27,151           ********************************************************************************

2025-06-02T17:17:27,152   !!
2025-06-02T17:17:27,153     check.warn(importable)
2025-06-02T17:17:27,153   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2025-06-02T17:17:27,153   !!

2025-06-02T17:17:27,154           ********************************************************************************
2025-06-02T17:17:27,155           ############################
2025-06-02T17:17:27,155           # Package would be ignored #
2025-06-02T17:17:27,156           ############################
2025-06-02T17:17:27,156           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2025-06-02T17:17:27,157           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,158           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,158           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2025-06-02T17:17:27,159           to the `packages` configuration field.

2025-06-02T17:17:27,160           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,161           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,161           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,162           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,163           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,164           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2025-06-02T17:17:27,165           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2025-06-02T17:17:27,165           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,166           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,166           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,167           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,168           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,170           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,170                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,171                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,171                 directory, all directories are treated like packages.
2025-06-02T17:17:27,172           ********************************************************************************

2025-06-02T17:17:27,173   !!
2025-06-02T17:17:27,173     check.warn(importable)
2025-06-02T17:17:27,176   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2025-06-02T17:17:27,177   !!

2025-06-02T17:17:27,177           ********************************************************************************
2025-06-02T17:17:27,178           ############################
2025-06-02T17:17:27,178           # Package would be ignored #
2025-06-02T17:17:27,179           ############################
2025-06-02T17:17:27,179           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2025-06-02T17:17:27,179           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,180           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,181           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2025-06-02T17:17:27,181           to the `packages` configuration field.

2025-06-02T17:17:27,182           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,182           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,183           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,184           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,185           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,186           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2025-06-02T17:17:27,186           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2025-06-02T17:17:27,187           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,187           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,187           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,188           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,189           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,191           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,191                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,191                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,192                 directory, all directories are treated like packages.
2025-06-02T17:17:27,192           ********************************************************************************

2025-06-02T17:17:27,193   !!
2025-06-02T17:17:27,194     check.warn(importable)
2025-06-02T17:17:27,194   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2025-06-02T17:17:27,195   !!

2025-06-02T17:17:27,196           ********************************************************************************
2025-06-02T17:17:27,196           ############################
2025-06-02T17:17:27,197           # Package would be ignored #
2025-06-02T17:17:27,197           ############################
2025-06-02T17:17:27,198           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2025-06-02T17:17:27,198           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,199           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,200           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2025-06-02T17:17:27,200           to the `packages` configuration field.

2025-06-02T17:17:27,201           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,202           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,202           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,203           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,204           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,205           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2025-06-02T17:17:27,205           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2025-06-02T17:17:27,205           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,206           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,206           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,207           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,208           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,209           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,210                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,210                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,210                 directory, all directories are treated like packages.
2025-06-02T17:17:27,211           ********************************************************************************

2025-06-02T17:17:27,212   !!
2025-06-02T17:17:27,212     check.warn(importable)
2025-06-02T17:17:27,213   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2025-06-02T17:17:27,213   !!

2025-06-02T17:17:27,214           ********************************************************************************
2025-06-02T17:17:27,214           ############################
2025-06-02T17:17:27,215           # Package would be ignored #
2025-06-02T17:17:27,215           ############################
2025-06-02T17:17:27,216           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2025-06-02T17:17:27,216           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,217           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,218           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2025-06-02T17:17:27,218           to the `packages` configuration field.

2025-06-02T17:17:27,219           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,220           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,220           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,221           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,222           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,223           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2025-06-02T17:17:27,224           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2025-06-02T17:17:27,224           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,225           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,226           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,227           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,228           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,229           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,229                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,230                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,230                 directory, all directories are treated like packages.
2025-06-02T17:17:27,231           ********************************************************************************

2025-06-02T17:17:27,231   !!
2025-06-02T17:17:27,232     check.warn(importable)
2025-06-02T17:17:27,232   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2025-06-02T17:17:27,233   !!

2025-06-02T17:17:27,234           ********************************************************************************
2025-06-02T17:17:27,234           ############################
2025-06-02T17:17:27,235           # Package would be ignored #
2025-06-02T17:17:27,235           ############################
2025-06-02T17:17:27,236           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2025-06-02T17:17:27,236           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,237           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,238           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2025-06-02T17:17:27,238           to the `packages` configuration field.

2025-06-02T17:17:27,239           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,239           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,240           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,241           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,242           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,243           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2025-06-02T17:17:27,243           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2025-06-02T17:17:27,243           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,244           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,245           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,247           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,248           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,250           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,251                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,251                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,252                 directory, all directories are treated like packages.
2025-06-02T17:17:27,252           ********************************************************************************

2025-06-02T17:17:27,253   !!
2025-06-02T17:17:27,254     check.warn(importable)
2025-06-02T17:17:27,254   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2025-06-02T17:17:27,255   !!

2025-06-02T17:17:27,256           ********************************************************************************
2025-06-02T17:17:27,256           ############################
2025-06-02T17:17:27,257           # Package would be ignored #
2025-06-02T17:17:27,257           ############################
2025-06-02T17:17:27,258           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2025-06-02T17:17:27,258           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,259           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,260           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2025-06-02T17:17:27,260           to the `packages` configuration field.

2025-06-02T17:17:27,261           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,262           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,262           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,263           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,264           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,265           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2025-06-02T17:17:27,265           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2025-06-02T17:17:27,266           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,266           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,266           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,267           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,268           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,270           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,270                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,271                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,271                 directory, all directories are treated like packages.
2025-06-02T17:17:27,272           ********************************************************************************

2025-06-02T17:17:27,272   !!
2025-06-02T17:17:27,273     check.warn(importable)
2025-06-02T17:17:27,273   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2025-06-02T17:17:27,274   !!

2025-06-02T17:17:27,275           ********************************************************************************
2025-06-02T17:17:27,275           ############################
2025-06-02T17:17:27,276           # Package would be ignored #
2025-06-02T17:17:27,277           ############################
2025-06-02T17:17:27,277           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2025-06-02T17:17:27,278           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,279           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,279           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2025-06-02T17:17:27,280           to the `packages` configuration field.

2025-06-02T17:17:27,281           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,281           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,282           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,283           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,284           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,285           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2025-06-02T17:17:27,286           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2025-06-02T17:17:27,286           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,287           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,287           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,288           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,289           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,290           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,291                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,291                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,292                 directory, all directories are treated like packages.
2025-06-02T17:17:27,292           ********************************************************************************

2025-06-02T17:17:27,293   !!
2025-06-02T17:17:27,293     check.warn(importable)
2025-06-02T17:17:27,294   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2025-06-02T17:17:27,294   !!

2025-06-02T17:17:27,295           ********************************************************************************
2025-06-02T17:17:27,296           ############################
2025-06-02T17:17:27,297           # Package would be ignored #
2025-06-02T17:17:27,297           ############################
2025-06-02T17:17:27,298           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2025-06-02T17:17:27,298           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,299           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,300           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2025-06-02T17:17:27,301           to the `packages` configuration field.

2025-06-02T17:17:27,302           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,302           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,303           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,304           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,305           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,306           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2025-06-02T17:17:27,307           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2025-06-02T17:17:27,307           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,308           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,308           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,309           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,310           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,312           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,313                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,313                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,314                 directory, all directories are treated like packages.
2025-06-02T17:17:27,314           ********************************************************************************

2025-06-02T17:17:27,315   !!
2025-06-02T17:17:27,316     check.warn(importable)
2025-06-02T17:17:27,317   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2025-06-02T17:17:27,317   !!

2025-06-02T17:17:27,318           ********************************************************************************
2025-06-02T17:17:27,318           ############################
2025-06-02T17:17:27,319           # Package would be ignored #
2025-06-02T17:17:27,319           ############################
2025-06-02T17:17:27,320           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2025-06-02T17:17:27,320           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,321           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,322           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2025-06-02T17:17:27,322           to the `packages` configuration field.

2025-06-02T17:17:27,323           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,323           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,324           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,325           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,326           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,327           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2025-06-02T17:17:27,327           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2025-06-02T17:17:27,328           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,328           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,329           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,330           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,331           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,333           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,333                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,334                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,334                 directory, all directories are treated like packages.
2025-06-02T17:17:27,335           ********************************************************************************

2025-06-02T17:17:27,336   !!
2025-06-02T17:17:27,336     check.warn(importable)
2025-06-02T17:17:27,337   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2025-06-02T17:17:27,337   !!

2025-06-02T17:17:27,338           ********************************************************************************
2025-06-02T17:17:27,339           ############################
2025-06-02T17:17:27,339           # Package would be ignored #
2025-06-02T17:17:27,340           ############################
2025-06-02T17:17:27,340           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2025-06-02T17:17:27,341           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,342           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,343           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2025-06-02T17:17:27,343           to the `packages` configuration field.

2025-06-02T17:17:27,344           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,345           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,345           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,346           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,347           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,348           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2025-06-02T17:17:27,349           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2025-06-02T17:17:27,349           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,349           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,350           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,351           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,352           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,353           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,354                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,354                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,354                 directory, all directories are treated like packages.
2025-06-02T17:17:27,355           ********************************************************************************

2025-06-02T17:17:27,356   !!
2025-06-02T17:17:27,357     check.warn(importable)
2025-06-02T17:17:27,357   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2025-06-02T17:17:27,358   !!

2025-06-02T17:17:27,358           ********************************************************************************
2025-06-02T17:17:27,359           ############################
2025-06-02T17:17:27,359           # Package would be ignored #
2025-06-02T17:17:27,360           ############################
2025-06-02T17:17:27,360           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2025-06-02T17:17:27,361           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,362           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,362           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2025-06-02T17:17:27,363           to the `packages` configuration field.

2025-06-02T17:17:27,364           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,364           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,365           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,366           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,367           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,368           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2025-06-02T17:17:27,369           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2025-06-02T17:17:27,369           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,370           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,370           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,371           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,373           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,374           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,375                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,376                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,376                 directory, all directories are treated like packages.
2025-06-02T17:17:27,377           ********************************************************************************

2025-06-02T17:17:27,378   !!
2025-06-02T17:17:27,379     check.warn(importable)
2025-06-02T17:17:27,379   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2025-06-02T17:17:27,380   !!

2025-06-02T17:17:27,381           ********************************************************************************
2025-06-02T17:17:27,381           ############################
2025-06-02T17:17:27,382           # Package would be ignored #
2025-06-02T17:17:27,382           ############################
2025-06-02T17:17:27,383           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2025-06-02T17:17:27,383           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,385           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,385           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2025-06-02T17:17:27,386           to the `packages` configuration field.

2025-06-02T17:17:27,387           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,387           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,388           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,389           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,390           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,391           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2025-06-02T17:17:27,392           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2025-06-02T17:17:27,392           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,393           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,393           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,394           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,396           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,397           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,398                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,398                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,399                 directory, all directories are treated like packages.
2025-06-02T17:17:27,399           ********************************************************************************

2025-06-02T17:17:27,400   !!
2025-06-02T17:17:27,401     check.warn(importable)
2025-06-02T17:17:27,401   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2025-06-02T17:17:27,402   !!

2025-06-02T17:17:27,403           ********************************************************************************
2025-06-02T17:17:27,404           ############################
2025-06-02T17:17:27,404           # Package would be ignored #
2025-06-02T17:17:27,405           ############################
2025-06-02T17:17:27,405           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2025-06-02T17:17:27,406           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,407           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,408           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2025-06-02T17:17:27,408           to the `packages` configuration field.

2025-06-02T17:17:27,409           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,409           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,410           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,411           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,412           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,413           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2025-06-02T17:17:27,414           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2025-06-02T17:17:27,414           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,415           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,415           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,416           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,417           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,419           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,420                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,420                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,421                 directory, all directories are treated like packages.
2025-06-02T17:17:27,421           ********************************************************************************

2025-06-02T17:17:27,422   !!
2025-06-02T17:17:27,423     check.warn(importable)
2025-06-02T17:17:27,423   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2025-06-02T17:17:27,424   !!

2025-06-02T17:17:27,425           ********************************************************************************
2025-06-02T17:17:27,426           ############################
2025-06-02T17:17:27,426           # Package would be ignored #
2025-06-02T17:17:27,427           ############################
2025-06-02T17:17:27,428           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2025-06-02T17:17:27,428           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,429           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,430           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2025-06-02T17:17:27,430           to the `packages` configuration field.

2025-06-02T17:17:27,432           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,432           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,433           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,434           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,435           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,436           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2025-06-02T17:17:27,437           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2025-06-02T17:17:27,437           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,438           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,438           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,439           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,440           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,442           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,442                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,443                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,443                 directory, all directories are treated like packages.
2025-06-02T17:17:27,443           ********************************************************************************

2025-06-02T17:17:27,445   !!
2025-06-02T17:17:27,445     check.warn(importable)
2025-06-02T17:17:27,446   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2025-06-02T17:17:27,446   !!

2025-06-02T17:17:27,447           ********************************************************************************
2025-06-02T17:17:27,448           ############################
2025-06-02T17:17:27,448           # Package would be ignored #
2025-06-02T17:17:27,449           ############################
2025-06-02T17:17:27,449           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2025-06-02T17:17:27,450           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,451           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,452           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2025-06-02T17:17:27,452           to the `packages` configuration field.

2025-06-02T17:17:27,453           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,454           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,454           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,455           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,456           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,457           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2025-06-02T17:17:27,458           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2025-06-02T17:17:27,458           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,459           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,459           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,461           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,462           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,463           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,464                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,464                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,465                 directory, all directories are treated like packages.
2025-06-02T17:17:27,465           ********************************************************************************

2025-06-02T17:17:27,467   !!
2025-06-02T17:17:27,467     check.warn(importable)
2025-06-02T17:17:27,468   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2025-06-02T17:17:27,468   !!

2025-06-02T17:17:27,470           ********************************************************************************
2025-06-02T17:17:27,470           ############################
2025-06-02T17:17:27,471           # Package would be ignored #
2025-06-02T17:17:27,471           ############################
2025-06-02T17:17:27,472           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2025-06-02T17:17:27,472           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,473           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,474           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2025-06-02T17:17:27,474           to the `packages` configuration field.

2025-06-02T17:17:27,476           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,476           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,477           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,477           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,479           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,480           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2025-06-02T17:17:27,480           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2025-06-02T17:17:27,481           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,481           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,482           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,483           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,484           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,486           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,486                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,487                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,488                 directory, all directories are treated like packages.
2025-06-02T17:17:27,488           ********************************************************************************

2025-06-02T17:17:27,489   !!
2025-06-02T17:17:27,490     check.warn(importable)
2025-06-02T17:17:27,490   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2025-06-02T17:17:27,491   !!

2025-06-02T17:17:27,492           ********************************************************************************
2025-06-02T17:17:27,493           ############################
2025-06-02T17:17:27,493           # Package would be ignored #
2025-06-02T17:17:27,494           ############################
2025-06-02T17:17:27,494           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2025-06-02T17:17:27,495           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,496           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,497           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2025-06-02T17:17:27,498           to the `packages` configuration field.

2025-06-02T17:17:27,499           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,500           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,501           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,502           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,503           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,504           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2025-06-02T17:17:27,504           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2025-06-02T17:17:27,505           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,505           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,505           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,506           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,507           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,509           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,509                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,510                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,510                 directory, all directories are treated like packages.
2025-06-02T17:17:27,511           ********************************************************************************

2025-06-02T17:17:27,512   !!
2025-06-02T17:17:27,512     check.warn(importable)
2025-06-02T17:17:27,513   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2025-06-02T17:17:27,514   !!

2025-06-02T17:17:27,515           ********************************************************************************
2025-06-02T17:17:27,516           ############################
2025-06-02T17:17:27,517           # Package would be ignored #
2025-06-02T17:17:27,517           ############################
2025-06-02T17:17:27,518           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2025-06-02T17:17:27,519           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,520           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,521           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2025-06-02T17:17:27,521           to the `packages` configuration field.

2025-06-02T17:17:27,522           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,523           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,523           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,524           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,525           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,526           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2025-06-02T17:17:27,527           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2025-06-02T17:17:27,527           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,528           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,529           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,530           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,531           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,533           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,533                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,534                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,535                 directory, all directories are treated like packages.
2025-06-02T17:17:27,535           ********************************************************************************

2025-06-02T17:17:27,537   !!
2025-06-02T17:17:27,537     check.warn(importable)
2025-06-02T17:17:27,538   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2025-06-02T17:17:27,538   !!

2025-06-02T17:17:27,539           ********************************************************************************
2025-06-02T17:17:27,540           ############################
2025-06-02T17:17:27,540           # Package would be ignored #
2025-06-02T17:17:27,541           ############################
2025-06-02T17:17:27,542           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2025-06-02T17:17:27,542           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,543           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,544           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2025-06-02T17:17:27,544           to the `packages` configuration field.

2025-06-02T17:17:27,545           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,545           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,546           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,547           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,548           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,549           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2025-06-02T17:17:27,549           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2025-06-02T17:17:27,550           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,550           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,551           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,552           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,554           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,556           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,556                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,557                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,557                 directory, all directories are treated like packages.
2025-06-02T17:17:27,558           ********************************************************************************

2025-06-02T17:17:27,559   !!
2025-06-02T17:17:27,560     check.warn(importable)
2025-06-02T17:17:27,560   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2025-06-02T17:17:27,561   !!

2025-06-02T17:17:27,562           ********************************************************************************
2025-06-02T17:17:27,562           ############################
2025-06-02T17:17:27,563           # Package would be ignored #
2025-06-02T17:17:27,564           ############################
2025-06-02T17:17:27,564           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2025-06-02T17:17:27,565           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,566           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,566           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2025-06-02T17:17:27,567           to the `packages` configuration field.

2025-06-02T17:17:27,568           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,568           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,569           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,570           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,571           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,572           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2025-06-02T17:17:27,573           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2025-06-02T17:17:27,573           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,574           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,574           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,575           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,576           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,578           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,578                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,579                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,579                 directory, all directories are treated like packages.
2025-06-02T17:17:27,580           ********************************************************************************

2025-06-02T17:17:27,581   !!
2025-06-02T17:17:27,581     check.warn(importable)
2025-06-02T17:17:27,582   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2025-06-02T17:17:27,582   !!

2025-06-02T17:17:27,583           ********************************************************************************
2025-06-02T17:17:27,584           ############################
2025-06-02T17:17:27,585           # Package would be ignored #
2025-06-02T17:17:27,585           ############################
2025-06-02T17:17:27,586           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2025-06-02T17:17:27,586           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,588           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,589           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2025-06-02T17:17:27,590           to the `packages` configuration field.

2025-06-02T17:17:27,591           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,592           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,592           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,594           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,595           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,596           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2025-06-02T17:17:27,596           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2025-06-02T17:17:27,597           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,598           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,598           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,600           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,601           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,603           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,604                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,605                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,605                 directory, all directories are treated like packages.
2025-06-02T17:17:27,606           ********************************************************************************

2025-06-02T17:17:27,607   !!
2025-06-02T17:17:27,607     check.warn(importable)
2025-06-02T17:17:27,608   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2025-06-02T17:17:27,609   !!

2025-06-02T17:17:27,610           ********************************************************************************
2025-06-02T17:17:27,610           ############################
2025-06-02T17:17:27,611           # Package would be ignored #
2025-06-02T17:17:27,611           ############################
2025-06-02T17:17:27,613           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2025-06-02T17:17:27,614           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,615           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,615           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2025-06-02T17:17:27,616           to the `packages` configuration field.

2025-06-02T17:17:27,617           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,617           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,618           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,619           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,620           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,622           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2025-06-02T17:17:27,622           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2025-06-02T17:17:27,623           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,623           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,624           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,625           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,626           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,628           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,629                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,629                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,630                 directory, all directories are treated like packages.
2025-06-02T17:17:27,630           ********************************************************************************

2025-06-02T17:17:27,632   !!
2025-06-02T17:17:27,632     check.warn(importable)
2025-06-02T17:17:27,633   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2025-06-02T17:17:27,633   !!

2025-06-02T17:17:27,634           ********************************************************************************
2025-06-02T17:17:27,635           ############################
2025-06-02T17:17:27,636           # Package would be ignored #
2025-06-02T17:17:27,637           ############################
2025-06-02T17:17:27,637           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2025-06-02T17:17:27,638           but it is absent from setuptools' `packages` configuration.

2025-06-02T17:17:27,639           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-02T17:17:27,639           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2025-06-02T17:17:27,640           to the `packages` configuration field.

2025-06-02T17:17:27,641           Alternatively, you can also rely on setuptools' discovery methods
2025-06-02T17:17:27,641           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-02T17:17:27,642           instead of `find_packages(...)`/`find:`).

2025-06-02T17:17:27,643           You can read more about "package discovery" on setuptools documentation page:

2025-06-02T17:17:27,644           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-02T17:17:27,645           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2025-06-02T17:17:27,645           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2025-06-02T17:17:27,646           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-02T17:17:27,646           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-02T17:17:27,647           combination with a more fine grained `package-data` configuration.

2025-06-02T17:17:27,648           You can read more about "package data files" on setuptools documentation page:

2025-06-02T17:17:27,649           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-02T17:17:27,651           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-02T17:17:27,652                 even if it does not contain any `.py` files.
2025-06-02T17:17:27,652                 On the other hand, currently there is no concept of package data
2025-06-02T17:17:27,653                 directory, all directories are treated like packages.
2025-06-02T17:17:27,654           ********************************************************************************

2025-06-02T17:17:27,655   !!
2025-06-02T17:17:27,655     check.warn(importable)
2025-06-02T17:17:27,656   creating build/lib/deepspeed/autotuning/config_templates
2025-06-02T17:17:27,657   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-02T17:17:27,657   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-02T17:17:27,658   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-02T17:17:27,658   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-02T17:17:27,659   creating build/lib/deepspeed/ops/csrc/adagrad
2025-06-02T17:17:27,660   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2025-06-02T17:17:27,660   creating build/lib/deepspeed/ops/csrc/adam
2025-06-02T17:17:27,661   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-02T17:17:27,661   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-02T17:17:27,662   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-02T17:17:27,662   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2025-06-02T17:17:27,663   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2025-06-02T17:17:27,663   creating build/lib/deepspeed/ops/csrc/aio/common
2025-06-02T17:17:27,664   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-02T17:17:27,665   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-02T17:17:27,665   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-02T17:17:27,666   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-02T17:17:27,666   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-02T17:17:27,667   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-02T17:17:27,667   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,668   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,668   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,669   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,669   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,670   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,670   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,671   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,671   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,672   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,672   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,673   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,674   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,674   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,675   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,675   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,676   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,676   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:27,677   creating build/lib/deepspeed/ops/csrc/aio/py_test
2025-06-02T17:17:27,678   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2025-06-02T17:17:27,678   creating build/lib/deepspeed/ops/csrc/compile
2025-06-02T17:17:27,679   copying deepspeed/ops/csrc/compile/deepcompile.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-02T17:17:27,679   copying deepspeed/ops/csrc/compile/init.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-02T17:17:27,680   copying deepspeed/ops/csrc/compile/util.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-02T17:17:27,680   copying deepspeed/ops/csrc/compile/z1.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-02T17:17:27,681   copying deepspeed/ops/csrc/compile/z1.h -> build/lib/deepspeed/ops/csrc/compile
2025-06-02T17:17:27,682   copying deepspeed/ops/csrc/compile/z3.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-02T17:17:27,682   copying deepspeed/ops/csrc/compile/z3.h -> build/lib/deepspeed/ops/csrc/compile
2025-06-02T17:17:27,683   creating build/lib/deepspeed/ops/csrc/cpu/adam
2025-06-02T17:17:27,683   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2025-06-02T17:17:27,684   creating build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-02T17:17:27,684   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-02T17:17:27,685   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-02T17:17:27,685   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-02T17:17:27,686   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-02T17:17:27,686   creating build/lib/deepspeed/ops/csrc/cpu/lion
2025-06-02T17:17:27,687   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2025-06-02T17:17:27,687   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-02T17:17:27,688   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-02T17:17:27,688   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-02T17:17:27,689   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-02T17:17:27,689   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-02T17:17:27,690   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-02T17:17:27,690   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-02T17:17:27,691   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-02T17:17:27,692   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-02T17:17:27,694   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-02T17:17:27,695   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-02T17:17:27,695   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-02T17:17:27,696   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-02T17:17:27,697   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-02T17:17:27,697   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-02T17:17:27,698   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-02T17:17:27,698   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-02T17:17:27,699   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-02T17:17:27,699   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-02T17:17:27,700   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-02T17:17:27,701   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-02T17:17:27,702   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-02T17:17:27,702   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-02T17:17:27,703   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-02T17:17:27,703   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-02T17:17:27,704   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-02T17:17:27,705   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-02T17:17:27,705   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-02T17:17:27,706   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-02T17:17:27,706   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-02T17:17:27,707   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-02T17:17:27,708   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-02T17:17:27,708   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-02T17:17:27,709   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-02T17:17:27,709   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-02T17:17:27,710   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-02T17:17:27,711   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-02T17:17:27,711   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-02T17:17:27,712   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-02T17:17:27,713   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-02T17:17:27,713   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-02T17:17:27,714   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-02T17:17:27,715   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-02T17:17:27,715   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-02T17:17:27,716   creating build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,716   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,717   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,718   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,718   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,719   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,720   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,720   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,721   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,721   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,722   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,722   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,723   copying deepspeed/ops/csrc/includes/deepcompile.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,723   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,724   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,724   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,725   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,725   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,726   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,728   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,731   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,734   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,738   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,741   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,744   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,747   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,750   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,754   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,757   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,760   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,764   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-02T17:17:27,767   creating build/lib/deepspeed/ops/csrc/lamb
2025-06-02T17:17:27,768   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2025-06-02T17:17:27,771   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2025-06-02T17:17:27,775   creating build/lib/deepspeed/ops/csrc/lion
2025-06-02T17:17:27,777   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-02T17:17:27,780   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-02T17:17:27,783   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-02T17:17:27,786   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2025-06-02T17:17:27,789   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2025-06-02T17:17:27,792   creating build/lib/deepspeed/ops/csrc/quantization
2025-06-02T17:17:27,793   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-02T17:17:27,796   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-02T17:17:27,800   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2025-06-02T17:17:27,803   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-02T17:17:27,807   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-02T17:17:27,810   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-02T17:17:27,813   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-02T17:17:27,816   creating build/lib/deepspeed/ops/csrc/random_ltd
2025-06-02T17:17:27,818   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-02T17:17:27,821   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-02T17:17:27,824   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-02T17:17:27,827   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-02T17:17:27,830   creating build/lib/deepspeed/ops/csrc/sparse_attention
2025-06-02T17:17:27,832   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2025-06-02T17:17:27,835   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-02T17:17:27,837   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-02T17:17:27,840   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-02T17:17:27,843   creating build/lib/deepspeed/ops/csrc/spatial/includes
2025-06-02T17:17:27,845   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2025-06-02T17:17:27,848   creating build/lib/deepspeed/ops/csrc/transformer
2025-06-02T17:17:27,849   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-02T17:17:27,853   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-02T17:17:27,857   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2025-06-02T17:17:27,861   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-02T17:17:27,864   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-02T17:17:27,868   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-02T17:17:27,873   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-02T17:17:27,877   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-02T17:17:27,881   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:27,884   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:27,887   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:27,890   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:27,894   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:27,898   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:27,901   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:27,906   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:27,909   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:27,912   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:27,916   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:27,920   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-02T17:17:27,922   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-02T17:17:27,925   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-02T17:17:27,929   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-02T17:17:27,932   creating build/lib/deepspeed/ops/csrc/utils
2025-06-02T17:17:27,933   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2025-06-02T17:17:27,936   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-06-02T17:17:27,938   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-06-02T17:17:27,941   creating build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-02T17:17:27,943   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-02T17:17:27,945   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-02T17:17:27,949   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-02T17:17:27,952   creating build/lib/deepspeed/ops/csrc/xpu/common
2025-06-02T17:17:27,953   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2025-06-02T17:17:27,956   creating build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-02T17:17:27,957   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-02T17:17:27,960   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-02T17:17:27,963   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-02T17:17:27,966   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-02T17:17:27,970   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-02T17:17:27,972   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2025-06-02T17:17:27,974   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2025-06-02T17:17:27,977   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-02T17:17:27,979   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-02T17:17:27,982   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-02T17:17:27,985   creating build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-02T17:17:27,986   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-02T17:17:27,989   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-02T17:17:27,991   creating build/lib/deepspeed/inference/v2/ragged/includes
2025-06-02T17:17:27,993   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2025-06-02T17:17:27,995   creating build/lib/deepspeed/inference/v2/kernels/includes
2025-06-02T17:17:27,996   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-02T17:17:27,999   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-02T17:17:28,002   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-02T17:17:28,005   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-02T17:17:28,008   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-02T17:17:28,012   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-02T17:17:28,014   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-02T17:17:28,015   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-02T17:17:28,018   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-02T17:17:28,021   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-02T17:17:28,023   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-02T17:17:28,024   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-02T17:17:28,027   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-02T17:17:28,028   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-02T17:17:28,030   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-02T17:17:28,033   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-02T17:17:28,035   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-02T17:17:28,038   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-02T17:17:28,040   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-02T17:17:28,043   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-02T17:17:28,046   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-02T17:17:28,048   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-02T17:17:28,051   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-02T17:17:28,054   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-02T17:17:28,057   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-02T17:17:28,060   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-02T17:17:28,064   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-02T17:17:28,066   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-02T17:17:28,069   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-02T17:17:28,071   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:28,072   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:28,075   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:28,078   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:28,080   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:28,083   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:28,086   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:28,089   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:28,091   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:28,094   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:28,097   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-02T17:17:28,100   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-02T17:17:28,102   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:28,105   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:28,108   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:28,111   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-02T17:17:28,114   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-02T17:17:28,117   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-02T17:17:28,120   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-02T17:17:28,122   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-02T17:17:28,125   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-02T17:17:28,127   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-02T17:17:28,130   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-02T17:17:28,132   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-02T17:17:28,134   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-02T17:17:28,137   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-02T17:17:28,140   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-02T17:17:28,143   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-02T17:17:28,145   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-02T17:17:28,148   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-02T17:17:28,151   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-02T17:17:28,154   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-02T17:17:28,157   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-02T17:17:28,162   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-02T17:17:28,165   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-02T17:17:28,169   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-02T17:17:28,172   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-02T17:17:28,174   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-02T17:17:28,177   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-02T17:17:28,180   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-02T17:17:28,182   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-02T17:17:28,186   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-02T17:17:28,188   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-02T17:17:28,191   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-02T17:17:28,193   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-02T17:17:28,196   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-02T17:17:28,199   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-02T17:17:28,201   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:28,204   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:28,207   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:28,209   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:28,272   running build_scripts
2025-06-02T17:17:28,273   creating build/scripts-3.11
2025-06-02T17:17:28,274   copying and adjusting bin/deepspeed -> build/scripts-3.11
2025-06-02T17:17:28,276   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2025-06-02T17:17:28,277   copying and adjusting bin/ds -> build/scripts-3.11
2025-06-02T17:17:28,279   copying bin/ds_ssh -> build/scripts-3.11
2025-06-02T17:17:28,281   copying and adjusting bin/ds_report -> build/scripts-3.11
2025-06-02T17:17:28,283   copying and adjusting bin/ds_bench -> build/scripts-3.11
2025-06-02T17:17:28,284   copying and adjusting bin/dsr -> build/scripts-3.11
2025-06-02T17:17:28,286   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2025-06-02T17:17:28,288   copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11
2025-06-02T17:17:28,289   copying and adjusting bin/ds_io -> build/scripts-3.11
2025-06-02T17:17:28,290   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2025-06-02T17:17:28,291   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2025-06-02T17:17:28,291   changing mode of build/scripts-3.11/ds from 644 to 755
2025-06-02T17:17:28,292   changing mode of build/scripts-3.11/ds_report from 644 to 755
2025-06-02T17:17:28,293   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2025-06-02T17:17:28,293   changing mode of build/scripts-3.11/dsr from 644 to 755
2025-06-02T17:17:28,294   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2025-06-02T17:17:28,294   changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755
2025-06-02T17:17:28,295   changing mode of build/scripts-3.11/ds_io from 644 to 755
2025-06-02T17:17:28,322   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2025-06-02T17:17:28,323   !!

2025-06-02T17:17:28,324           ********************************************************************************
2025-06-02T17:17:28,325           Please avoid running ``setup.py`` directly.
2025-06-02T17:17:28,326           Instead, use pypa/build, pypa/installer or other
2025-06-02T17:17:28,326           standards-based tools.

2025-06-02T17:17:28,327           By 2025-Oct-31, you need to update your project and remove deprecated calls
2025-06-02T17:17:28,328           or your builds will no longer be supported.

2025-06-02T17:17:28,329           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2025-06-02T17:17:28,330           ********************************************************************************

2025-06-02T17:17:28,331   !!
2025-06-02T17:17:28,331     self.initialize_options()
2025-06-02T17:17:28,353   installing to build/bdist.linux-armv7l/wheel
2025-06-02T17:17:28,354   running install
2025-06-02T17:17:28,379   running install_lib
2025-06-02T17:17:28,405   creating build/bdist.linux-armv7l/wheel
2025-06-02T17:17:28,408   creating build/bdist.linux-armv7l/wheel/deepspeed
2025-06-02T17:17:28,409   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-02T17:17:28,412   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2025-06-02T17:17:28,413   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-02T17:17:28,415   copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-02T17:17:28,418   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-02T17:17:28,420   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-02T17:17:28,423   creating build/bdist.linux-armv7l/wheel/deepspeed/nvme
2025-06-02T17:17:28,424   copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-02T17:17:28,426   copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-02T17:17:28,428   copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-02T17:17:28,430   copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-02T17:17:28,432   copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-02T17:17:28,434   copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-02T17:17:28,436   copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-02T17:17:28,438   copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-02T17:17:28,441   copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-02T17:17:28,443   copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-02T17:17:28,445   copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-02T17:17:28,447   copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-02T17:17:28,450   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2025-06-02T17:17:28,451   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-02T17:17:28,453   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-02T17:17:28,455   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-02T17:17:28,458   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2025-06-02T17:17:28,459   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,462   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,464   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,466   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,468   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,470   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,473   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,475   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,477   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,479   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,481   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,483   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,485   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,487   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,490   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,492   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,495   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,498   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-02T17:17:28,501   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2025-06-02T17:17:28,503   copying build/lib/deepspeed/accelerator/sdaa_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-02T17:17:28,505   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-02T17:17:28,508   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-02T17:17:28,510   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-02T17:17:28,512   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-02T17:17:28,515   copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-02T17:17:28,518   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-02T17:17:28,521   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-02T17:17:28,523   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-02T17:17:28,526   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-02T17:17:28,529   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-02T17:17:28,532   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2025-06-02T17:17:28,533   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-02T17:17:28,535   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-02T17:17:28,537   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-02T17:17:28,539   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-02T17:17:28,541   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-02T17:17:28,544   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-02T17:17:28,546   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-02T17:17:28,548   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-02T17:17:28,551   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2025-06-02T17:17:28,552   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2025-06-02T17:17:28,553   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-02T17:17:28,556   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-02T17:17:28,558   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-02T17:17:28,560   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-02T17:17:28,562   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-02T17:17:28,564   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-02T17:17:28,566   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-02T17:17:28,568   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-02T17:17:28,570   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2025-06-02T17:17:28,571   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-02T17:17:28,573   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-02T17:17:28,575   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-02T17:17:28,577   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-02T17:17:28,579   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-02T17:17:28,581   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-02T17:17:28,584   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-02T17:17:28,587   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-02T17:17:28,591   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-02T17:17:28,593   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-02T17:17:28,595   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-02T17:17:28,598   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2025-06-02T17:17:28,600   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2025-06-02T17:17:28,601   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-02T17:17:28,603   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-02T17:17:28,605   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-02T17:17:28,608   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-02T17:17:28,611   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2025-06-02T17:17:28,613   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-06-02T17:17:28,615   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-06-02T17:17:28,617   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2025-06-02T17:17:28,619   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2025-06-02T17:17:28,621   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-06-02T17:17:28,623   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-06-02T17:17:28,626   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2025-06-02T17:17:28,627   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-02T17:17:28,629   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-02T17:17:28,632   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-02T17:17:28,634   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-02T17:17:28,637   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2025-06-02T17:17:28,638   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-06-02T17:17:28,640   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-06-02T17:17:28,643   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2025-06-02T17:17:28,645   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-02T17:17:28,647   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-02T17:17:28,650   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-02T17:17:28,652   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-02T17:17:28,654   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-02T17:17:28,657   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2025-06-02T17:17:28,659   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-02T17:17:28,661   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-02T17:17:28,663   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-02T17:17:28,665   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-02T17:17:28,667   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-02T17:17:28,671   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-02T17:17:28,674   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2025-06-02T17:17:28,676   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2025-06-02T17:17:28,677   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-06-02T17:17:28,681   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-02T17:17:28,682   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-06-02T17:17:28,684   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-06-02T17:17:28,686   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-06-02T17:17:28,690   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2025-06-02T17:17:28,691   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2025-06-02T17:17:28,694   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2025-06-02T17:17:28,695   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-02T17:17:28,698   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-02T17:17:28,701   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-02T17:17:28,703   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-02T17:17:28,706   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2025-06-02T17:17:28,707   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-02T17:17:28,709   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-02T17:17:28,711   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-02T17:17:28,714   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-02T17:17:28,716   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-02T17:17:28,718   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2025-06-02T17:17:28,720   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-06-02T17:17:28,722   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-06-02T17:17:28,725   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2025-06-02T17:17:28,726   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2025-06-02T17:17:28,729   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2025-06-02T17:17:28,731   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2025-06-02T17:17:28,732   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-02T17:17:28,735   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-02T17:17:28,737   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-02T17:17:28,740   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-02T17:17:28,742   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-02T17:17:28,745   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-02T17:17:28,747   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2025-06-02T17:17:28,748   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-02T17:17:28,751   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-02T17:17:28,754   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-02T17:17:28,757   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-02T17:17:28,760   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-02T17:17:28,762   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-02T17:17:28,766   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2025-06-02T17:17:28,768   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:28,769   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:28,772   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:28,775   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:28,777   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:28,781   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:28,784   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:28,788   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:28,791   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:28,794   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:28,796   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-02T17:17:28,799   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2025-06-02T17:17:28,800   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-02T17:17:28,803   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-02T17:17:28,806   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-02T17:17:28,809   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-02T17:17:28,812   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-02T17:17:28,816   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2025-06-02T17:17:28,817   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,819   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,821   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,823   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,825   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,828   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,830   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,833   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,835   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,838   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,840   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,843   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,845   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,848   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,850   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,852   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,855   copying build/lib/deepspeed/ops/csrc/includes/deepcompile.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,858   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,862   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,864   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,866   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,869   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,872   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,874   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,877   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,879   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,882   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,885   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,887   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,889   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-02T17:17:28,892   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2025-06-02T17:17:28,894   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2025-06-02T17:17:28,895   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2025-06-02T17:17:28,898   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2025-06-02T17:17:28,900   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2025-06-02T17:17:28,903   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2025-06-02T17:17:28,904   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-02T17:17:28,907   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-02T17:17:28,910   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-02T17:17:28,912   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-02T17:17:28,915   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2025-06-02T17:17:28,916   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2025-06-02T17:17:28,920   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2025-06-02T17:17:28,922   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2025-06-02T17:17:28,923   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2025-06-02T17:17:28,926   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2025-06-02T17:17:28,928   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-02T17:17:28,930   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-02T17:17:28,933   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-02T17:17:28,935   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-02T17:17:28,938   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-02T17:17:28,941   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2025-06-02T17:17:28,943   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2025-06-02T17:17:28,946   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2025-06-02T17:17:28,947   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2025-06-02T17:17:28,951   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2025-06-02T17:17:28,952   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-02T17:17:28,954   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-02T17:17:28,957   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-02T17:17:28,961   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2025-06-02T17:17:28,963   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-02T17:17:28,964   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-02T17:17:28,968   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-02T17:17:28,969   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-02T17:17:28,972   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-02T17:17:28,975   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-02T17:17:28,978   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-02T17:17:28,982   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-02T17:17:28,986   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-02T17:17:28,988   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-02T17:17:28,991   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-02T17:17:28,995   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-02T17:17:28,996   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-02T17:17:28,999   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-02T17:17:29,002   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-02T17:17:29,004   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-02T17:17:29,007   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-02T17:17:29,010   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-02T17:17:29,012   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-02T17:17:29,015   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-02T17:17:29,020   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-02T17:17:29,023   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-02T17:17:29,026   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-02T17:17:29,029   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-02T17:17:29,031   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-02T17:17:29,034   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-02T17:17:29,036   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-02T17:17:29,040   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-02T17:17:29,043   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-02T17:17:29,045   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-02T17:17:29,049   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-02T17:17:29,052   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/compile
2025-06-02T17:17:29,053   copying build/lib/deepspeed/ops/csrc/compile/init.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-02T17:17:29,056   copying build/lib/deepspeed/ops/csrc/compile/z1.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-02T17:17:29,058   copying build/lib/deepspeed/ops/csrc/compile/util.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-02T17:17:29,061   copying build/lib/deepspeed/ops/csrc/compile/z3.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-02T17:17:29,063   copying build/lib/deepspeed/ops/csrc/compile/z3.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-02T17:17:29,066   copying build/lib/deepspeed/ops/csrc/compile/z1.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-02T17:17:29,068   copying build/lib/deepspeed/ops/csrc/compile/deepcompile.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-02T17:17:29,072   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2025-06-02T17:17:29,074   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2025-06-02T17:17:29,075   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-06-02T17:17:29,078   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-06-02T17:17:29,081   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2025-06-02T17:17:29,082   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2025-06-02T17:17:29,085   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2025-06-02T17:17:29,087   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2025-06-02T17:17:29,088   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-02T17:17:29,091   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-02T17:17:29,093   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-02T17:17:29,095   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-02T17:17:29,098   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-02T17:17:29,100   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-02T17:17:29,103   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,104   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,107   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,110   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,112   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,114   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,116   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,118   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,120   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,122   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,124   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,127   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,129   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,131   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,134   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,136   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,138   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,141   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-02T17:17:29,143   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2025-06-02T17:17:29,144   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2025-06-02T17:17:29,147   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2025-06-02T17:17:29,149   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-02T17:17:29,151   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-02T17:17:29,154   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-02T17:17:29,157   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-02T17:17:29,160   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-02T17:17:29,163   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-02T17:17:29,165   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-02T17:17:29,169   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2025-06-02T17:17:29,171   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-02T17:17:29,173   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-02T17:17:29,175   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-02T17:17:29,178   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-02T17:17:29,180   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-02T17:17:29,184   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2025-06-02T17:17:29,185   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2025-06-02T17:17:29,188   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2025-06-02T17:17:29,190   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu
2025-06-02T17:17:29,192   copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-02T17:17:29,194   copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-02T17:17:29,196   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-02T17:17:29,198   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-02T17:17:29,201   copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-02T17:17:29,203   copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-02T17:17:29,205   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,208   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/sdaa
2025-06-02T17:17:29,209   copying build/lib/deepspeed/ops/op_builder/sdaa/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-02T17:17:29,212   copying build/lib/deepspeed/ops/op_builder/sdaa/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-02T17:17:29,214   copying build/lib/deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-02T17:17:29,216   copying build/lib/deepspeed/ops/op_builder/sdaa/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-02T17:17:29,218   copying build/lib/deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-02T17:17:29,221   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,223   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,225   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,227   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,229   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,231   copying build/lib/deepspeed/ops/op_builder/dc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,233   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,236   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,238   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,240   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,242   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,245   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2025-06-02T17:17:29,247   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-02T17:17:29,249   copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-02T17:17:29,251   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-02T17:17:29,254   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-02T17:17:29,256   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-02T17:17:29,258   copying build/lib/deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-02T17:17:29,261   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-02T17:17:29,263   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,266   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,269   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2025-06-02T17:17:29,270   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-02T17:17:29,273   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-02T17:17:29,275   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-02T17:17:29,277   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-02T17:17:29,279   copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-02T17:17:29,281   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-02T17:17:29,284   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-02T17:17:29,286   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,290   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2025-06-02T17:17:29,291   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-02T17:17:29,293   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-02T17:17:29,295   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-02T17:17:29,297   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-02T17:17:29,299   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-02T17:17:29,302   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-02T17:17:29,304   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-02T17:17:29,306   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-02T17:17:29,309   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-02T17:17:29,312   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2025-06-02T17:17:29,313   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-02T17:17:29,315   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-02T17:17:29,317   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-02T17:17:29,319   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-02T17:17:29,321   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-02T17:17:29,323   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-02T17:17:29,325   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-02T17:17:29,328   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-02T17:17:29,330   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-02T17:17:29,332   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-02T17:17:29,334   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,337   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,339   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,341   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,343   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,345   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,347   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,350   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,352   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,354   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-02T17:17:29,357   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2025-06-02T17:17:29,358   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-06-02T17:17:29,361   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2025-06-02T17:17:29,362   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-02T17:17:29,365   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-02T17:17:29,368   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-02T17:17:29,371   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,372   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,375   copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,377   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,379   copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,381   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,383   copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,385   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,387   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,390   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,392   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,394   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,396   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,398   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,400   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,403   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,405   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,407   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,410   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,412   copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,415   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,417   copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,419   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,421   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-02T17:17:29,424   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-02T17:17:29,426   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-02T17:17:29,430   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:29,431   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:29,434   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:29,437   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:29,439   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:29,442   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:29,445   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:29,447   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:29,450   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:29,453   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:29,455   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-02T17:17:29,458   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-02T17:17:29,461   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-02T17:17:29,463   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-02T17:17:29,466   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-02T17:17:29,468   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-02T17:17:29,471   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-06-02T17:17:29,475   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2025-06-02T17:17:29,476   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-06-02T17:17:29,479   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-06-02T17:17:29,482   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2025-06-02T17:17:29,483   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-06-02T17:17:29,485   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-06-02T17:17:29,488   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/compile
2025-06-02T17:17:29,490   copying build/lib/deepspeed/ops/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/compile
2025-06-02T17:17:29,493   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2025-06-02T17:17:29,494   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2025-06-02T17:17:29,497   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2025-06-02T17:17:29,498   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-02T17:17:29,501   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-02T17:17:29,503   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-02T17:17:29,505   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-02T17:17:29,509   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2025-06-02T17:17:29,510   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-02T17:17:29,513   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-02T17:17:29,515   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2025-06-02T17:17:29,517   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-06-02T17:17:29,519   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-06-02T17:17:29,522   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-02T17:17:29,525   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2025-06-02T17:17:29,526   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-02T17:17:29,529   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-02T17:17:29,531   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-02T17:17:29,533   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-02T17:17:29,536   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-02T17:17:29,538   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-02T17:17:29,541   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-02T17:17:29,543   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-02T17:17:29,547   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2025-06-02T17:17:29,548   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-02T17:17:29,550   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-02T17:17:29,552   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-02T17:17:29,554   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-02T17:17:29,557   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-02T17:17:29,560   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-02T17:17:29,563   creating build/bdist.linux-armv7l/wheel/deepspeed/compile
2025-06-02T17:17:29,564   copying build/lib/deepspeed/compile/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-02T17:17:29,567   copying build/lib/deepspeed/compile/inductor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-02T17:17:29,569   copying build/lib/deepspeed/compile/patch_compiled_func.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-02T17:17:29,572   copying build/lib/deepspeed/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-02T17:17:29,574   creating build/bdist.linux-armv7l/wheel/deepspeed/compile/profilers
2025-06-02T17:17:29,575   copying build/lib/deepspeed/compile/profilers/comm_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-02T17:17:29,578   copying build/lib/deepspeed/compile/profilers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-02T17:17:29,580   copying build/lib/deepspeed/compile/profilers/graph_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-02T17:17:29,584   creating build/bdist.linux-armv7l/wheel/deepspeed/compile/passes
2025-06-02T17:17:29,585   copying build/lib/deepspeed/compile/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-02T17:17:29,587   copying build/lib/deepspeed/compile/passes/zero1_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-02T17:17:29,590   copying build/lib/deepspeed/compile/passes/prefetch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-02T17:17:29,592   copying build/lib/deepspeed/compile/passes/zero3_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-02T17:17:29,595   copying build/lib/deepspeed/compile/passes/offload_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-02T17:17:29,597   copying build/lib/deepspeed/compile/passes/selective_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-02T17:17:29,600   copying build/lib/deepspeed/compile/passes/offload_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-02T17:17:29,602   copying build/lib/deepspeed/compile/passes/offload_adam_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-02T17:17:29,605   copying build/lib/deepspeed/compile/init_z1.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-02T17:17:29,608   copying build/lib/deepspeed/compile/graph_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-02T17:17:29,610   copying build/lib/deepspeed/compile/partitioner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-02T17:17:29,613   copying build/lib/deepspeed/compile/list_schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-02T17:17:29,616   copying build/lib/deepspeed/compile/patch_fake_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-02T17:17:29,619   copying build/lib/deepspeed/compile/util.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-02T17:17:29,622   copying build/lib/deepspeed/compile/init_z3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-02T17:17:29,625   copying build/lib/deepspeed/compile/fx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-02T17:17:29,628   copying build/lib/deepspeed/compile/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-02T17:17:29,632   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2025-06-02T17:17:29,633   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-02T17:17:29,636   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-02T17:17:29,639   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-02T17:17:29,641   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-02T17:17:29,644   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-02T17:17:29,647   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-02T17:17:29,651   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2025-06-02T17:17:29,652   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,656   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,659   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,661   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,663   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,666   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,669   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,673   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2025-06-02T17:17:29,674   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-02T17:17:29,677   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-02T17:17:29,680   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-02T17:17:29,682   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-02T17:17:29,686   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2025-06-02T17:17:29,687   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-02T17:17:29,690   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-02T17:17:29,693   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2025-06-02T17:17:29,695   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-02T17:17:29,698   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-02T17:17:29,700   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-02T17:17:29,703   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-02T17:17:29,707   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-02T17:17:29,710   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-02T17:17:29,713   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,716   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,720   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,723   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,732   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2025-06-02T17:17:29,733   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-02T17:17:29,736   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-02T17:17:29,738   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-02T17:17:29,742   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/tensor_parallel
2025-06-02T17:17:29,744   copying build/lib/deepspeed/runtime/tensor_parallel/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-02T17:17:29,746   copying build/lib/deepspeed/runtime/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-02T17:17:29,748   copying build/lib/deepspeed/runtime/tensor_parallel/tp_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-02T17:17:29,751   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,754   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,757   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2025-06-02T17:17:29,758   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-06-02T17:17:29,760   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-06-02T17:17:29,762   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,765   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino
2025-06-02T17:17:29,767   copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-02T17:17:29,768   copying build/lib/deepspeed/runtime/domino/async_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-02T17:17:29,771   copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-02T17:17:29,774   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,777   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,780   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2025-06-02T17:17:29,781   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-02T17:17:29,784   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-02T17:17:29,787   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-02T17:17:29,791   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-02T17:17:29,794   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-02T17:17:29,796   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-02T17:17:29,800   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2025-06-02T17:17:29,801   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-02T17:17:29,803   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-02T17:17:29,806   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-02T17:17:29,809   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-02T17:17:29,811   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-02T17:17:29,813   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-02T17:17:29,816   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-02T17:17:29,818   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-02T17:17:29,821   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-02T17:17:29,823   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,827   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2025-06-02T17:17:29,828   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-02T17:17:29,830   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-02T17:17:29,833   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-02T17:17:29,835   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-02T17:17:29,839   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-02T17:17:29,842   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-02T17:17:29,848   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-02T17:17:29,851   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-02T17:17:29,854   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-02T17:17:29,856   copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-02T17:17:29,858   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-02T17:17:29,863   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-02T17:17:29,866   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-02T17:17:29,868   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-02T17:17:29,871   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-02T17:17:29,874   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-02T17:17:29,876   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-02T17:17:29,878   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2025-06-02T17:17:29,880   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-02T17:17:29,882   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-02T17:17:29,885   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-02T17:17:29,887   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-02T17:17:29,889   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-02T17:17:29,892   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-02T17:17:29,894   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-02T17:17:29,897   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2025-06-02T17:17:29,898   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-02T17:17:29,901   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-02T17:17:29,903   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-02T17:17:29,906   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2025-06-02T17:17:29,907   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-02T17:17:29,909   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-02T17:17:29,912   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-02T17:17:29,915   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-02T17:17:29,918   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-02T17:17:29,921   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-02T17:17:29,925   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2025-06-02T17:17:29,926   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-02T17:17:29,928   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-02T17:17:29,930   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-02T17:17:29,932   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-02T17:17:29,934   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-02T17:17:29,937   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-02T17:17:29,940   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2025-06-02T17:17:29,942   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-02T17:17:29,944   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-02T17:17:29,946   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-02T17:17:29,948   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-02T17:17:29,951   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-02T17:17:29,953   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-02T17:17:29,956   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-02T17:17:29,958   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-02T17:17:29,960   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-02T17:17:29,963   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-02T17:17:29,967   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2025-06-02T17:17:29,968   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2025-06-02T17:17:29,972   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2025-06-02T17:17:29,973   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-02T17:17:29,975   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-02T17:17:29,978   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-02T17:17:29,980   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-02T17:17:29,982   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-02T17:17:29,984   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-02T17:17:29,986   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-02T17:17:29,989   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2025-06-02T17:17:29,991   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-02T17:17:29,994   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-02T17:17:29,996   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-02T17:17:30,000   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2025-06-02T17:17:30,001   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-02T17:17:30,003   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-02T17:17:30,007   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2025-06-02T17:17:30,008   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-02T17:17:30,010   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-02T17:17:30,013   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:30,014   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:30,016   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:30,018   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:30,020   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:30,022   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:30,025   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:30,027   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:30,029   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-02T17:17:30,031   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-02T17:17:30,033   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-02T17:17:30,037   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2025-06-02T17:17:30,039   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-02T17:17:30,040   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-02T17:17:30,042   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-02T17:17:30,044   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-02T17:17:30,046   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2025-06-02T17:17:30,049   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2025-06-02T17:17:30,050   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-06-02T17:17:30,053   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-06-02T17:17:30,055   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2025-06-02T17:17:30,057   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-06-02T17:17:30,059   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-06-02T17:17:30,062   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2025-06-02T17:17:30,064   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-06-02T17:17:30,067   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-06-02T17:17:30,069   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2025-06-02T17:17:30,070   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-06-02T17:17:30,072   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-06-02T17:17:30,076   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-02T17:17:30,077   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-06-02T17:17:30,079   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-06-02T17:17:30,082   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2025-06-02T17:17:30,083   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-02T17:17:30,086   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-02T17:17:30,088   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-02T17:17:30,091   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2025-06-02T17:17:30,092   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-02T17:17:30,095   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-02T17:17:30,098   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-02T17:17:30,100   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-02T17:17:30,102   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-02T17:17:30,104   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-02T17:17:30,105   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-02T17:17:30,107   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-02T17:17:30,110   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-02T17:17:30,112   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-02T17:17:30,114   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-02T17:17:30,116   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-02T17:17:30,119   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2025-06-02T17:17:30,120   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-02T17:17:30,123   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-02T17:17:30,125   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-02T17:17:30,127   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-02T17:17:30,131   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2025-06-02T17:17:30,132   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-06-02T17:17:30,134   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-06-02T17:17:30,137   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2025-06-02T17:17:30,138   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2025-06-02T17:17:30,141   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-02T17:17:30,143   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-02T17:17:30,146   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-02T17:17:30,150   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2025-06-02T17:17:30,151   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-02T17:17:30,153   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-02T17:17:30,154   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-02T17:17:30,157   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-06-02T17:17:30,159   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-02T17:17:30,162   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-02T17:17:30,165   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-02T17:17:30,167   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-02T17:17:30,169   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-02T17:17:30,171   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-02T17:17:30,173   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-02T17:17:30,176   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-06-02T17:17:30,178   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-02T17:17:30,179   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-02T17:17:30,182   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-02T17:17:30,184   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-02T17:17:30,186   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-02T17:17:30,189   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-02T17:17:30,191   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-06-02T17:17:30,193   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2025-06-02T17:17:30,195   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-02T17:17:30,197   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-02T17:17:30,199   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-02T17:17:30,201   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-02T17:17:30,203   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-02T17:17:30,205   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-02T17:17:30,208   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-02T17:17:30,210   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-02T17:17:30,213   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-06-02T17:17:30,215   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-02T17:17:30,217   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:30,219   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:30,221   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:30,223   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:30,225   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:30,228   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:30,231   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:30,234   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:30,236   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:30,238   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-02T17:17:30,241   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-02T17:17:30,243   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-02T17:17:30,245   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-02T17:17:30,247   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-02T17:17:30,250   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-02T17:17:30,253   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-02T17:17:30,256   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-02T17:17:30,258   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-02T17:17:30,261   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-02T17:17:30,263   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-02T17:17:30,265   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-02T17:17:30,267   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-06-02T17:17:30,270   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:30,271   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:30,274   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:30,276   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:30,278   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:30,280   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:30,282   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:30,285   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:30,288   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-02T17:17:30,291   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-02T17:17:30,292   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-02T17:17:30,294   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-02T17:17:30,296   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-02T17:17:30,299   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-02T17:17:30,301   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-02T17:17:30,304   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-02T17:17:30,305   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-02T17:17:30,307   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-02T17:17:30,309   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-02T17:17:30,312   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-02T17:17:30,314   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-02T17:17:30,316   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2025-06-02T17:17:30,318   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-02T17:17:30,320   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-02T17:17:30,323   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-02T17:17:30,325   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-02T17:17:30,328   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-02T17:17:30,332   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2025-06-02T17:17:30,333   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-06-02T17:17:30,336   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-02T17:17:30,338   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-02T17:17:30,340   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-02T17:17:30,342   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-02T17:17:30,344   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-02T17:17:30,346   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-02T17:17:30,348   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-02T17:17:30,351   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-02T17:17:30,352   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-02T17:17:30,354   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-02T17:17:30,356   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-02T17:17:30,358   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-02T17:17:30,361   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-02T17:17:30,363   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-02T17:17:30,365   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-02T17:17:30,366   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-02T17:17:30,369   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-02T17:17:30,371   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-02T17:17:30,373   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-02T17:17:30,376   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-02T17:17:30,378   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-02T17:17:30,381   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-02T17:17:30,383   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-02T17:17:30,385   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-02T17:17:30,386   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-02T17:17:30,389   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-02T17:17:30,391   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-02T17:17:30,394   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-02T17:17:30,395   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-02T17:17:30,398   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-02T17:17:30,400   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-02T17:17:30,402   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-02T17:17:30,404   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-02T17:17:30,406   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-02T17:17:30,410   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-02T17:17:30,411   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-02T17:17:30,413   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-02T17:17:30,415   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-02T17:17:30,418   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-02T17:17:30,420   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-02T17:17:30,422   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-02T17:17:30,425   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-02T17:17:30,427   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-02T17:17:30,429   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-02T17:17:30,431   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-02T17:17:30,433   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-02T17:17:30,436   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-02T17:17:30,438   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-02T17:17:30,441   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-02T17:17:30,442   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-02T17:17:30,445   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-02T17:17:30,447   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-02T17:17:30,449   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-02T17:17:30,452   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-06-02T17:17:30,455   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:30,456   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:30,458   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:30,460   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:30,463   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:30,466   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:30,468   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:30,471   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:30,473   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-02T17:17:30,475   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-06-02T17:17:30,478   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2025-06-02T17:17:30,479   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-02T17:17:30,481   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-02T17:17:30,483   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-02T17:17:30,485   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-02T17:17:30,489   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2025-06-02T17:17:30,490   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-02T17:17:30,493   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-02T17:17:30,495   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-02T17:17:30,497   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-02T17:17:30,499   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-02T17:17:30,501   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-02T17:17:30,503   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-02T17:17:30,507   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2025-06-02T17:17:30,508   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-02T17:17:30,511   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-02T17:17:30,513   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-02T17:17:30,515   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-02T17:17:30,519   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2025-06-02T17:17:30,520   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-02T17:17:30,523   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-02T17:17:30,525   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-02T17:17:30,527   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-02T17:17:30,530   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-02T17:17:30,533   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2025-06-02T17:17:30,534   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-02T17:17:30,536   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-02T17:17:30,539   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-02T17:17:30,541   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-02T17:17:30,544   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-02T17:17:30,546   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-02T17:17:30,548   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-02T17:17:30,550   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-02T17:17:30,552   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-02T17:17:30,555   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-02T17:17:30,556   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-02T17:17:30,559   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-02T17:17:30,561   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-02T17:17:30,563   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-02T17:17:30,567   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-02T17:17:30,572   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-02T17:17:30,574   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-02T17:17:30,578   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2025-06-02T17:17:30,579   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-02T17:17:30,581   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-02T17:17:30,583   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-02T17:17:30,586   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-02T17:17:30,589   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2025-06-02T17:17:30,591   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-02T17:17:30,593   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-02T17:17:30,595   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-02T17:17:30,597   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-02T17:17:30,601   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:30,602   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:30,604   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:30,606   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:30,608   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:30,610   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:30,612   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:30,615   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:30,617   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:30,619   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-02T17:17:30,621   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-02T17:17:30,625   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2025-06-02T17:17:30,626   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-02T17:17:30,629   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-02T17:17:30,631   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-02T17:17:30,633   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-02T17:17:30,636   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2025-06-02T17:17:30,638   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-02T17:17:30,640   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-02T17:17:30,642   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-02T17:17:30,644   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-02T17:17:30,648   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:30,649   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:30,652   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:30,654   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:30,656   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:30,658   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:30,661   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:30,663   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:30,665   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:30,667   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-02T17:17:30,670   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-02T17:17:30,672   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-02T17:17:30,675   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2025-06-02T17:17:30,676   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-02T17:17:30,679   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-02T17:17:30,681   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-02T17:17:30,683   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-02T17:17:30,686   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-02T17:17:30,690   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2025-06-02T17:17:30,691   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2025-06-02T17:17:30,694   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2025-06-02T17:17:30,695   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-02T17:17:30,697   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-02T17:17:30,699   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-02T17:17:30,703   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2025-06-02T17:17:30,704   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-02T17:17:30,706   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-02T17:17:30,709   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-02T17:17:30,711   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-02T17:17:30,713   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-02T17:17:30,715   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-02T17:17:30,717   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-02T17:17:30,720   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-02T17:17:30,722   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-02T17:17:30,724   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-02T17:17:30,727   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2025-06-02T17:17:30,728   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-06-02T17:17:30,731   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-06-02T17:17:30,733   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2025-06-02T17:17:30,735   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2025-06-02T17:17:30,736   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,739   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,741   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,743   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,745   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,748   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,750   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,752   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,755   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,758   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,760   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,763   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,765   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,768   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2025-06-02T17:17:30,769   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-02T17:17:30,772   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-02T17:17:30,774   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-02T17:17:30,776   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-02T17:17:30,779   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-02T17:17:30,781   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-02T17:17:30,784   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-02T17:17:30,787   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,789   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,793   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,799   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,801   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,803   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-02T17:17:30,806   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-02T17:17:30,809   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-02T17:17:30,812   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-02T17:17:30,815   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-02T17:17:30,817   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-02T17:17:30,819   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-02T17:17:30,822   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-02T17:17:30,825   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-02T17:17:30,827   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-02T17:17:30,829   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-02T17:17:30,832   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-02T17:17:30,835   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-02T17:17:30,838   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-02T17:17:30,842   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2025-06-02T17:17:30,843   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-02T17:17:30,846   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-02T17:17:30,848   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-02T17:17:30,850   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-02T17:17:30,853   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-02T17:17:30,856   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2025-06-02T17:17:30,858   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-02T17:17:30,860   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-02T17:17:30,862   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-02T17:17:30,865   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-02T17:17:30,867   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-02T17:17:30,870   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-02T17:17:30,872   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-02T17:17:30,874   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-02T17:17:30,877   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-02T17:17:30,879   running install_egg_info
2025-06-02T17:17:30,918   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.16.7-py3.11.egg-info
2025-06-02T17:17:30,933   running install_scripts
2025-06-02T17:17:30,934   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts
2025-06-02T17:17:30,936   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts
2025-06-02T17:17:30,938   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts
2025-06-02T17:17:30,940   copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts
2025-06-02T17:17:30,942   copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts
2025-06-02T17:17:30,944   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts
2025-06-02T17:17:30,946   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts
2025-06-02T17:17:30,949   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts
2025-06-02T17:17:30,951   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts
2025-06-02T17:17:30,953   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts
2025-06-02T17:17:30,955   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts
2025-06-02T17:17:30,957   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts/ds to 755
2025-06-02T17:17:30,957   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts/ds_ssh to 755
2025-06-02T17:17:30,958   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts/ds_nvme_tune to 755
2025-06-02T17:17:30,958   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts/ds_io to 755
2025-06-02T17:17:30,959   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts/ds_elastic to 755
2025-06-02T17:17:30,960   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts/deepspeed to 755
2025-06-02T17:17:30,960   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts/ds_bench to 755
2025-06-02T17:17:30,961   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts/deepspeed.pt to 755
2025-06-02T17:17:30,961   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts/ds_report to 755
2025-06-02T17:17:30,962   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.data/scripts/dsr to 755
2025-06-02T17:17:30,977   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.7.dist-info/WHEEL
2025-06-02T17:17:30,980   creating '/tmp/pip-wheel-ohf83971/deepspeed-0.16.7-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2025-06-02T17:17:30,984   adding 'deepspeed/__init__.py'
2025-06-02T17:17:30,986   adding 'deepspeed/constants.py'
2025-06-02T17:17:30,988   adding 'deepspeed/env_report.py'
2025-06-02T17:17:30,990   adding 'deepspeed/git_version_info.py'
2025-06-02T17:17:30,991   adding 'deepspeed/git_version_info_installed.py'
2025-06-02T17:17:30,993   adding 'deepspeed/accelerator/__init__.py'
2025-06-02T17:17:30,995   adding 'deepspeed/accelerator/abstract_accelerator.py'
2025-06-02T17:17:30,997   adding 'deepspeed/accelerator/cpu_accelerator.py'
2025-06-02T17:17:31,000   adding 'deepspeed/accelerator/cuda_accelerator.py'
2025-06-02T17:17:31,002   adding 'deepspeed/accelerator/hpu_accelerator.py'
2025-06-02T17:17:31,004   adding 'deepspeed/accelerator/mlu_accelerator.py'
2025-06-02T17:17:31,006   adding 'deepspeed/accelerator/mps_accelerator.py'
2025-06-02T17:17:31,008   adding 'deepspeed/accelerator/npu_accelerator.py'
2025-06-02T17:17:31,010   adding 'deepspeed/accelerator/real_accelerator.py'
2025-06-02T17:17:31,012   adding 'deepspeed/accelerator/sdaa_accelerator.py'
2025-06-02T17:17:31,014   adding 'deepspeed/accelerator/xpu_accelerator.py'
2025-06-02T17:17:31,016   adding 'deepspeed/autotuning/__init__.py'
2025-06-02T17:17:31,021   adding 'deepspeed/autotuning/autotuner.py'
2025-06-02T17:17:31,023   adding 'deepspeed/autotuning/config.py'
2025-06-02T17:17:31,025   adding 'deepspeed/autotuning/constants.py'
2025-06-02T17:17:31,028   adding 'deepspeed/autotuning/scheduler.py'
2025-06-02T17:17:31,030   adding 'deepspeed/autotuning/utils.py'
2025-06-02T17:17:31,032   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2025-06-02T17:17:31,033   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2025-06-02T17:17:31,034   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2025-06-02T17:17:31,036   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2025-06-02T17:17:31,038   adding 'deepspeed/autotuning/tuner/__init__.py'
2025-06-02T17:17:31,039   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2025-06-02T17:17:31,040   adding 'deepspeed/autotuning/tuner/cost_model.py'
2025-06-02T17:17:31,042   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2025-06-02T17:17:31,043   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2025-06-02T17:17:31,045   adding 'deepspeed/autotuning/tuner/utils.py'
2025-06-02T17:17:31,047   adding 'deepspeed/checkpoint/__init__.py'
2025-06-02T17:17:31,048   adding 'deepspeed/checkpoint/constants.py'
2025-06-02T17:17:31,050   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2025-06-02T17:17:31,054   adding 'deepspeed/checkpoint/ds_to_universal.py'
2025-06-02T17:17:31,055   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2025-06-02T17:17:31,057   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2025-06-02T17:17:31,059   adding 'deepspeed/checkpoint/reshape_utils.py'
2025-06-02T17:17:31,061   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2025-06-02T17:17:31,062   adding 'deepspeed/checkpoint/utils.py'
2025-06-02T17:17:31,064   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2025-06-02T17:17:31,065   adding 'deepspeed/comm/__init__.py'
2025-06-02T17:17:31,067   adding 'deepspeed/comm/backend.py'
2025-06-02T17:17:31,068   adding 'deepspeed/comm/ccl.py'
2025-06-02T17:17:31,072   adding 'deepspeed/comm/comm.py'
2025-06-02T17:17:31,073   adding 'deepspeed/comm/config.py'
2025-06-02T17:17:31,074   adding 'deepspeed/comm/constants.py'
2025-06-02T17:17:31,076   adding 'deepspeed/comm/reduce_op.py'
2025-06-02T17:17:31,078   adding 'deepspeed/comm/torch.py'
2025-06-02T17:17:31,080   adding 'deepspeed/comm/utils.py'
2025-06-02T17:17:31,082   adding 'deepspeed/compile/__init__.py'
2025-06-02T17:17:31,084   adding 'deepspeed/compile/backend.py'
2025-06-02T17:17:31,085   adding 'deepspeed/compile/config.py'
2025-06-02T17:17:31,086   adding 'deepspeed/compile/fx.py'
2025-06-02T17:17:31,088   adding 'deepspeed/compile/graph_param.py'
2025-06-02T17:17:31,089   adding 'deepspeed/compile/inductor.py'
2025-06-02T17:17:31,091   adding 'deepspeed/compile/init_z1.py'
2025-06-02T17:17:31,092   adding 'deepspeed/compile/init_z3.py'
2025-06-02T17:17:31,095   adding 'deepspeed/compile/list_schedule.py'
2025-06-02T17:17:31,096   adding 'deepspeed/compile/partitioner.py'
2025-06-02T17:17:31,098   adding 'deepspeed/compile/patch_compiled_func.py'
2025-06-02T17:17:31,099   adding 'deepspeed/compile/patch_fake_tensor.py'
2025-06-02T17:17:31,101   adding 'deepspeed/compile/util.py'
2025-06-02T17:17:31,103   adding 'deepspeed/compile/passes/__init__.py'
2025-06-02T17:17:31,105   adding 'deepspeed/compile/passes/offload_activation.py'
2025-06-02T17:17:31,107   adding 'deepspeed/compile/passes/offload_adam_states.py'
2025-06-02T17:17:31,109   adding 'deepspeed/compile/passes/offload_parameters.py'
2025-06-02T17:17:31,111   adding 'deepspeed/compile/passes/prefetch.py'
2025-06-02T17:17:31,112   adding 'deepspeed/compile/passes/selective_gather.py'
2025-06-02T17:17:31,114   adding 'deepspeed/compile/passes/zero1_compile.py'
2025-06-02T17:17:31,115   adding 'deepspeed/compile/passes/zero3_compile.py'
2025-06-02T17:17:31,117   adding 'deepspeed/compile/profilers/__init__.py'
2025-06-02T17:17:31,119   adding 'deepspeed/compile/profilers/comm_profile.py'
2025-06-02T17:17:31,121   adding 'deepspeed/compile/profilers/graph_profile.py'
2025-06-02T17:17:31,123   adding 'deepspeed/compression/__init__.py'
2025-06-02T17:17:31,126   adding 'deepspeed/compression/basic_layer.py'
2025-06-02T17:17:31,128   adding 'deepspeed/compression/compress.py'
2025-06-02T17:17:31,131   adding 'deepspeed/compression/config.py'
2025-06-02T17:17:31,132   adding 'deepspeed/compression/constants.py'
2025-06-02T17:17:31,135   adding 'deepspeed/compression/helper.py'
2025-06-02T17:17:31,136   adding 'deepspeed/compression/scheduler.py'
2025-06-02T17:17:31,138   adding 'deepspeed/compression/utils.py'
2025-06-02T17:17:31,140   adding 'deepspeed/elasticity/__init__.py'
2025-06-02T17:17:31,141   adding 'deepspeed/elasticity/config.py'
2025-06-02T17:17:31,143   adding 'deepspeed/elasticity/constants.py'
2025-06-02T17:17:31,145   adding 'deepspeed/elasticity/elastic_agent.py'
2025-06-02T17:17:31,147   adding 'deepspeed/elasticity/elasticity.py'
2025-06-02T17:17:31,149   adding 'deepspeed/elasticity/utils.py'
2025-06-02T17:17:31,150   adding 'deepspeed/inference/__init__.py'
2025-06-02T17:17:31,152   adding 'deepspeed/inference/config.py'
2025-06-02T17:17:31,156   adding 'deepspeed/inference/engine.py'
2025-06-02T17:17:31,158   adding 'deepspeed/inference/quantization/__init__.py'
2025-06-02T17:17:31,160   adding 'deepspeed/inference/quantization/layers.py'
2025-06-02T17:17:31,161   adding 'deepspeed/inference/quantization/quantization.py'
2025-06-02T17:17:31,162   adding 'deepspeed/inference/quantization/quantization_context.py'
2025-06-02T17:17:31,164   adding 'deepspeed/inference/quantization/utils.py'
2025-06-02T17:17:31,166   adding 'deepspeed/inference/v2/__init__.py'
2025-06-02T17:17:31,168   adding 'deepspeed/inference/v2/allocator.py'
2025-06-02T17:17:31,169   adding 'deepspeed/inference/v2/config_v2.py'
2025-06-02T17:17:31,171   adding 'deepspeed/inference/v2/engine_factory.py'
2025-06-02T17:17:31,172   adding 'deepspeed/inference/v2/engine_v2.py'
2025-06-02T17:17:31,174   adding 'deepspeed/inference/v2/inference_parameter.py'
2025-06-02T17:17:31,175   adding 'deepspeed/inference/v2/inference_utils.py'
2025-06-02T17:17:31,176   adding 'deepspeed/inference/v2/logging.py'
2025-06-02T17:17:31,178   adding 'deepspeed/inference/v2/scheduling_utils.py'
2025-06-02T17:17:31,179   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2025-06-02T17:17:31,181   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2025-06-02T17:17:31,182   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2025-06-02T17:17:31,184   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2025-06-02T17:17:31,185   adding 'deepspeed/inference/v2/kernels/__init__.py'
2025-06-02T17:17:31,186   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2025-06-02T17:17:31,188   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2025-06-02T17:17:31,190   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2025-06-02T17:17:31,191   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2025-06-02T17:17:31,193   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2025-06-02T17:17:31,194   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2025-06-02T17:17:31,195   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2025-06-02T17:17:31,197   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2025-06-02T17:17:31,199   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2025-06-02T17:17:31,201   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2025-06-02T17:17:31,202   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2025-06-02T17:17:31,204   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2025-06-02T17:17:31,205   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2025-06-02T17:17:31,207   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2025-06-02T17:17:31,208   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2025-06-02T17:17:31,209   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2025-06-02T17:17:31,211   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2025-06-02T17:17:31,212   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2025-06-02T17:17:31,214   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2025-06-02T17:17:31,216   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2025-06-02T17:17:31,218   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2025-06-02T17:17:31,219   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2025-06-02T17:17:31,221   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2025-06-02T17:17:31,223   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2025-06-02T17:17:31,225   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2025-06-02T17:17:31,226   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2025-06-02T17:17:31,228   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2025-06-02T17:17:31,231   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2025-06-02T17:17:31,232   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2025-06-02T17:17:31,233   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2025-06-02T17:17:31,235   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2025-06-02T17:17:31,236   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2025-06-02T17:17:31,238   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2025-06-02T17:17:31,239   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2025-06-02T17:17:31,241   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2025-06-02T17:17:31,243   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2025-06-02T17:17:31,244   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2025-06-02T17:17:31,246   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2025-06-02T17:17:31,247   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2025-06-02T17:17:31,248   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2025-06-02T17:17:31,250   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2025-06-02T17:17:31,251   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2025-06-02T17:17:31,253   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2025-06-02T17:17:31,255   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2025-06-02T17:17:31,256   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2025-06-02T17:17:31,257   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2025-06-02T17:17:31,259   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2025-06-02T17:17:31,261   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2025-06-02T17:17:31,262   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2025-06-02T17:17:31,264   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2025-06-02T17:17:31,265   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2025-06-02T17:17:31,267   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2025-06-02T17:17:31,268   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2025-06-02T17:17:31,269   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2025-06-02T17:17:31,271   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2025-06-02T17:17:31,273   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2025-06-02T17:17:31,274   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2025-06-02T17:17:31,276   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2025-06-02T17:17:31,277   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2025-06-02T17:17:31,279   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2025-06-02T17:17:31,280   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2025-06-02T17:17:31,282   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2025-06-02T17:17:31,284   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2025-06-02T17:17:31,285   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2025-06-02T17:17:31,288   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2025-06-02T17:17:31,291   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2025-06-02T17:17:31,293   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2025-06-02T17:17:31,294   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2025-06-02T17:17:31,296   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2025-06-02T17:17:31,298   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2025-06-02T17:17:31,299   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2025-06-02T17:17:31,300   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2025-06-02T17:17:31,302   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2025-06-02T17:17:31,303   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2025-06-02T17:17:31,305   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2025-06-02T17:17:31,306   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2025-06-02T17:17:31,308   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2025-06-02T17:17:31,309   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2025-06-02T17:17:31,311   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2025-06-02T17:17:31,313   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2025-06-02T17:17:31,314   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2025-06-02T17:17:31,315   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2025-06-02T17:17:31,317   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2025-06-02T17:17:31,319   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2025-06-02T17:17:31,320   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2025-06-02T17:17:31,322   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2025-06-02T17:17:31,324   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2025-06-02T17:17:31,325   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2025-06-02T17:17:31,326   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2025-06-02T17:17:31,328   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2025-06-02T17:17:31,330   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2025-06-02T17:17:31,332   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2025-06-02T17:17:31,333   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2025-06-02T17:17:31,335   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2025-06-02T17:17:31,336   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2025-06-02T17:17:31,337   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2025-06-02T17:17:31,339   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2025-06-02T17:17:31,340   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2025-06-02T17:17:31,342   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2025-06-02T17:17:31,343   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2025-06-02T17:17:31,345   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2025-06-02T17:17:31,346   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2025-06-02T17:17:31,347   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2025-06-02T17:17:31,349   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2025-06-02T17:17:31,350   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2025-06-02T17:17:31,352   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2025-06-02T17:17:31,353   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2025-06-02T17:17:31,354   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2025-06-02T17:17:31,356   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2025-06-02T17:17:31,357   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2025-06-02T17:17:31,359   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2025-06-02T17:17:31,361   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2025-06-02T17:17:31,362   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2025-06-02T17:17:31,363   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2025-06-02T17:17:31,365   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2025-06-02T17:17:31,367   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2025-06-02T17:17:31,368   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2025-06-02T17:17:31,369   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2025-06-02T17:17:31,370   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2025-06-02T17:17:31,372   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2025-06-02T17:17:31,374   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2025-06-02T17:17:31,376   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2025-06-02T17:17:31,378   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2025-06-02T17:17:31,380   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2025-06-02T17:17:31,383   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2025-06-02T17:17:31,386   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2025-06-02T17:17:31,388   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2025-06-02T17:17:31,390   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2025-06-02T17:17:31,391   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2025-06-02T17:17:31,393   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2025-06-02T17:17:31,394   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2025-06-02T17:17:31,395   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2025-06-02T17:17:31,397   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2025-06-02T17:17:31,398   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2025-06-02T17:17:31,399   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2025-06-02T17:17:31,401   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2025-06-02T17:17:31,403   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2025-06-02T17:17:31,404   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2025-06-02T17:17:31,406   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2025-06-02T17:17:31,407   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2025-06-02T17:17:31,409   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2025-06-02T17:17:31,411   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2025-06-02T17:17:31,412   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2025-06-02T17:17:31,413   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2025-06-02T17:17:31,415   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2025-06-02T17:17:31,416   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2025-06-02T17:17:31,418   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2025-06-02T17:17:31,419   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2025-06-02T17:17:31,421   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2025-06-02T17:17:31,422   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2025-06-02T17:17:31,424   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2025-06-02T17:17:31,426   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2025-06-02T17:17:31,428   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2025-06-02T17:17:31,429   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2025-06-02T17:17:31,431   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2025-06-02T17:17:31,432   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2025-06-02T17:17:31,434   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2025-06-02T17:17:31,435   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2025-06-02T17:17:31,437   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2025-06-02T17:17:31,439   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2025-06-02T17:17:31,440   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2025-06-02T17:17:31,442   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2025-06-02T17:17:31,444   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2025-06-02T17:17:31,445   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2025-06-02T17:17:31,447   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2025-06-02T17:17:31,448   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2025-06-02T17:17:31,450   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2025-06-02T17:17:31,451   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2025-06-02T17:17:31,453   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2025-06-02T17:17:31,455   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2025-06-02T17:17:31,457   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2025-06-02T17:17:31,458   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2025-06-02T17:17:31,460   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2025-06-02T17:17:31,462   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2025-06-02T17:17:31,464   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2025-06-02T17:17:31,466   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2025-06-02T17:17:31,468   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2025-06-02T17:17:31,469   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2025-06-02T17:17:31,471   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2025-06-02T17:17:31,472   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2025-06-02T17:17:31,474   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2025-06-02T17:17:31,475   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2025-06-02T17:17:31,476   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2025-06-02T17:17:31,478   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2025-06-02T17:17:31,479   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2025-06-02T17:17:31,481   adding 'deepspeed/inference/v2/modules/__init__.py'
2025-06-02T17:17:31,483   adding 'deepspeed/inference/v2/modules/ds_module.py'
2025-06-02T17:17:31,484   adding 'deepspeed/inference/v2/modules/heuristics.py'
2025-06-02T17:17:31,485   adding 'deepspeed/inference/v2/modules/module_registry.py'
2025-06-02T17:17:31,487   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2025-06-02T17:17:31,489   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2025-06-02T17:17:31,490   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2025-06-02T17:17:31,491   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2025-06-02T17:17:31,493   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2025-06-02T17:17:31,494   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2025-06-02T17:17:31,495   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2025-06-02T17:17:31,497   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2025-06-02T17:17:31,499   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2025-06-02T17:17:31,501   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2025-06-02T17:17:31,503   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2025-06-02T17:17:31,504   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2025-06-02T17:17:31,506   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2025-06-02T17:17:31,507   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2025-06-02T17:17:31,509   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2025-06-02T17:17:31,511   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2025-06-02T17:17:31,513   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2025-06-02T17:17:31,515   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2025-06-02T17:17:31,516   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2025-06-02T17:17:31,518   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2025-06-02T17:17:31,519   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2025-06-02T17:17:31,521   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2025-06-02T17:17:31,523   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2025-06-02T17:17:31,524   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2025-06-02T17:17:31,526   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2025-06-02T17:17:31,528   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2025-06-02T17:17:31,529   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2025-06-02T17:17:31,531   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2025-06-02T17:17:31,532   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2025-06-02T17:17:31,533   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2025-06-02T17:17:31,535   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2025-06-02T17:17:31,536   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2025-06-02T17:17:31,538   adding 'deepspeed/inference/v2/ragged/__init__.py'
2025-06-02T17:17:31,540   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2025-06-02T17:17:31,542   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2025-06-02T17:17:31,544   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2025-06-02T17:17:31,546   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2025-06-02T17:17:31,548   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2025-06-02T17:17:31,550   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2025-06-02T17:17:31,552   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2025-06-02T17:17:31,553   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2025-06-02T17:17:31,555   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2025-06-02T17:17:31,557   adding 'deepspeed/launcher/__init__.py'
2025-06-02T17:17:31,558   adding 'deepspeed/launcher/constants.py'
2025-06-02T17:17:31,561   adding 'deepspeed/launcher/launch.py'
2025-06-02T17:17:31,563   adding 'deepspeed/launcher/launcher_helper.py'
2025-06-02T17:17:31,565   adding 'deepspeed/launcher/multinode_runner.py'
2025-06-02T17:17:31,569   adding 'deepspeed/launcher/runner.py'
2025-06-02T17:17:31,571   adding 'deepspeed/linear/__init__.py'
2025-06-02T17:17:31,572   adding 'deepspeed/linear/config.py'
2025-06-02T17:17:31,574   adding 'deepspeed/linear/context_manager.py'
2025-06-02T17:17:31,576   adding 'deepspeed/linear/optimized_linear.py'
2025-06-02T17:17:31,578   adding 'deepspeed/linear/quantization.py'
2025-06-02T17:17:31,580   adding 'deepspeed/model_implementations/__init__.py'
2025-06-02T17:17:31,581   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2025-06-02T17:17:31,583   adding 'deepspeed/model_implementations/diffusers/unet.py'
2025-06-02T17:17:31,584   adding 'deepspeed/model_implementations/diffusers/vae.py'
2025-06-02T17:17:31,586   adding 'deepspeed/model_implementations/features/__init__.py'
2025-06-02T17:17:31,587   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2025-06-02T17:17:31,590   adding 'deepspeed/model_implementations/transformers/__init__.py'
2025-06-02T17:17:31,592   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2025-06-02T17:17:31,593   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2025-06-02T17:17:31,594   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2025-06-02T17:17:31,595   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2025-06-02T17:17:31,597   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2025-06-02T17:17:31,598   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2025-06-02T17:17:31,600   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2025-06-02T17:17:31,601   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2025-06-02T17:17:31,603   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2025-06-02T17:17:31,605   adding 'deepspeed/module_inject/__init__.py'
2025-06-02T17:17:31,609   adding 'deepspeed/module_inject/auto_tp.py'
2025-06-02T17:17:31,611   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2025-06-02T17:17:31,613   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2025-06-02T17:17:31,615   adding 'deepspeed/module_inject/inject.py'
2025-06-02T17:17:31,619   adding 'deepspeed/module_inject/layers.py'
2025-06-02T17:17:31,621   adding 'deepspeed/module_inject/load_checkpoint.py'
2025-06-02T17:17:31,622   adding 'deepspeed/module_inject/module_quantize.py'
2025-06-02T17:17:31,624   adding 'deepspeed/module_inject/policy.py'
2025-06-02T17:17:31,628   adding 'deepspeed/module_inject/replace_module.py'
2025-06-02T17:17:31,630   adding 'deepspeed/module_inject/replace_policy.py'
2025-06-02T17:17:31,631   adding 'deepspeed/module_inject/tp_shard.py'
2025-06-02T17:17:31,632   adding 'deepspeed/module_inject/utils.py'
2025-06-02T17:17:31,634   adding 'deepspeed/module_inject/containers/__init__.py'
2025-06-02T17:17:31,636   adding 'deepspeed/module_inject/containers/base.py'
2025-06-02T17:17:31,638   adding 'deepspeed/module_inject/containers/base_moe.py'
2025-06-02T17:17:31,639   adding 'deepspeed/module_inject/containers/bert.py'
2025-06-02T17:17:31,641   adding 'deepspeed/module_inject/containers/bloom.py'
2025-06-02T17:17:31,642   adding 'deepspeed/module_inject/containers/clip.py'
2025-06-02T17:17:31,644   adding 'deepspeed/module_inject/containers/distil_bert.py'
2025-06-02T17:17:31,645   adding 'deepspeed/module_inject/containers/gpt2.py'
2025-06-02T17:17:31,647   adding 'deepspeed/module_inject/containers/gptj.py'
2025-06-02T17:17:31,649   adding 'deepspeed/module_inject/containers/gptneo.py'
2025-06-02T17:17:31,651   adding 'deepspeed/module_inject/containers/gptneox.py'
2025-06-02T17:17:31,653   adding 'deepspeed/module_inject/containers/internlm.py'
2025-06-02T17:17:31,655   adding 'deepspeed/module_inject/containers/llama.py'
2025-06-02T17:17:31,656   adding 'deepspeed/module_inject/containers/llama2.py'
2025-06-02T17:17:31,658   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2025-06-02T17:17:31,659   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2025-06-02T17:17:31,661   adding 'deepspeed/module_inject/containers/opt.py'
2025-06-02T17:17:31,662   adding 'deepspeed/module_inject/containers/unet.py'
2025-06-02T17:17:31,664   adding 'deepspeed/module_inject/containers/vae.py'
2025-06-02T17:17:31,665   adding 'deepspeed/module_inject/containers/features/__init__.py'
2025-06-02T17:17:31,667   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2025-06-02T17:17:31,669   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2025-06-02T17:17:31,670   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2025-06-02T17:17:31,671   adding 'deepspeed/module_inject/containers/features/megatron.py'
2025-06-02T17:17:31,673   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2025-06-02T17:17:31,674   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2025-06-02T17:17:31,676   adding 'deepspeed/moe/__init__.py'
2025-06-02T17:17:31,678   adding 'deepspeed/moe/experts.py'
2025-06-02T17:17:31,679   adding 'deepspeed/moe/layer.py'
2025-06-02T17:17:31,681   adding 'deepspeed/moe/mappings.py'
2025-06-02T17:17:31,684   adding 'deepspeed/moe/sharded_moe.py'
2025-06-02T17:17:31,686   adding 'deepspeed/moe/utils.py'
2025-06-02T17:17:31,688   adding 'deepspeed/monitor/__init__.py'
2025-06-02T17:17:31,690   adding 'deepspeed/monitor/comet.py'
2025-06-02T17:17:31,691   adding 'deepspeed/monitor/config.py'
2025-06-02T17:17:31,693   adding 'deepspeed/monitor/csv_monitor.py'
2025-06-02T17:17:31,694   adding 'deepspeed/monitor/monitor.py'
2025-06-02T17:17:31,695   adding 'deepspeed/monitor/tensorboard.py'
2025-06-02T17:17:31,697   adding 'deepspeed/monitor/utils.py'
2025-06-02T17:17:31,698   adding 'deepspeed/monitor/wandb.py'
2025-06-02T17:17:31,700   adding 'deepspeed/nebula/__init__.py'
2025-06-02T17:17:31,701   adding 'deepspeed/nebula/config.py'
2025-06-02T17:17:31,703   adding 'deepspeed/nebula/constants.py'
2025-06-02T17:17:31,704   adding 'deepspeed/nvme/__init__.py'
2025-06-02T17:17:31,706   adding 'deepspeed/nvme/ds_aio_args.py'
2025-06-02T17:17:31,708   adding 'deepspeed/nvme/ds_aio_basic.py'
2025-06-02T17:17:31,709   adding 'deepspeed/nvme/ds_aio_handle.py'
2025-06-02T17:17:31,711   adding 'deepspeed/nvme/ds_aio_job.py'
2025-06-02T17:17:31,712   adding 'deepspeed/nvme/parse_nvme_stats.py'
2025-06-02T17:17:31,714   adding 'deepspeed/nvme/perf_generate_param.py'
2025-06-02T17:17:31,716   adding 'deepspeed/nvme/perf_run_sweep.py'
2025-06-02T17:17:31,717   adding 'deepspeed/nvme/perf_sweep_utils.py'
2025-06-02T17:17:31,718   adding 'deepspeed/nvme/test_ds_aio.py'
2025-06-02T17:17:31,720   adding 'deepspeed/nvme/test_ds_aio_utils.py'
2025-06-02T17:17:31,721   adding 'deepspeed/nvme/validate_async_io.py'
2025-06-02T17:17:31,723   adding 'deepspeed/ops/__init__.py'
2025-06-02T17:17:31,725   adding 'deepspeed/ops/adagrad/__init__.py'
2025-06-02T17:17:31,726   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2025-06-02T17:17:31,728   adding 'deepspeed/ops/adam/__init__.py'
2025-06-02T17:17:31,730   adding 'deepspeed/ops/adam/cpu_adam.py'
2025-06-02T17:17:31,732   adding 'deepspeed/ops/adam/fused_adam.py'
2025-06-02T17:17:31,733   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2025-06-02T17:17:31,735   adding 'deepspeed/ops/aio/__init__.py'
2025-06-02T17:17:31,737   adding 'deepspeed/ops/compile/__init__.py'
2025-06-02T17:17:31,740   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2025-06-02T17:17:31,742   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2025-06-02T17:17:31,744   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2025-06-02T17:17:31,745   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2025-06-02T17:17:31,747   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2025-06-02T17:17:31,749   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2025-06-02T17:17:31,752   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2025-06-02T17:17:31,754   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2025-06-02T17:17:31,755   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2025-06-02T17:17:31,756   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2025-06-02T17:17:31,758   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2025-06-02T17:17:31,759   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2025-06-02T17:17:31,762   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2025-06-02T17:17:31,763   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2025-06-02T17:17:31,764   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2025-06-02T17:17:31,765   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2025-06-02T17:17:31,767   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2025-06-02T17:17:31,768   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2025-06-02T17:17:31,769   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2025-06-02T17:17:31,771   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2025-06-02T17:17:31,772   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2025-06-02T17:17:31,773   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2025-06-02T17:17:31,775   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2025-06-02T17:17:31,776   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2025-06-02T17:17:31,777   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2025-06-02T17:17:31,779   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2025-06-02T17:17:31,780   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2025-06-02T17:17:31,782   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2025-06-02T17:17:31,783   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2025-06-02T17:17:31,785   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2025-06-02T17:17:31,787   adding 'deepspeed/ops/csrc/compile/deepcompile.cpp'
2025-06-02T17:17:31,789   adding 'deepspeed/ops/csrc/compile/init.cpp'
2025-06-02T17:17:31,790   adding 'deepspeed/ops/csrc/compile/util.cpp'
2025-06-02T17:17:31,792   adding 'deepspeed/ops/csrc/compile/z1.cpp'
2025-06-02T17:17:31,793   adding 'deepspeed/ops/csrc/compile/z1.h'
2025-06-02T17:17:31,796   adding 'deepspeed/ops/csrc/compile/z3.cpp'
2025-06-02T17:17:31,797   adding 'deepspeed/ops/csrc/compile/z3.h'
2025-06-02T17:17:31,800   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2025-06-02T17:17:31,803   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2025-06-02T17:17:31,806   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2025-06-02T17:17:31,807   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2025-06-02T17:17:31,809   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2025-06-02T17:17:31,811   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2025-06-02T17:17:31,814   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2025-06-02T17:17:31,815   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2025-06-02T17:17:31,817   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2025-06-02T17:17:31,819   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2025-06-02T17:17:31,828   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2025-06-02T17:17:31,834   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2025-06-02T17:17:31,836   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2025-06-02T17:17:31,839   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2025-06-02T17:17:31,841   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2025-06-02T17:17:31,843   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2025-06-02T17:17:31,845   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2025-06-02T17:17:31,847   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2025-06-02T17:17:31,850   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2025-06-02T17:17:31,852   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2025-06-02T17:17:31,854   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2025-06-02T17:17:31,856   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2025-06-02T17:17:31,864   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2025-06-02T17:17:31,867   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2025-06-02T17:17:31,869   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2025-06-02T17:17:31,873   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2025-06-02T17:17:31,877   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2025-06-02T17:17:31,881   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2025-06-02T17:17:31,883   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2025-06-02T17:17:31,885   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2025-06-02T17:17:31,887   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2025-06-02T17:17:31,888   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2025-06-02T17:17:31,890   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2025-06-02T17:17:31,893   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2025-06-02T17:17:31,895   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2025-06-02T17:17:31,896   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2025-06-02T17:17:31,899   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2025-06-02T17:17:31,900   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2025-06-02T17:17:31,902   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2025-06-02T17:17:31,903   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2025-06-02T17:17:31,905   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2025-06-02T17:17:31,906   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2025-06-02T17:17:31,909   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2025-06-02T17:17:31,910   adding 'deepspeed/ops/csrc/includes/Timer.h'
2025-06-02T17:17:31,911   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2025-06-02T17:17:31,913   adding 'deepspeed/ops/csrc/includes/compat.h'
2025-06-02T17:17:31,914   adding 'deepspeed/ops/csrc/includes/context.h'
2025-06-02T17:17:31,916   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2025-06-02T17:17:31,918   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2025-06-02T17:17:31,919   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2025-06-02T17:17:31,921   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2025-06-02T17:17:31,923   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2025-06-02T17:17:31,924   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2025-06-02T17:17:31,927   adding 'deepspeed/ops/csrc/includes/deepcompile.h'
2025-06-02T17:17:31,929   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2025-06-02T17:17:31,930   adding 'deepspeed/ops/csrc/includes/dropout.h'
2025-06-02T17:17:31,932   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2025-06-02T17:17:31,933   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2025-06-02T17:17:31,935   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2025-06-02T17:17:31,936   adding 'deepspeed/ops/csrc/includes/gelu.h'
2025-06-02T17:17:31,937   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2025-06-02T17:17:31,939   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2025-06-02T17:17:31,941   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2025-06-02T17:17:31,943   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2025-06-02T17:17:31,945   adding 'deepspeed/ops/csrc/includes/quantization.h'
2025-06-02T17:17:31,947   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2025-06-02T17:17:31,949   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2025-06-02T17:17:31,951   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2025-06-02T17:17:31,953   adding 'deepspeed/ops/csrc/includes/simd.h'
2025-06-02T17:17:31,954   adding 'deepspeed/ops/csrc/includes/softmax.h'
2025-06-02T17:17:31,956   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2025-06-02T17:17:31,957   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2025-06-02T17:17:31,959   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2025-06-02T17:17:31,961   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2025-06-02T17:17:31,963   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2025-06-02T17:17:31,965   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2025-06-02T17:17:31,966   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2025-06-02T17:17:31,968   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2025-06-02T17:17:31,969   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2025-06-02T17:17:31,971   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2025-06-02T17:17:31,975   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2025-06-02T17:17:31,977   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2025-06-02T17:17:31,979   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2025-06-02T17:17:31,981   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2025-06-02T17:17:31,983   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2025-06-02T17:17:31,985   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2025-06-02T17:17:31,987   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2025-06-02T17:17:31,989   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2025-06-02T17:17:31,990   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2025-06-02T17:17:31,992   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2025-06-02T17:17:31,994   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2025-06-02T17:17:31,997   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2025-06-02T17:17:31,998   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2025-06-02T17:17:32,000   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2025-06-02T17:17:32,002   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2025-06-02T17:17:32,005   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2025-06-02T17:17:32,009   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2025-06-02T17:17:32,011   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2025-06-02T17:17:32,013   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2025-06-02T17:17:32,018   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2025-06-02T17:17:32,021   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2025-06-02T17:17:32,024   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2025-06-02T17:17:32,027   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2025-06-02T17:17:32,029   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2025-06-02T17:17:32,032   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2025-06-02T17:17:32,034   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2025-06-02T17:17:32,036   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2025-06-02T17:17:32,042   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2025-06-02T17:17:32,044   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2025-06-02T17:17:32,046   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2025-06-02T17:17:32,048   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2025-06-02T17:17:32,051   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2025-06-02T17:17:32,054   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2025-06-02T17:17:32,056   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2025-06-02T17:17:32,058   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2025-06-02T17:17:32,059   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2025-06-02T17:17:32,062   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2025-06-02T17:17:32,064   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2025-06-02T17:17:32,065   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2025-06-02T17:17:32,067   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2025-06-02T17:17:32,069   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2025-06-02T17:17:32,071   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2025-06-02T17:17:32,073   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2025-06-02T17:17:32,075   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2025-06-02T17:17:32,076   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2025-06-02T17:17:32,078   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2025-06-02T17:17:32,080   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2025-06-02T17:17:32,082   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2025-06-02T17:17:32,084   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2025-06-02T17:17:32,086   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2025-06-02T17:17:32,088   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2025-06-02T17:17:32,089   adding 'deepspeed/ops/fp_quantizer/fp8_gemm_triton.py'
2025-06-02T17:17:32,091   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2025-06-02T17:17:32,093   adding 'deepspeed/ops/gds/__init__.py'
2025-06-02T17:17:32,095   adding 'deepspeed/ops/lamb/__init__.py'
2025-06-02T17:17:32,097   adding 'deepspeed/ops/lamb/fused_lamb.py'
2025-06-02T17:17:32,099   adding 'deepspeed/ops/lion/__init__.py'
2025-06-02T17:17:32,101   adding 'deepspeed/ops/lion/cpu_lion.py'
2025-06-02T17:17:32,103   adding 'deepspeed/ops/lion/fused_lion.py'
2025-06-02T17:17:32,104   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2025-06-02T17:17:32,107   adding 'deepspeed/ops/op_builder/__init__.py'
2025-06-02T17:17:32,108   adding 'deepspeed/ops/op_builder/all_ops.py'
2025-06-02T17:17:32,110   adding 'deepspeed/ops/op_builder/async_io.py'
2025-06-02T17:17:32,114   adding 'deepspeed/ops/op_builder/builder.py'
2025-06-02T17:17:32,116   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2025-06-02T17:17:32,117   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2025-06-02T17:17:32,118   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2025-06-02T17:17:32,120   adding 'deepspeed/ops/op_builder/dc.py'
2025-06-02T17:17:32,121   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2025-06-02T17:17:32,123   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2025-06-02T17:17:32,124   adding 'deepspeed/ops/op_builder/fused_adam.py'
2025-06-02T17:17:32,125   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2025-06-02T17:17:32,127   adding 'deepspeed/ops/op_builder/fused_lion.py'
2025-06-02T17:17:32,128   adding 'deepspeed/ops/op_builder/gds.py'
2025-06-02T17:17:32,130   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2025-06-02T17:17:32,131   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2025-06-02T17:17:32,132   adding 'deepspeed/ops/op_builder/quantizer.py'
2025-06-02T17:17:32,134   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2025-06-02T17:17:32,135   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2025-06-02T17:17:32,137   adding 'deepspeed/ops/op_builder/random_ltd.py'
2025-06-02T17:17:32,138   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2025-06-02T17:17:32,140   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2025-06-02T17:17:32,141   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2025-06-02T17:17:32,143   adding 'deepspeed/ops/op_builder/transformer.py'
2025-06-02T17:17:32,144   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2025-06-02T17:17:32,146   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2025-06-02T17:17:32,148   adding 'deepspeed/ops/op_builder/cpu/async_io.py'
2025-06-02T17:17:32,149   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2025-06-02T17:17:32,151   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2025-06-02T17:17:32,152   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2025-06-02T17:17:32,153   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2025-06-02T17:17:32,155   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2025-06-02T17:17:32,157   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2025-06-02T17:17:32,158   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2025-06-02T17:17:32,159   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2025-06-02T17:17:32,161   adding 'deepspeed/ops/op_builder/hpu/fp_quantizer.py'
2025-06-02T17:17:32,162   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2025-06-02T17:17:32,163   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2025-06-02T17:17:32,164   adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py'
2025-06-02T17:17:32,166   adding 'deepspeed/ops/op_builder/mlu/__init__.py'
2025-06-02T17:17:32,168   adding 'deepspeed/ops/op_builder/mlu/builder.py'
2025-06-02T17:17:32,169   adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py'
2025-06-02T17:17:32,170   adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py'
2025-06-02T17:17:32,172   adding 'deepspeed/ops/op_builder/mlu/fused_adam.py'
2025-06-02T17:17:32,173   adding 'deepspeed/ops/op_builder/mlu/no_impl.py'
2025-06-02T17:17:32,175   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2025-06-02T17:17:32,176   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2025-06-02T17:17:32,178   adding 'deepspeed/ops/op_builder/npu/builder.py'
2025-06-02T17:17:32,179   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2025-06-02T17:17:32,181   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2025-06-02T17:17:32,182   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2025-06-02T17:17:32,184   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2025-06-02T17:17:32,186   adding 'deepspeed/ops/op_builder/npu/inference.py'
2025-06-02T17:17:32,187   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2025-06-02T17:17:32,190   adding 'deepspeed/ops/op_builder/sdaa/__init__.py'
2025-06-02T17:17:32,191   adding 'deepspeed/ops/op_builder/sdaa/builder.py'
2025-06-02T17:17:32,193   adding 'deepspeed/ops/op_builder/sdaa/cpu_adam.py'
2025-06-02T17:17:32,194   adding 'deepspeed/ops/op_builder/sdaa/fused_adam.py'
2025-06-02T17:17:32,196   adding 'deepspeed/ops/op_builder/sdaa/no_impl.py'
2025-06-02T17:17:32,198   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2025-06-02T17:17:32,200   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2025-06-02T17:17:32,202   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2025-06-02T17:17:32,203   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2025-06-02T17:17:32,204   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2025-06-02T17:17:32,206   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2025-06-02T17:17:32,207   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2025-06-02T17:17:32,208   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2025-06-02T17:17:32,209   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2025-06-02T17:17:32,211   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2025-06-02T17:17:32,212   adding 'deepspeed/ops/quantizer/__init__.py'
2025-06-02T17:17:32,213   adding 'deepspeed/ops/quantizer/quantizer.py'
2025-06-02T17:17:32,215   adding 'deepspeed/ops/random_ltd/__init__.py'
2025-06-02T17:17:32,217   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2025-06-02T17:17:32,218   adding 'deepspeed/ops/sparse_attention/__init__.py'
2025-06-02T17:17:32,220   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2025-06-02T17:17:32,224   adding 'deepspeed/ops/sparse_attention/matmul.py'
2025-06-02T17:17:32,226   adding 'deepspeed/ops/sparse_attention/softmax.py'
2025-06-02T17:17:32,229   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2025-06-02T17:17:32,231   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2025-06-02T17:17:32,234   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2025-06-02T17:17:32,236   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2025-06-02T17:17:32,238   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2025-06-02T17:17:32,239   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2025-06-02T17:17:32,241   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2025-06-02T17:17:32,243   adding 'deepspeed/ops/transformer/__init__.py'
2025-06-02T17:17:32,246   adding 'deepspeed/ops/transformer/transformer.py'
2025-06-02T17:17:32,248   adding 'deepspeed/ops/transformer/inference/__init__.py'
2025-06-02T17:17:32,249   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2025-06-02T17:17:32,251   adding 'deepspeed/ops/transformer/inference/config.py'
2025-06-02T17:17:32,252   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2025-06-02T17:17:32,254   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2025-06-02T17:17:32,255   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2025-06-02T17:17:32,258   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2025-06-02T17:17:32,259   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2025-06-02T17:17:32,262   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2025-06-02T17:17:32,264   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2025-06-02T17:17:32,266   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2025-06-02T17:17:32,267   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2025-06-02T17:17:32,269   adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py'
2025-06-02T17:17:32,270   adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py'
2025-06-02T17:17:32,271   adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py'
2025-06-02T17:17:32,272   adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py'
2025-06-02T17:17:32,274   adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py'
2025-06-02T17:17:32,275   adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py'
2025-06-02T17:17:32,276   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2025-06-02T17:17:32,278   adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py'
2025-06-02T17:17:32,279   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2025-06-02T17:17:32,281   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2025-06-02T17:17:32,282   adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py'
2025-06-02T17:17:32,283   adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py'
2025-06-02T17:17:32,285   adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py'
2025-06-02T17:17:32,286   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2025-06-02T17:17:32,288   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2025-06-02T17:17:32,289   adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py'
2025-06-02T17:17:32,290   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2025-06-02T17:17:32,292   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2025-06-02T17:17:32,293   adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py'
2025-06-02T17:17:32,295   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2025-06-02T17:17:32,297   adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py'
2025-06-02T17:17:32,299   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2025-06-02T17:17:32,301   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2025-06-02T17:17:32,302   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2025-06-02T17:17:32,304   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2025-06-02T17:17:32,306   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2025-06-02T17:17:32,308   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2025-06-02T17:17:32,310   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2025-06-02T17:17:32,311   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2025-06-02T17:17:32,313   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2025-06-02T17:17:32,315   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2025-06-02T17:17:32,316   adding 'deepspeed/pipe/__init__.py'
2025-06-02T17:17:32,318   adding 'deepspeed/profiling/__init__.py'
2025-06-02T17:17:32,319   adding 'deepspeed/profiling/config.py'
2025-06-02T17:17:32,321   adding 'deepspeed/profiling/constants.py'
2025-06-02T17:17:32,322   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2025-06-02T17:17:32,328   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2025-06-02T17:17:32,331   adding 'deepspeed/runtime/__init__.py'
2025-06-02T17:17:32,332   adding 'deepspeed/runtime/base_optimizer.py'
2025-06-02T17:17:32,335   adding 'deepspeed/runtime/bf16_optimizer.py'
2025-06-02T17:17:32,337   adding 'deepspeed/runtime/compiler.py'
2025-06-02T17:17:32,341   adding 'deepspeed/runtime/config.py'
2025-06-02T17:17:32,343   adding 'deepspeed/runtime/config_utils.py'
2025-06-02T17:17:32,346   adding 'deepspeed/runtime/constants.py'
2025-06-02T17:17:32,348   adding 'deepspeed/runtime/dataloader.py'
2025-06-02T17:17:32,349   adding 'deepspeed/runtime/eigenvalue.py'
2025-06-02T17:17:32,371   adding 'deepspeed/runtime/engine.py'
2025-06-02T17:17:32,375   adding 'deepspeed/runtime/hybrid_engine.py'
2025-06-02T17:17:32,379   adding 'deepspeed/runtime/lr_schedules.py'
2025-06-02T17:17:32,380   adding 'deepspeed/runtime/progressive_layer_drop.py'
2025-06-02T17:17:32,382   adding 'deepspeed/runtime/quantize.py'
2025-06-02T17:17:32,383   adding 'deepspeed/runtime/sparse_tensor.py'
2025-06-02T17:17:32,385   adding 'deepspeed/runtime/state_dict_factory.py'
2025-06-02T17:17:32,391   adding 'deepspeed/runtime/utils.py'
2025-06-02T17:17:32,393   adding 'deepspeed/runtime/weight_quantizer.py'
2025-06-02T17:17:32,394   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2025-06-02T17:17:32,399   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2025-06-02T17:17:32,401   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2025-06-02T17:17:32,403   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2025-06-02T17:17:32,404   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2025-06-02T17:17:32,405   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2025-06-02T17:17:32,407   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2025-06-02T17:17:32,409   adding 'deepspeed/runtime/comm/__init__.py'
2025-06-02T17:17:32,411   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2025-06-02T17:17:32,412   adding 'deepspeed/runtime/comm/compressed.py'
2025-06-02T17:17:32,414   adding 'deepspeed/runtime/comm/hccl.py'
2025-06-02T17:17:32,415   adding 'deepspeed/runtime/comm/mpi.py'
2025-06-02T17:17:32,417   adding 'deepspeed/runtime/comm/nccl.py'
2025-06-02T17:17:32,419   adding 'deepspeed/runtime/compression/__init__.py'
2025-06-02T17:17:32,420   adding 'deepspeed/runtime/compression/cupy.py'
2025-06-02T17:17:32,422   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2025-06-02T17:17:32,423   adding 'deepspeed/runtime/data_pipeline/config.py'
2025-06-02T17:17:32,425   adding 'deepspeed/runtime/data_pipeline/constants.py'
2025-06-02T17:17:32,427   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2025-06-02T17:17:32,429   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2025-06-02T17:17:32,430   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2025-06-02T17:17:32,431   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2025-06-02T17:17:32,433   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2025-06-02T17:17:32,434   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2025-06-02T17:17:32,436   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2025-06-02T17:17:32,442   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2025-06-02T17:17:32,444   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2025-06-02T17:17:32,448   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2025-06-02T17:17:32,449   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2025-06-02T17:17:32,452   adding 'deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py'
2025-06-02T17:17:32,454   adding 'deepspeed/runtime/domino/__init__.py'
2025-06-02T17:17:32,455   adding 'deepspeed/runtime/domino/async_linear.py'
2025-06-02T17:17:32,458   adding 'deepspeed/runtime/domino/transformer.py'
2025-06-02T17:17:32,460   adding 'deepspeed/runtime/fp16/__init__.py'
2025-06-02T17:17:32,463   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2025-06-02T17:17:32,465   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2025-06-02T17:17:32,467   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2025-06-02T17:17:32,469   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2025-06-02T17:17:32,471   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2025-06-02T17:17:32,474   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2025-06-02T17:17:32,477   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2025-06-02T17:17:32,479   adding 'deepspeed/runtime/pipe/__init__.py'
2025-06-02T17:17:32,486   adding 'deepspeed/runtime/pipe/engine.py'
2025-06-02T17:17:32,490   adding 'deepspeed/runtime/pipe/module.py'
2025-06-02T17:17:32,529   adding 'deepspeed/runtime/pipe/p2p.py'
2025-06-02T17:17:32,534   adding 'deepspeed/runtime/pipe/schedule.py'
2025-06-02T17:17:32,539   adding 'deepspeed/runtime/pipe/topology.py'
2025-06-02T17:17:32,542   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2025-06-02T17:17:32,545   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2025-06-02T17:17:32,548   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2025-06-02T17:17:32,550   adding 'deepspeed/runtime/swap_tensor/constants.py'
2025-06-02T17:17:32,553   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2025-06-02T17:17:32,555   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2025-06-02T17:17:32,558   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2025-06-02T17:17:32,560   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2025-06-02T17:17:32,561   adding 'deepspeed/runtime/swap_tensor/utils.py'
2025-06-02T17:17:32,563   adding 'deepspeed/runtime/tensor_parallel/__init__.py'
2025-06-02T17:17:32,565   adding 'deepspeed/runtime/tensor_parallel/config.py'
2025-06-02T17:17:32,566   adding 'deepspeed/runtime/tensor_parallel/tp_manager.py'
2025-06-02T17:17:32,568   adding 'deepspeed/runtime/zero/__init__.py'
2025-06-02T17:17:32,571   adding 'deepspeed/runtime/zero/config.py'
2025-06-02T17:17:32,573   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2025-06-02T17:17:32,575   adding 'deepspeed/runtime/zero/linear.py'
2025-06-02T17:17:32,578   adding 'deepspeed/runtime/zero/mics.py'
2025-06-02T17:17:32,580   adding 'deepspeed/runtime/zero/mics_utils.py'
2025-06-02T17:17:32,581   adding 'deepspeed/runtime/zero/offload_config.py'
2025-06-02T17:17:32,583   adding 'deepspeed/runtime/zero/offload_states.py'
2025-06-02T17:17:32,586   adding 'deepspeed/runtime/zero/parameter_offload.py'
2025-06-02T17:17:32,599   adding 'deepspeed/runtime/zero/partition_parameters.py'
2025-06-02T17:17:32,603   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2025-06-02T17:17:32,605   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2025-06-02T17:17:32,621   adding 'deepspeed/runtime/zero/stage3.py'
2025-06-02T17:17:32,635   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2025-06-02T17:17:32,637   adding 'deepspeed/runtime/zero/test.py'
2025-06-02T17:17:32,639   adding 'deepspeed/runtime/zero/tiling.py'
2025-06-02T17:17:32,641   adding 'deepspeed/runtime/zero/utils.py'
2025-06-02T17:17:32,642   adding 'deepspeed/sequence/__init__.py'
2025-06-02T17:17:32,644   adding 'deepspeed/sequence/cross_entropy.py'
2025-06-02T17:17:32,648   adding 'deepspeed/sequence/fpdt_layer.py'
2025-06-02T17:17:32,651   adding 'deepspeed/sequence/layer.py'
2025-06-02T17:17:32,653   adding 'deepspeed/utils/__init__.py'
2025-06-02T17:17:32,654   adding 'deepspeed/utils/bwc.py'
2025-06-02T17:17:32,656   adding 'deepspeed/utils/comms_logging.py'
2025-06-02T17:17:32,657   adding 'deepspeed/utils/config.py'
2025-06-02T17:17:32,659   adding 'deepspeed/utils/debug.py'
2025-06-02T17:17:32,660   adding 'deepspeed/utils/exceptions.py'
2025-06-02T17:17:32,663   adding 'deepspeed/utils/groups.py'
2025-06-02T17:17:32,665   adding 'deepspeed/utils/init_on_device.py'
2025-06-02T17:17:32,666   adding 'deepspeed/utils/logging.py'
2025-06-02T17:17:32,668   adding 'deepspeed/utils/mixed_precision_linkage.py'
2025-06-02T17:17:32,670   adding 'deepspeed/utils/numa.py'
2025-06-02T17:17:32,671   adding 'deepspeed/utils/nvtx.py'
2025-06-02T17:17:32,673   adding 'deepspeed/utils/tensor_fragment.py'
2025-06-02T17:17:32,675   adding 'deepspeed/utils/timer.py'
2025-06-02T17:17:32,676   adding 'deepspeed/utils/torch.py'
2025-06-02T17:17:32,678   adding 'deepspeed/utils/types.py'
2025-06-02T17:17:32,679   adding 'deepspeed/utils/z3_leaf_module.py'
2025-06-02T17:17:32,683   adding 'deepspeed/utils/zero_to_fp32.py'
2025-06-02T17:17:32,686   adding 'deepspeed-0.16.7.data/scripts/deepspeed'
2025-06-02T17:17:32,687   adding 'deepspeed-0.16.7.data/scripts/deepspeed.pt'
2025-06-02T17:17:32,688   adding 'deepspeed-0.16.7.data/scripts/ds'
2025-06-02T17:17:32,690   adding 'deepspeed-0.16.7.data/scripts/ds_bench'
2025-06-02T17:17:32,691   adding 'deepspeed-0.16.7.data/scripts/ds_elastic'
2025-06-02T17:17:32,692   adding 'deepspeed-0.16.7.data/scripts/ds_io'
2025-06-02T17:17:32,694   adding 'deepspeed-0.16.7.data/scripts/ds_nvme_tune'
2025-06-02T17:17:32,695   adding 'deepspeed-0.16.7.data/scripts/ds_report'
2025-06-02T17:17:32,696   adding 'deepspeed-0.16.7.data/scripts/ds_ssh'
2025-06-02T17:17:32,698   adding 'deepspeed-0.16.7.data/scripts/dsr'
2025-06-02T17:17:32,701   adding 'deepspeed-0.16.7.dist-info/licenses/LICENSE'
2025-06-02T17:17:32,707   adding 'deepspeed-0.16.7.dist-info/METADATA'
2025-06-02T17:17:32,708   adding 'deepspeed-0.16.7.dist-info/WHEEL'
2025-06-02T17:17:32,709   adding 'deepspeed-0.16.7.dist-info/entry_points.txt'
2025-06-02T17:17:32,710   adding 'deepspeed-0.16.7.dist-info/top_level.txt'
2025-06-02T17:17:32,728   adding 'deepspeed-0.16.7.dist-info/RECORD'
2025-06-02T17:17:32,761   removing build/bdist.linux-armv7l/wheel
2025-06-02T17:17:33,059   deepspeed build time = 13.783726215362549 secs
2025-06-02T17:17:33,188   Building wheel for deepspeed (setup.py): finished with status 'done'
2025-06-02T17:17:33,208   Created wheel for deepspeed: filename=deepspeed-0.16.7-py3-none-any.whl size=1642805 sha256=390b2019766f00b87f17ec77236c987f6852ba1ee233be5b1a2a330f50fcf246
2025-06-02T17:17:33,209   Stored in directory: /tmp/pip-ephem-wheel-cache-tqg_6_4m/wheels/42/e7/1a/2106f7197cc13e09c68f1b4f55f7e5117a985e726378968970
2025-06-02T17:17:33,255 Successfully built deepspeed
2025-06-02T17:17:33,326 Removed build tracker: '/tmp/pip-build-tracker-9xs3db0_'