2025-06-08T05:30:45,315 Created temporary directory: /tmp/pip-build-tracker-tmcythip
2025-06-08T05:30:45,316 Initialized build tracking at /tmp/pip-build-tracker-tmcythip
2025-06-08T05:30:45,317 Created build tracker: /tmp/pip-build-tracker-tmcythip
2025-06-08T05:30:45,317 Entered build tracker: /tmp/pip-build-tracker-tmcythip
2025-06-08T05:30:45,318 Created temporary directory: /tmp/pip-wheel-6wmd1smg
2025-06-08T05:30:45,322 Created temporary directory: /tmp/pip-ephem-wheel-cache-_u88x2n5
2025-06-08T05:30:45,373 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2025-06-08T05:30:45,376 2 location(s) to search for versions of deepspeed:
2025-06-08T05:30:45,376 * https://pypi.org/simple/deepspeed/
2025-06-08T05:30:45,376 * https://www.piwheels.org/simple/deepspeed/
2025-06-08T05:30:45,376 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2025-06-08T05:30:45,377 Getting page https://pypi.org/simple/deepspeed/
2025-06-08T05:30:45,379 Found index url https://pypi.org/simple/
2025-06-08T05:30:45,602 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2025-06-08T05:30:45,615   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T05:30:45,616   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2025-06-08T05:30:45,616   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T05:30:45,617   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2025-06-08T05:30:45,618   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T05:30:45,618   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2025-06-08T05:30:45,619   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T05:30:45,620   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2025-06-08T05:30:45,620   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T05:30:45,621   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2025-06-08T05:30:45,622   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2025-06-08T05:30:45,622   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2025-06-08T05:30:45,623   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2025-06-08T05:30:45,624   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2025-06-08T05:30:45,625   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2025-06-08T05:30:45,626   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2025-06-08T05:30:45,626   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2025-06-08T05:30:45,627   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2025-06-08T05:30:45,628   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2025-06-08T05:30:45,628   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2025-06-08T05:30:45,629   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2025-06-08T05:30:45,630   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2025-06-08T05:30:45,631   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2025-06-08T05:30:45,631   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2025-06-08T05:30:45,632   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2025-06-08T05:30:45,633   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2025-06-08T05:30:45,634   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2025-06-08T05:30:45,635   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2025-06-08T05:30:45,636   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2025-06-08T05:30:45,636   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2025-06-08T05:30:45,637   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2025-06-08T05:30:45,638   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2025-06-08T05:30:45,639   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2025-06-08T05:30:45,639   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2025-06-08T05:30:45,640   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2025-06-08T05:30:45,640   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2025-06-08T05:30:45,641   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2025-06-08T05:30:45,641   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2025-06-08T05:30:45,642   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2025-06-08T05:30:45,643   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2025-06-08T05:30:45,643   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2025-06-08T05:30:45,644   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2025-06-08T05:30:45,645   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2025-06-08T05:30:45,645   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2025-06-08T05:30:45,646   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2025-06-08T05:30:45,647   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2025-06-08T05:30:45,647   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2025-06-08T05:30:45,648   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2025-06-08T05:30:45,649   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2025-06-08T05:30:45,650   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2025-06-08T05:30:45,651   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2025-06-08T05:30:45,651   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2025-06-08T05:30:45,652   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2025-06-08T05:30:45,653   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2025-06-08T05:30:45,653   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2025-06-08T05:30:45,654   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2025-06-08T05:30:45,654   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2025-06-08T05:30:45,655   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2025-06-08T05:30:45,656   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2025-06-08T05:30:45,656   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2025-06-08T05:30:45,657   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2025-06-08T05:30:45,657   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2025-06-08T05:30:45,658   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2025-06-08T05:30:45,659   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2025-06-08T05:30:45,659   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2025-06-08T05:30:45,660   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2025-06-08T05:30:45,661   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2025-06-08T05:30:45,661   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2025-06-08T05:30:45,662   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2025-06-08T05:30:45,663   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2025-06-08T05:30:45,663   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2025-06-08T05:30:45,664   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2025-06-08T05:30:45,664   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2025-06-08T05:30:45,665   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2025-06-08T05:30:45,665   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2025-06-08T05:30:45,666   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2025-06-08T05:30:45,667   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2025-06-08T05:30:45,667   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2025-06-08T05:30:45,668   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2025-06-08T05:30:45,669   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2025-06-08T05:30:45,670   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2025-06-08T05:30:45,670   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2025-06-08T05:30:45,671   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2025-06-08T05:30:45,672   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2025-06-08T05:30:45,672   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2025-06-08T05:30:45,673   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2025-06-08T05:30:45,674   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2025-06-08T05:30:45,674   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2025-06-08T05:30:45,675   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2025-06-08T05:30:45,676   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2025-06-08T05:30:45,676   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2025-06-08T05:30:45,677   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2025-06-08T05:30:45,677   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2025-06-08T05:30:45,678   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2025-06-08T05:30:45,678   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2025-06-08T05:30:45,679   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2025-06-08T05:30:45,680   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T05:30:45,681   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2025-06-08T05:30:45,681   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T05:30:45,682   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2025-06-08T05:30:45,683   Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1
2025-06-08T05:30:45,683   Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2
2025-06-08T05:30:45,684   Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3
2025-06-08T05:30:45,685   Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4
2025-06-08T05:30:45,685   Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0
2025-06-08T05:30:45,686   Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1
2025-06-08T05:30:45,687   Found link https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.2
2025-06-08T05:30:45,687   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/52/23/cfe2166f06f1817b73b8695addd2fded55f4189322bcf181cfb7feaba550/deepspeed-0.16.3-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T05:30:45,687   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/ce/92/853de2a32b3f9c0945e0c9e145eddac98e570c1faebcd58aa85e6dcd89ba/deepspeed-0.16.3-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T05:30:45,688   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/55/8f/57ee424e114478a667c604b2f3f05bbc1addc0afc089b9ab6a64b233063d/deepspeed-0.16.3-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T05:30:45,688   Found link https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.3
2025-06-08T05:30:45,689   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/3d/65/1a6394f5d6dee851e9ea59e385f6d6428e3bfe36f83c06e0336e14dcfd11/deepspeed-0.16.4-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T05:30:45,690   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a3/aa/bb67b63cc25c5e29e4ca3f8b155e0faf74d5a33acf2ec67e249206a36b0f/deepspeed-0.16.4-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T05:30:45,690   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d4/59/fd251661b78b049eed7ee46f0d8d51c69ae7fbb710716a1ebcc796a6b0fd/deepspeed-0.16.4-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T05:30:45,691   Found link https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.4
2025-06-08T05:30:45,692   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/15/b0/be6cc74fd1e23da20d6c34db923858a8ae5017d39a13dedc188a935c646a/deepspeed-0.16.5-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T05:30:45,692   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/0b/78/9a87d137f83f53dd57f425ac174723c746c53029bf6cdce22eb9e805e3f0/deepspeed-0.16.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T05:30:45,693   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/80/f8/a9b1fca237fe8ea25f866956778280d0b735350f29fb6f4e0b548aa02a5f/deepspeed-0.16.5-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T05:30:45,693   Found link https://files.pythonhosted.org/packages/0d/88/96569b2acb3219c9c72068f9b952c59beffe366e7d1edd9e922e5c68f08b/deepspeed-0.16.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.5
2025-06-08T05:30:45,694   Found link https://files.pythonhosted.org/packages/cb/a3/1d758fcbcdb3f5ecf4e71907e293f17bae8a9f448b112e65c6195e90c2d3/deepspeed-0.16.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.6
2025-06-08T05:30:45,695   Found link https://files.pythonhosted.org/packages/06/b3/a3903de5c5b707170c5c27e1a40f4ef613f14d241bd84d8b151a2a8786f6/deepspeed-0.16.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.7
2025-06-08T05:30:45,695   Found link https://files.pythonhosted.org/packages/e1/27/f857569546dc97f64169df1cc35d1ec5161766c4a0ec32f2af5d39614a51/deepspeed-0.16.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.8
2025-06-08T05:30:45,696   Found link https://files.pythonhosted.org/packages/4f/5c/7542904cddfaa50a9a7ae6770349d468773359f5af1718865452cea8729d/deepspeed-0.16.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.9
2025-06-08T05:30:45,696   Found link https://files.pythonhosted.org/packages/1e/35/eef570f4da4a39d0e7f2e72757295fdba3718a8eca60d8d6dcfeb9e6f26d/deepspeed-0.17.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.0
2025-06-08T05:30:45,697   Found link https://files.pythonhosted.org/packages/38/10/a7f63e086c1e1c12e290c98363c748ef5ddd6313fde739d2aeccd5ed0cd4/deepspeed-0.17.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.1
2025-06-08T05:30:45,697   Found link https://files.pythonhosted.org/packages/8c/45/1ddcf8f8500d90fad9f3396bfb1295462d46a747ddcbfafcd7714d46827e/deepspeed-0.17.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.2
2025-06-08T05:30:45,698   Found link https://files.pythonhosted.org/packages/9e/6b/89faa30a38405cd2d7a81790b262673ca4c8e8ec97c2f8c433da04d7a002/deepspeed-0.17.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.3
2025-06-08T05:30:45,699   Found link https://files.pythonhosted.org/packages/84/b3/02d000bfd0d6f0ba3f5dac487e4151b3e9b4b3ee71336882102dc9ad79ad/deepspeed-0.17.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.4
2025-06-08T05:30:45,699 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2025-06-08T05:30:45,700 Getting page https://www.piwheels.org/simple/deepspeed/
2025-06-08T05:30:45,702 Found index url https://www.piwheels.org/simple/
2025-06-08T05:30:45,859 WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-08T05:30:46,517 WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-08T05:30:47,671 WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-08T05:30:49,870 WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-08T05:30:54,092 WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-08T05:30:54,307 Could not fetch URL https://www.piwheels.org/simple/deepspeed/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='www.piwheels.org', port=443): Max retries exceeded with url: /simple/deepspeed/ (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))) - skipping
2025-06-08T05:30:54,309 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2025-06-08T05:30:54,309 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2025-06-08T05:30:54,340 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2025-06-08T05:30:54,343 Collecting deepspeed==0.16.8
2025-06-08T05:30:54,345   Created temporary directory: /tmp/pip-unpack-41yrp_hi
2025-06-08T05:30:54,588   Downloading deepspeed-0.16.8.tar.gz (1.5 MB)
2025-06-08T05:30:57,213   Added deepspeed==0.16.8 from https://files.pythonhosted.org/packages/e1/27/f857569546dc97f64169df1cc35d1ec5161766c4a0ec32f2af5d39614a51/deepspeed-0.16.8.tar.gz to build tracker '/tmp/pip-build-tracker-tmcythip'
2025-06-08T05:30:57,215   Running setup.py (path:/tmp/pip-wheel-6wmd1smg/deepspeed_5555c1117b694f5abaf4a446604f1aa6/setup.py) egg_info for package deepspeed
2025-06-08T05:30:57,216   Created temporary directory: /tmp/pip-pip-egg-info-hrk7np9o
2025-06-08T05:30:57,216   Preparing metadata (setup.py): started
2025-06-08T05:30:57,217   Running command python setup.py egg_info
2025-06-08T05:30:58,288   fatal: not a git repository (or any of the parent directories): .git
2025-06-08T05:30:58,759   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-06-08T05:30:58,760    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-06-08T05:30:58,760   DS_BUILD_OPS=0
2025-06-08T05:30:58,761   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-06-08T05:30:58,761   version=0.16.8, git_hash=unknown, git_branch=unknown
2025-06-08T05:30:58,762   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-06-08T05:30:58,763   ext_modules=[]
2025-06-08T05:30:58,763   running egg_info
2025-06-08T05:30:58,787   creating /tmp/pip-pip-egg-info-hrk7np9o/deepspeed.egg-info
2025-06-08T05:30:58,788   writing /tmp/pip-pip-egg-info-hrk7np9o/deepspeed.egg-info/PKG-INFO
2025-06-08T05:30:58,823   writing dependency_links to /tmp/pip-pip-egg-info-hrk7np9o/deepspeed.egg-info/dependency_links.txt
2025-06-08T05:30:58,825   writing entry points to /tmp/pip-pip-egg-info-hrk7np9o/deepspeed.egg-info/entry_points.txt
2025-06-08T05:30:58,843   writing requirements to /tmp/pip-pip-egg-info-hrk7np9o/deepspeed.egg-info/requires.txt
2025-06-08T05:30:58,845   writing top-level names to /tmp/pip-pip-egg-info-hrk7np9o/deepspeed.egg-info/top_level.txt
2025-06-08T05:30:58,846   writing manifest file '/tmp/pip-pip-egg-info-hrk7np9o/deepspeed.egg-info/SOURCES.txt'
2025-06-08T05:30:59,092   reading manifest file '/tmp/pip-pip-egg-info-hrk7np9o/deepspeed.egg-info/SOURCES.txt'
2025-06-08T05:30:59,094   reading manifest template 'MANIFEST.in'
2025-06-08T05:30:59,096   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-06-08T05:30:59,096   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-06-08T05:31:00,943   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-06-08T05:31:02,179   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-06-08T05:31:03,112   warning: no files found matching '*.tr' under directory 'csrc'
2025-06-08T05:31:03,295   warning: no files found matching '*.cc' under directory 'csrc'
2025-06-08T05:31:03,368   warning: no files found matching '*.py' under directory 'benchmarks'
2025-06-08T05:31:03,377   adding license file 'LICENSE'
2025-06-08T05:31:03,435   writing manifest file '/tmp/pip-pip-egg-info-hrk7np9o/deepspeed.egg-info/SOURCES.txt'
2025-06-08T05:31:03,438   deepspeed build time = 5.146130323410034 secs
2025-06-08T05:31:03,562   Preparing metadata (setup.py): finished with status 'done'
2025-06-08T05:31:03,568   Source in /tmp/pip-wheel-6wmd1smg/deepspeed_5555c1117b694f5abaf4a446604f1aa6 has version 0.16.8, which satisfies requirement deepspeed==0.16.8 from https://files.pythonhosted.org/packages/e1/27/f857569546dc97f64169df1cc35d1ec5161766c4a0ec32f2af5d39614a51/deepspeed-0.16.8.tar.gz
2025-06-08T05:31:03,569   Removed deepspeed==0.16.8 from https://files.pythonhosted.org/packages/e1/27/f857569546dc97f64169df1cc35d1ec5161766c4a0ec32f2af5d39614a51/deepspeed-0.16.8.tar.gz from build tracker '/tmp/pip-build-tracker-tmcythip'
2025-06-08T05:31:03,642 Created temporary directory: /tmp/pip-unpack-6y_hmvzo
2025-06-08T05:31:03,643 Created temporary directory: /tmp/pip-unpack-81vcya_u
2025-06-08T05:31:03,644 Building wheels for collected packages: deepspeed
2025-06-08T05:31:03,648   Created temporary directory: /tmp/pip-wheel-fjxcrjjz
2025-06-08T05:31:03,649   DEPRECATION: Building 'deepspeed' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'deepspeed'. Discussion can be found at https://github.com/pypa/pip/issues/6334
2025-06-08T05:31:03,650   Building wheel for deepspeed (setup.py): started
2025-06-08T05:31:03,651   Destination directory: /tmp/pip-wheel-fjxcrjjz
2025-06-08T05:31:03,651   Running command python setup.py bdist_wheel
2025-06-08T05:31:04,134   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-06-08T05:31:04,138    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-06-08T05:31:04,265   DS_BUILD_OPS=0
2025-06-08T05:31:04,380   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-06-08T05:31:04,400   fatal: not a git repository (or any of the parent directories): .git
2025-06-08T05:31:04,402   version=0.16.8, git_hash=unknown, git_branch=unknown
2025-06-08T05:31:04,403   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-06-08T05:31:04,404   ext_modules=[]
2025-06-08T05:31:04,787   running bdist_wheel
2025-06-08T05:31:04,918   running build
2025-06-08T05:31:04,919   running build_py
2025-06-08T05:31:04,948   creating build/lib/deepspeed
2025-06-08T05:31:04,950   copying deepspeed/constants.py -> build/lib/deepspeed
2025-06-08T05:31:04,953   copying deepspeed/env_report.py -> build/lib/deepspeed
2025-06-08T05:31:04,955   copying deepspeed/__init__.py -> build/lib/deepspeed
2025-06-08T05:31:04,958   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2025-06-08T05:31:04,959   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2025-06-08T05:31:04,962   creating build/lib/deepspeed/ops
2025-06-08T05:31:04,963   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2025-06-08T05:31:04,966   creating build/lib/deepspeed/nvme
2025-06-08T05:31:04,967   copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme
2025-06-08T05:31:04,969   copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme
2025-06-08T05:31:04,971   copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme
2025-06-08T05:31:04,972   copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme
2025-06-08T05:31:04,975   copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme
2025-06-08T05:31:04,977   copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme
2025-06-08T05:31:04,979   copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme
2025-06-08T05:31:04,981   copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme
2025-06-08T05:31:04,984   copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme
2025-06-08T05:31:04,986   copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme
2025-06-08T05:31:04,987   copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme
2025-06-08T05:31:04,990   copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme
2025-06-08T05:31:04,992   creating build/lib/deepspeed/pipe
2025-06-08T05:31:04,993   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2025-06-08T05:31:04,995   creating build/lib/deepspeed/moe
2025-06-08T05:31:04,996   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2025-06-08T05:31:04,998   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2025-06-08T05:31:05,000   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2025-06-08T05:31:05,002   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2025-06-08T05:31:05,004   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2025-06-08T05:31:05,006   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2025-06-08T05:31:05,009   creating build/lib/deepspeed/checkpoint
2025-06-08T05:31:05,010   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2025-06-08T05:31:05,012   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2025-06-08T05:31:05,014   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-08T05:31:05,016   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2025-06-08T05:31:05,019   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2025-06-08T05:31:05,021   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2025-06-08T05:31:05,023   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2025-06-08T05:31:05,025   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2025-06-08T05:31:05,027   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-08T05:31:05,029   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-08T05:31:05,032   creating build/lib/deepspeed/monitor
2025-06-08T05:31:05,033   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2025-06-08T05:31:05,036   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2025-06-08T05:31:05,037   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2025-06-08T05:31:05,039   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2025-06-08T05:31:05,041   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2025-06-08T05:31:05,043   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2025-06-08T05:31:05,045   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2025-06-08T05:31:05,047   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2025-06-08T05:31:05,049   creating build/lib/deepspeed/model_implementations
2025-06-08T05:31:05,050   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2025-06-08T05:31:05,053   creating build/lib/deepspeed/nebula
2025-06-08T05:31:05,054   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2025-06-08T05:31:05,056   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2025-06-08T05:31:05,058   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2025-06-08T05:31:05,060   creating build/lib/deepspeed/compression
2025-06-08T05:31:05,061   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2025-06-08T05:31:05,064   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2025-06-08T05:31:05,067   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2025-06-08T05:31:05,069   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2025-06-08T05:31:05,072   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2025-06-08T05:31:05,073   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2025-06-08T05:31:05,076   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2025-06-08T05:31:05,079   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2025-06-08T05:31:05,082   creating build/lib/deepspeed/comm
2025-06-08T05:31:05,083   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2025-06-08T05:31:05,085   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2025-06-08T05:31:05,088   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2025-06-08T05:31:05,089   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2025-06-08T05:31:05,091   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2025-06-08T05:31:05,093   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2025-06-08T05:31:05,095   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2025-06-08T05:31:05,097   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2025-06-08T05:31:05,099   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2025-06-08T05:31:05,102   creating build/lib/deepspeed/launcher
2025-06-08T05:31:05,103   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2025-06-08T05:31:05,105   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2025-06-08T05:31:05,108   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2025-06-08T05:31:05,111   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2025-06-08T05:31:05,113   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2025-06-08T05:31:05,115   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2025-06-08T05:31:05,118   creating build/lib/deepspeed/utils
2025-06-08T05:31:05,119   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,121   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,123   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,126   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,128   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,131   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,133   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,135   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,137   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,139   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,141   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,143   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,145   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,147   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,149   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,152   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,154   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,156   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2025-06-08T05:31:05,159   creating build/lib/deepspeed/module_inject
2025-06-08T05:31:05,160   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2025-06-08T05:31:05,163   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2025-06-08T05:31:05,165   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2025-06-08T05:31:05,167   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2025-06-08T05:31:05,170   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2025-06-08T05:31:05,172   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2025-06-08T05:31:05,173   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2025-06-08T05:31:05,176   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2025-06-08T05:31:05,178   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2025-06-08T05:31:05,180   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2025-06-08T05:31:05,182   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2025-06-08T05:31:05,184   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2025-06-08T05:31:05,186   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2025-06-08T05:31:05,189   creating build/lib/deepspeed/accelerator
2025-06-08T05:31:05,190   copying deepspeed/accelerator/sdaa_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T05:31:05,193   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T05:31:05,196   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2025-06-08T05:31:05,198   copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T05:31:05,200   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T05:31:05,203   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T05:31:05,205   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T05:31:05,208   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T05:31:05,210   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T05:31:05,213   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T05:31:05,216   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T05:31:05,219   creating build/lib/deepspeed/sequence
2025-06-08T05:31:05,221   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2025-06-08T05:31:05,224   copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence
2025-06-08T05:31:05,228   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2025-06-08T05:31:05,230   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2025-06-08T05:31:05,233   creating build/lib/deepspeed/elasticity
2025-06-08T05:31:05,234   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2025-06-08T05:31:05,237   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2025-06-08T05:31:05,239   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2025-06-08T05:31:05,242   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2025-06-08T05:31:05,245   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2025-06-08T05:31:05,247   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2025-06-08T05:31:05,250   creating build/lib/deepspeed/inference
2025-06-08T05:31:05,251   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2025-06-08T05:31:05,254   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2025-06-08T05:31:05,257   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2025-06-08T05:31:05,260   creating build/lib/deepspeed/profiling
2025-06-08T05:31:05,261   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2025-06-08T05:31:05,264   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2025-06-08T05:31:05,266   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2025-06-08T05:31:05,269   creating build/lib/deepspeed/linear
2025-06-08T05:31:05,271   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2025-06-08T05:31:05,273   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2025-06-08T05:31:05,276   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2025-06-08T05:31:05,278   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2025-06-08T05:31:05,280   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2025-06-08T05:31:05,284   creating build/lib/deepspeed/compile
2025-06-08T05:31:05,285   copying deepspeed/compile/config.py -> build/lib/deepspeed/compile
2025-06-08T05:31:05,288   copying deepspeed/compile/patch_compiled_func.py -> build/lib/deepspeed/compile
2025-06-08T05:31:05,290   copying deepspeed/compile/init_z3.py -> build/lib/deepspeed/compile
2025-06-08T05:31:05,293   copying deepspeed/compile/fx.py -> build/lib/deepspeed/compile
2025-06-08T05:31:05,295   copying deepspeed/compile/graph_param.py -> build/lib/deepspeed/compile
2025-06-08T05:31:05,297   copying deepspeed/compile/backend.py -> build/lib/deepspeed/compile
2025-06-08T05:31:05,300   copying deepspeed/compile/__init__.py -> build/lib/deepspeed/compile
2025-06-08T05:31:05,302   copying deepspeed/compile/patch_fake_tensor.py -> build/lib/deepspeed/compile
2025-06-08T05:31:05,304   copying deepspeed/compile/inductor.py -> build/lib/deepspeed/compile
2025-06-08T05:31:05,307   copying deepspeed/compile/list_schedule.py -> build/lib/deepspeed/compile
2025-06-08T05:31:05,310   copying deepspeed/compile/partitioner.py -> build/lib/deepspeed/compile
2025-06-08T05:31:05,313   copying deepspeed/compile/util.py -> build/lib/deepspeed/compile
2025-06-08T05:31:05,316   copying deepspeed/compile/init_z1.py -> build/lib/deepspeed/compile
2025-06-08T05:31:05,319   creating build/lib/deepspeed/runtime
2025-06-08T05:31:05,320   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,323   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,327   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,330   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,333   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,336   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,339   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,342   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,344   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,347   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,349   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,352   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,354   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,361   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,363   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,367   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,370   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,373   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2025-06-08T05:31:05,376   creating build/lib/deepspeed/autotuning
2025-06-08T05:31:05,377   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2025-06-08T05:31:05,380   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2025-06-08T05:31:05,383   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2025-06-08T05:31:05,385   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2025-06-08T05:31:05,387   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2025-06-08T05:31:05,391   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2025-06-08T05:31:05,394   creating build/lib/deepspeed/ops/lamb
2025-06-08T05:31:05,395   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2025-06-08T05:31:05,398   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2025-06-08T05:31:05,401   creating build/lib/deepspeed/ops/sparse_attention
2025-06-08T05:31:05,403   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-08T05:31:05,405   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-08T05:31:05,408   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-08T05:31:05,410   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-08T05:31:05,413   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-08T05:31:05,416   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-08T05:31:05,420   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-08T05:31:05,423   creating build/lib/deepspeed/ops/gds
2025-06-08T05:31:05,425   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2025-06-08T05:31:05,428   creating build/lib/deepspeed/ops/aio
2025-06-08T05:31:05,429   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2025-06-08T05:31:05,432   creating build/lib/deepspeed/ops/deepspeed4science
2025-06-08T05:31:05,433   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2025-06-08T05:31:05,435   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2025-06-08T05:31:05,439   creating build/lib/deepspeed/ops/fp_quantizer
2025-06-08T05:31:05,440   copying deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-08T05:31:05,443   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-08T05:31:05,445   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-08T05:31:05,448   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-08T05:31:05,451   creating build/lib/deepspeed/ops/adam
2025-06-08T05:31:05,452   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2025-06-08T05:31:05,455   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2025-06-08T05:31:05,458   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2025-06-08T05:31:05,460   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2025-06-08T05:31:05,464   creating build/lib/deepspeed/ops/random_ltd
2025-06-08T05:31:05,465   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2025-06-08T05:31:05,467   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2025-06-08T05:31:05,471   creating build/lib/deepspeed/ops/lion
2025-06-08T05:31:05,472   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2025-06-08T05:31:05,475   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2025-06-08T05:31:05,477   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2025-06-08T05:31:05,480   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2025-06-08T05:31:05,483   creating build/lib/deepspeed/ops/adagrad
2025-06-08T05:31:05,484   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2025-06-08T05:31:05,487   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2025-06-08T05:31:05,490   creating build/lib/deepspeed/ops/transformer
2025-06-08T05:31:05,491   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2025-06-08T05:31:05,495   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2025-06-08T05:31:05,497   creating build/lib/deepspeed/ops/compile
2025-06-08T05:31:05,499   copying deepspeed/ops/compile/__init__.py -> build/lib/deepspeed/ops/compile
2025-06-08T05:31:05,502   creating build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,504   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,506   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,509   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,512   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,514   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,516   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,519   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,521   copying deepspeed/ops/op_builder/dc.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,523   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,526   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,528   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,531   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,533   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,535   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,537   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,539   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,541   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,543   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,545   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,547   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,549   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,552   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,555   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,557   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,559   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T05:31:05,561   creating build/lib/deepspeed/ops/quantizer
2025-06-08T05:31:05,562   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2025-06-08T05:31:05,565   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2025-06-08T05:31:05,567   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-08T05:31:05,568   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-08T05:31:05,571   creating build/lib/deepspeed/ops/transformer/inference
2025-06-08T05:31:05,572   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T05:31:05,575   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T05:31:05,577   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T05:31:05,580   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T05:31:05,582   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T05:31:05,584   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T05:31:05,585   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T05:31:05,588   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T05:31:05,590   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T05:31:05,593   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T05:31:05,596   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,597   copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,600   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,603   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,605   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,608   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,610   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,613   copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,615   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,618   copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,621   copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,623   copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,626   copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,628   copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,631   copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,634   copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,637   copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,640   copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,642   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,645   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,647   copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,649   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,652   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,655   copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:05,658   creating build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:05,660   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:05,663   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:05,666   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:05,668   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:05,671   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:05,674   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:05,677   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:05,680   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:05,683   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:05,685   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:05,689   creating build/lib/deepspeed/ops/op_builder/cpu
2025-06-08T05:31:05,690   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-08T05:31:05,693   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-08T05:31:05,695   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-08T05:31:05,698   copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-08T05:31:05,700   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-08T05:31:05,702   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-08T05:31:05,704   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-08T05:31:05,706   creating build/lib/deepspeed/ops/op_builder/sdaa
2025-06-08T05:31:05,707   copying deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-08T05:31:05,710   copying deepspeed/ops/op_builder/sdaa/__init__.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-08T05:31:05,712   copying deepspeed/ops/op_builder/sdaa/no_impl.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-08T05:31:05,714   copying deepspeed/ops/op_builder/sdaa/builder.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-08T05:31:05,716   copying deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-08T05:31:05,719   creating build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T05:31:05,721   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T05:31:05,723   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T05:31:05,724   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T05:31:05,726   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T05:31:05,728   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T05:31:05,730   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T05:31:05,732   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T05:31:05,734   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T05:31:05,737   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T05:31:05,739   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T05:31:05,741   creating build/lib/deepspeed/ops/op_builder/npu
2025-06-08T05:31:05,742   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T05:31:05,745   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T05:31:05,747   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T05:31:05,749   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T05:31:05,751   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T05:31:05,753   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T05:31:05,755   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T05:31:05,757   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T05:31:05,759   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T05:31:05,762   creating build/lib/deepspeed/ops/op_builder/hpu
2025-06-08T05:31:05,763   copying deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-08T05:31:05,765   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-08T05:31:05,767   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-08T05:31:05,769   copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-08T05:31:05,772   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-08T05:31:05,774   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-08T05:31:05,776   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-08T05:31:05,779   creating build/lib/deepspeed/ops/op_builder/mlu
2025-06-08T05:31:05,780   copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-08T05:31:05,782   copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-08T05:31:05,785   copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-08T05:31:05,787   copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-08T05:31:05,789   copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-08T05:31:05,791   copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-08T05:31:05,793   creating build/lib/deepspeed/model_implementations/transformers
2025-06-08T05:31:05,795   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T05:31:05,797   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T05:31:05,799   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T05:31:05,801   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T05:31:05,804   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T05:31:05,806   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T05:31:05,808   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T05:31:05,810   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T05:31:05,813   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T05:31:05,815   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T05:31:05,818   creating build/lib/deepspeed/model_implementations/diffusers
2025-06-08T05:31:05,819   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-08T05:31:05,821   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-08T05:31:05,824   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-08T05:31:05,827   creating build/lib/deepspeed/model_implementations/features
2025-06-08T05:31:05,829   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2025-06-08T05:31:05,831   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2025-06-08T05:31:05,834   creating build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,835   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,838   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,841   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,843   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,845   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,848   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,850   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,853   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,855   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,858   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,861   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,863   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,866   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,868   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,870   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,873   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,876   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,878   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,880   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T05:31:05,883   creating build/lib/deepspeed/module_inject/containers/features
2025-06-08T05:31:05,884   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-08T05:31:05,887   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-08T05:31:05,890   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-08T05:31:05,892   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-08T05:31:05,894   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-08T05:31:05,896   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-08T05:31:05,898   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-08T05:31:05,902   creating build/lib/deepspeed/inference/v2
2025-06-08T05:31:05,903   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2025-06-08T05:31:05,905   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2025-06-08T05:31:05,907   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2025-06-08T05:31:05,909   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2025-06-08T05:31:05,911   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2025-06-08T05:31:05,913   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2025-06-08T05:31:05,915   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2025-06-08T05:31:05,918   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2025-06-08T05:31:05,921   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2025-06-08T05:31:05,923   creating build/lib/deepspeed/inference/quantization
2025-06-08T05:31:05,924   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2025-06-08T05:31:05,926   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2025-06-08T05:31:05,929   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2025-06-08T05:31:05,932   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2025-06-08T05:31:05,934   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2025-06-08T05:31:05,936   creating build/lib/deepspeed/inference/v2/kernels
2025-06-08T05:31:05,938   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2025-06-08T05:31:05,940   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2025-06-08T05:31:05,943   creating build/lib/deepspeed/inference/v2/checkpoint
2025-06-08T05:31:05,944   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-08T05:31:05,946   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-08T05:31:05,948   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-08T05:31:05,951   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-08T05:31:05,954   creating build/lib/deepspeed/inference/v2/model_implementations
2025-06-08T05:31:05,956   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-08T05:31:05,959   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-08T05:31:05,962   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-08T05:31:05,965   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-08T05:31:05,968   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-08T05:31:05,971   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-08T05:31:05,975   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-08T05:31:05,978   creating build/lib/deepspeed/inference/v2/modules
2025-06-08T05:31:05,980   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2025-06-08T05:31:05,983   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2025-06-08T05:31:05,985   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2025-06-08T05:31:05,987   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2025-06-08T05:31:05,991   creating build/lib/deepspeed/inference/v2/ragged
2025-06-08T05:31:05,992   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-08T05:31:05,995   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-08T05:31:05,998   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-08T05:31:06,000   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-08T05:31:06,003   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-08T05:31:06,006   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-08T05:31:06,009   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-08T05:31:06,011   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-08T05:31:06,013   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-08T05:31:06,016   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-08T05:31:06,017   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-08T05:31:06,020   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-08T05:31:06,021   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-08T05:31:06,024   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T05:31:06,026   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T05:31:06,028   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T05:31:06,031   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T05:31:06,033   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T05:31:06,035   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T05:31:06,038   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T05:31:06,041   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T05:31:06,042   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T05:31:06,044   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T05:31:06,047   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T05:31:06,049   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T05:31:06,051   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T05:31:06,054   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T05:31:06,056   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T05:31:06,059   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T05:31:06,060   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T05:31:06,063   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T05:31:06,065   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T05:31:06,067   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T05:31:06,069   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T05:31:06,072   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:06,074   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:06,076   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:06,078   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:06,080   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:06,082   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:06,085   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T05:31:06,086   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T05:31:06,089   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T05:31:06,092   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T05:31:06,093   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T05:31:06,095   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T05:31:06,098   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T05:31:06,099   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T05:31:06,102   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T05:31:06,104   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T05:31:06,105   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T05:31:06,108   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T05:31:06,111   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T05:31:06,112   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T05:31:06,114   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T05:31:06,117   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T05:31:06,118   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T05:31:06,121   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T05:31:06,124   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:06,125   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:06,127   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:06,130   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:06,132   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:06,135   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T05:31:06,136   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T05:31:06,139   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T05:31:06,142   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T05:31:06,143   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T05:31:06,146   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T05:31:06,148   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T05:31:06,150   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T05:31:06,152   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T05:31:06,154   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T05:31:06,157   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T05:31:06,160   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T05:31:06,161   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T05:31:06,164   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T05:31:06,166   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T05:31:06,168   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T05:31:06,172   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:06,173   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:06,176   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:06,179   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:06,181   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:06,184   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:06,186   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:06,188   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:06,190   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:06,192   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:06,195   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T05:31:06,196   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T05:31:06,198   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T05:31:06,200   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T05:31:06,202   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T05:31:06,205   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-08T05:31:06,206   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-08T05:31:06,208   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-08T05:31:06,210   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-08T05:31:06,212   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-08T05:31:06,215   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-08T05:31:06,216   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-08T05:31:06,218   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-08T05:31:06,219   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-08T05:31:06,221   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-08T05:31:06,224   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:06,225   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:06,227   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:06,229   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:06,231   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:06,233   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:06,235   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:06,237   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:06,240   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:06,242   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:06,244   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-08T05:31:06,245   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-08T05:31:06,247   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-08T05:31:06,249   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-08T05:31:06,251   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-08T05:31:06,254   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-08T05:31:06,256   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-08T05:31:06,258   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-08T05:31:06,260   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-08T05:31:06,262   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-08T05:31:06,265   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-08T05:31:06,266   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-08T05:31:06,268   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-08T05:31:06,270   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-08T05:31:06,272   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-08T05:31:06,275   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-08T05:31:06,276   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-08T05:31:06,278   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-08T05:31:06,280   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-08T05:31:06,283   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-08T05:31:06,286   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T05:31:06,287   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T05:31:06,289   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T05:31:06,291   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T05:31:06,294   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T05:31:06,297   creating build/lib/deepspeed/inference/v2/modules/configs
2025-06-08T05:31:06,298   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-08T05:31:06,300   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-08T05:31:06,302   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-08T05:31:06,304   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-08T05:31:06,306   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-08T05:31:06,308   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-08T05:31:06,311   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-08T05:31:06,313   creating build/lib/deepspeed/inference/v2/modules/implementations
2025-06-08T05:31:06,314   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2025-06-08T05:31:06,317   creating build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:06,318   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:06,320   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:06,322   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:06,324   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:06,326   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:06,328   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:06,331   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:06,333   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:06,335   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-08T05:31:06,336   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-08T05:31:06,339   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-08T05:31:06,342   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-08T05:31:06,343   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-08T05:31:06,345   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-08T05:31:06,348   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-08T05:31:06,349   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-08T05:31:06,351   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-08T05:31:06,354   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-08T05:31:06,355   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-08T05:31:06,358   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-08T05:31:06,360   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-08T05:31:06,363   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-08T05:31:06,364   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-08T05:31:06,366   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-08T05:31:06,369   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-08T05:31:06,370   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-08T05:31:06,372   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-08T05:31:06,374   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-08T05:31:06,377   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-08T05:31:06,378   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-08T05:31:06,381   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-08T05:31:06,383   creating build/lib/deepspeed/profiling/flops_profiler
2025-06-08T05:31:06,384   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2025-06-08T05:31:06,387   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2025-06-08T05:31:06,390   creating build/lib/deepspeed/compile/profilers
2025-06-08T05:31:06,391   copying deepspeed/compile/profilers/comm_profile.py -> build/lib/deepspeed/compile/profilers
2025-06-08T05:31:06,394   copying deepspeed/compile/profilers/graph_profile.py -> build/lib/deepspeed/compile/profilers
2025-06-08T05:31:06,397   copying deepspeed/compile/profilers/__init__.py -> build/lib/deepspeed/compile/profilers
2025-06-08T05:31:06,399   creating build/lib/deepspeed/compile/passes
2025-06-08T05:31:06,400   copying deepspeed/compile/passes/__init__.py -> build/lib/deepspeed/compile/passes
2025-06-08T05:31:06,402   copying deepspeed/compile/passes/zero3_compile.py -> build/lib/deepspeed/compile/passes
2025-06-08T05:31:06,405   copying deepspeed/compile/passes/prefetch.py -> build/lib/deepspeed/compile/passes
2025-06-08T05:31:06,408   copying deepspeed/compile/passes/offload_adam_states.py -> build/lib/deepspeed/compile/passes
2025-06-08T05:31:06,412   copying deepspeed/compile/passes/offload_activation.py -> build/lib/deepspeed/compile/passes
2025-06-08T05:31:06,414   copying deepspeed/compile/passes/offload_parameters.py -> build/lib/deepspeed/compile/passes
2025-06-08T05:31:06,417   copying deepspeed/compile/passes/zero1_compile.py -> build/lib/deepspeed/compile/passes
2025-06-08T05:31:06,419   copying deepspeed/compile/passes/selective_gather.py -> build/lib/deepspeed/compile/passes
2025-06-08T05:31:06,423   creating build/lib/deepspeed/runtime/pipe
2025-06-08T05:31:06,424   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2025-06-08T05:31:06,427   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2025-06-08T05:31:06,430   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2025-06-08T05:31:06,434   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2025-06-08T05:31:06,437   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2025-06-08T05:31:06,441   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2025-06-08T05:31:06,445   creating build/lib/deepspeed/runtime/data_pipeline
2025-06-08T05:31:06,446   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-08T05:31:06,449   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-08T05:31:06,452   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-08T05:31:06,455   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-08T05:31:06,458   creating build/lib/deepspeed/runtime/checkpoint_engine
2025-06-08T05:31:06,460   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-08T05:31:06,463   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-08T05:31:06,465   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-08T05:31:06,468   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-08T05:31:06,471   creating build/lib/deepspeed/runtime/domino
2025-06-08T05:31:06,473   copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino
2025-06-08T05:31:06,476   copying deepspeed/runtime/domino/async_linear.py -> build/lib/deepspeed/runtime/domino
2025-06-08T05:31:06,479   copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino
2025-06-08T05:31:06,482   creating build/lib/deepspeed/runtime/compression
2025-06-08T05:31:06,483   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2025-06-08T05:31:06,486   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2025-06-08T05:31:06,488   creating build/lib/deepspeed/runtime/comm
2025-06-08T05:31:06,490   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2025-06-08T05:31:06,493   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2025-06-08T05:31:06,495   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2025-06-08T05:31:06,498   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2025-06-08T05:31:06,501   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2025-06-08T05:31:06,504   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2025-06-08T05:31:06,507   creating build/lib/deepspeed/runtime/swap_tensor
2025-06-08T05:31:06,508   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T05:31:06,511   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T05:31:06,514   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T05:31:06,516   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T05:31:06,518   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T05:31:06,521   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T05:31:06,524   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T05:31:06,526   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T05:31:06,528   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T05:31:06,531   creating build/lib/deepspeed/runtime/tensor_parallel
2025-06-08T05:31:06,533   copying deepspeed/runtime/tensor_parallel/config.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-08T05:31:06,535   copying deepspeed/runtime/tensor_parallel/tp_manager.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-08T05:31:06,537   copying deepspeed/runtime/tensor_parallel/__init__.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-08T05:31:06,539   creating build/lib/deepspeed/runtime/activation_checkpointing
2025-06-08T05:31:06,541   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-08T05:31:06,543   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-08T05:31:06,545   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-08T05:31:06,548   creating build/lib/deepspeed/runtime/fp16
2025-06-08T05:31:06,550   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-06-08T05:31:06,552   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2025-06-08T05:31:06,554   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-06-08T05:31:06,557   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2025-06-08T05:31:06,560   creating build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,561   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,565   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,568   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,570   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,573   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,575   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,577   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,579   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,582   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,586   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,588   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,592   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,595   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,598   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,600   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,602   copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,604   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2025-06-08T05:31:06,607   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-08T05:31:06,608   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-08T05:31:06,611   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-08T05:31:06,613   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-08T05:31:06,615   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-08T05:31:06,617   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-08T05:31:06,620   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T05:31:06,621   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T05:31:06,624   copying deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T05:31:06,626   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T05:31:06,628   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T05:31:06,631   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T05:31:06,634   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T05:31:06,637   creating build/lib/deepspeed/runtime/fp16/onebit
2025-06-08T05:31:06,638   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-08T05:31:06,640   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-08T05:31:06,643   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-08T05:31:06,645   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-08T05:31:06,649   creating build/lib/deepspeed/autotuning/tuner
2025-06-08T05:31:06,650   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-08T05:31:06,652   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2025-06-08T05:31:06,654   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-08T05:31:06,656   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2025-06-08T05:31:06,658   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-08T05:31:06,660   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2025-06-08T05:31:06,663   running egg_info
2025-06-08T05:31:06,689   writing deepspeed.egg-info/PKG-INFO
2025-06-08T05:31:06,723   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2025-06-08T05:31:06,725   writing entry points to deepspeed.egg-info/entry_points.txt
2025-06-08T05:31:06,743   writing requirements to deepspeed.egg-info/requires.txt
2025-06-08T05:31:06,744   writing top-level names to deepspeed.egg-info/top_level.txt
2025-06-08T05:31:06,884   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-06-08T05:31:06,977   reading manifest template 'MANIFEST.in'
2025-06-08T05:31:06,978   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-06-08T05:31:06,979   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-06-08T05:31:08,690   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-06-08T05:31:09,716   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-06-08T05:31:10,381   warning: no files found matching '*.tr' under directory 'csrc'
2025-06-08T05:31:10,512   warning: no files found matching '*.cc' under directory 'csrc'
2025-06-08T05:31:10,562   warning: no files found matching '*.py' under directory 'benchmarks'
2025-06-08T05:31:10,569   adding license file 'LICENSE'
2025-06-08T05:31:10,620   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-06-08T05:31:10,629   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2025-06-08T05:31:10,629   !!

2025-06-08T05:31:10,630           ********************************************************************************
2025-06-08T05:31:10,631           ############################
2025-06-08T05:31:10,631           # Package would be ignored #
2025-06-08T05:31:10,632           ############################
2025-06-08T05:31:10,633           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2025-06-08T05:31:10,633           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,634           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,635           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2025-06-08T05:31:10,636           to the `packages` configuration field.

2025-06-08T05:31:10,637           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,637           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,638           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,639           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,640           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,641           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2025-06-08T05:31:10,642           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2025-06-08T05:31:10,642           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,642           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,643           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,644           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,645           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,646           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,646                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,647                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,647                 directory, all directories are treated like packages.
2025-06-08T05:31:10,648           ********************************************************************************

2025-06-08T05:31:10,649   !!
2025-06-08T05:31:10,649     check.warn(importable)
2025-06-08T05:31:10,650   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2025-06-08T05:31:10,650   !!

2025-06-08T05:31:10,652           ********************************************************************************
2025-06-08T05:31:10,652           ############################
2025-06-08T05:31:10,653           # Package would be ignored #
2025-06-08T05:31:10,653           ############################
2025-06-08T05:31:10,654           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2025-06-08T05:31:10,654           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,656           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,656           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2025-06-08T05:31:10,657           to the `packages` configuration field.

2025-06-08T05:31:10,658           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,658           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,659           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,660           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,660           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,661           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2025-06-08T05:31:10,662           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2025-06-08T05:31:10,662           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,663           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,663           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,664           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,665           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,667           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,668                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,668                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,668                 directory, all directories are treated like packages.
2025-06-08T05:31:10,669           ********************************************************************************

2025-06-08T05:31:10,669   !!
2025-06-08T05:31:10,670     check.warn(importable)
2025-06-08T05:31:10,670   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2025-06-08T05:31:10,670   !!

2025-06-08T05:31:10,671           ********************************************************************************
2025-06-08T05:31:10,671           ############################
2025-06-08T05:31:10,672           # Package would be ignored #
2025-06-08T05:31:10,672           ############################
2025-06-08T05:31:10,672           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2025-06-08T05:31:10,673           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,673           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,674           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2025-06-08T05:31:10,674           to the `packages` configuration field.

2025-06-08T05:31:10,675           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,675           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,676           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,677           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,678           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,679           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2025-06-08T05:31:10,679           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2025-06-08T05:31:10,680           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,680           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,681           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,682           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,683           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,684           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,685                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,685                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,686                 directory, all directories are treated like packages.
2025-06-08T05:31:10,686           ********************************************************************************

2025-06-08T05:31:10,687   !!
2025-06-08T05:31:10,687     check.warn(importable)
2025-06-08T05:31:10,688   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2025-06-08T05:31:10,688   !!

2025-06-08T05:31:10,690           ********************************************************************************
2025-06-08T05:31:10,690           ############################
2025-06-08T05:31:10,691           # Package would be ignored #
2025-06-08T05:31:10,691           ############################
2025-06-08T05:31:10,692           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2025-06-08T05:31:10,693           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,693           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,694           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2025-06-08T05:31:10,694           to the `packages` configuration field.

2025-06-08T05:31:10,695           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,695           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,695           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,696           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,697           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,697           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2025-06-08T05:31:10,698           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2025-06-08T05:31:10,698           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,698           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,699           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,700           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,700           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,702           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,702                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,703                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,703                 directory, all directories are treated like packages.
2025-06-08T05:31:10,704           ********************************************************************************

2025-06-08T05:31:10,705   !!
2025-06-08T05:31:10,705     check.warn(importable)
2025-06-08T05:31:10,706   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2025-06-08T05:31:10,706   !!

2025-06-08T05:31:10,708           ********************************************************************************
2025-06-08T05:31:10,708           ############################
2025-06-08T05:31:10,709           # Package would be ignored #
2025-06-08T05:31:10,709           ############################
2025-06-08T05:31:10,710           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2025-06-08T05:31:10,710           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,711           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,712           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2025-06-08T05:31:10,712           to the `packages` configuration field.

2025-06-08T05:31:10,713           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,714           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,714           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,715           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,716           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,717           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2025-06-08T05:31:10,718           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2025-06-08T05:31:10,719           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,719           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,722           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,722           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,723           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,724           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,724                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,725                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,725                 directory, all directories are treated like packages.
2025-06-08T05:31:10,726           ********************************************************************************

2025-06-08T05:31:10,726   !!
2025-06-08T05:31:10,727     check.warn(importable)
2025-06-08T05:31:10,727   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2025-06-08T05:31:10,727   !!

2025-06-08T05:31:10,728           ********************************************************************************
2025-06-08T05:31:10,729           ############################
2025-06-08T05:31:10,729           # Package would be ignored #
2025-06-08T05:31:10,729           ############################
2025-06-08T05:31:10,730           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2025-06-08T05:31:10,730           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,731           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,732           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2025-06-08T05:31:10,732           to the `packages` configuration field.

2025-06-08T05:31:10,733           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,734           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,734           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,735           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,736           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,737           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2025-06-08T05:31:10,738           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2025-06-08T05:31:10,738           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,739           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,739           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,740           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,741           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,743           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,743                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,744                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,744                 directory, all directories are treated like packages.
2025-06-08T05:31:10,745           ********************************************************************************

2025-06-08T05:31:10,746   !!
2025-06-08T05:31:10,747     check.warn(importable)
2025-06-08T05:31:10,747   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2025-06-08T05:31:10,747   !!

2025-06-08T05:31:10,748           ********************************************************************************
2025-06-08T05:31:10,748           ############################
2025-06-08T05:31:10,749           # Package would be ignored #
2025-06-08T05:31:10,749           ############################
2025-06-08T05:31:10,749           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2025-06-08T05:31:10,750           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,751           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,751           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2025-06-08T05:31:10,751           to the `packages` configuration field.

2025-06-08T05:31:10,752           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,752           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,753           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,753           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,754           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,755           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2025-06-08T05:31:10,755           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2025-06-08T05:31:10,756           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,756           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,757           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,758           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,759           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,761           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,761                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,762                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,762                 directory, all directories are treated like packages.
2025-06-08T05:31:10,763           ********************************************************************************

2025-06-08T05:31:10,764   !!
2025-06-08T05:31:10,764     check.warn(importable)
2025-06-08T05:31:10,765   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2025-06-08T05:31:10,765   !!

2025-06-08T05:31:10,766           ********************************************************************************
2025-06-08T05:31:10,766           ############################
2025-06-08T05:31:10,767           # Package would be ignored #
2025-06-08T05:31:10,767           ############################
2025-06-08T05:31:10,768           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2025-06-08T05:31:10,768           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,769           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,770           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2025-06-08T05:31:10,771           to the `packages` configuration field.

2025-06-08T05:31:10,772           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,772           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,772           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,773           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,774           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,774           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2025-06-08T05:31:10,775           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2025-06-08T05:31:10,775           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,775           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,776           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,776           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,777           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,778           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,779                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,779                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,779                 directory, all directories are treated like packages.
2025-06-08T05:31:10,780           ********************************************************************************

2025-06-08T05:31:10,780   !!
2025-06-08T05:31:10,781     check.warn(importable)
2025-06-08T05:31:10,781   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2025-06-08T05:31:10,782   !!

2025-06-08T05:31:10,783           ********************************************************************************
2025-06-08T05:31:10,783           ############################
2025-06-08T05:31:10,784           # Package would be ignored #
2025-06-08T05:31:10,785           ############################
2025-06-08T05:31:10,785           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2025-06-08T05:31:10,786           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,787           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,787           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2025-06-08T05:31:10,788           to the `packages` configuration field.

2025-06-08T05:31:10,789           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,789           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,790           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,791           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,792           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,794           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2025-06-08T05:31:10,794           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2025-06-08T05:31:10,795           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,795           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,796           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,797           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,798           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,799           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,800                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,800                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,801                 directory, all directories are treated like packages.
2025-06-08T05:31:10,801           ********************************************************************************

2025-06-08T05:31:10,802   !!
2025-06-08T05:31:10,802     check.warn(importable)
2025-06-08T05:31:10,802   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2025-06-08T05:31:10,803   !!

2025-06-08T05:31:10,803           ********************************************************************************
2025-06-08T05:31:10,804           ############################
2025-06-08T05:31:10,804           # Package would be ignored #
2025-06-08T05:31:10,804           ############################
2025-06-08T05:31:10,805           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2025-06-08T05:31:10,805           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,806           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,806           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2025-06-08T05:31:10,807           to the `packages` configuration field.

2025-06-08T05:31:10,808           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,808           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,808           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,809           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,810           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,811           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2025-06-08T05:31:10,812           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2025-06-08T05:31:10,813           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,813           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,813           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,814           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,815           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,817           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,817                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,818                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,818                 directory, all directories are treated like packages.
2025-06-08T05:31:10,819           ********************************************************************************

2025-06-08T05:31:10,820   !!
2025-06-08T05:31:10,820     check.warn(importable)
2025-06-08T05:31:10,821   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2025-06-08T05:31:10,821   !!

2025-06-08T05:31:10,822           ********************************************************************************
2025-06-08T05:31:10,823           ############################
2025-06-08T05:31:10,823           # Package would be ignored #
2025-06-08T05:31:10,824           ############################
2025-06-08T05:31:10,825           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2025-06-08T05:31:10,825           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,826           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,827           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2025-06-08T05:31:10,827           to the `packages` configuration field.

2025-06-08T05:31:10,828           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,828           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,828           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,829           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,830           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,831           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2025-06-08T05:31:10,831           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2025-06-08T05:31:10,832           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,832           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,833           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,834           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,835           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,837           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,837                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,838                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,838                 directory, all directories are treated like packages.
2025-06-08T05:31:10,838           ********************************************************************************

2025-06-08T05:31:10,839   !!
2025-06-08T05:31:10,840     check.warn(importable)
2025-06-08T05:31:10,840   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2025-06-08T05:31:10,841   !!

2025-06-08T05:31:10,842           ********************************************************************************
2025-06-08T05:31:10,842           ############################
2025-06-08T05:31:10,843           # Package would be ignored #
2025-06-08T05:31:10,843           ############################
2025-06-08T05:31:10,844           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2025-06-08T05:31:10,844           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,845           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,846           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2025-06-08T05:31:10,846           to the `packages` configuration field.

2025-06-08T05:31:10,847           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,848           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,848           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,849           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,850           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,851           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2025-06-08T05:31:10,852           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2025-06-08T05:31:10,852           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,853           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,854           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,854           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,855           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,856           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,856                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,857                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,857                 directory, all directories are treated like packages.
2025-06-08T05:31:10,857           ********************************************************************************

2025-06-08T05:31:10,858   !!
2025-06-08T05:31:10,859     check.warn(importable)
2025-06-08T05:31:10,859   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2025-06-08T05:31:10,859   !!

2025-06-08T05:31:10,860           ********************************************************************************
2025-06-08T05:31:10,860           ############################
2025-06-08T05:31:10,861           # Package would be ignored #
2025-06-08T05:31:10,861           ############################
2025-06-08T05:31:10,862           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2025-06-08T05:31:10,862           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,863           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,864           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2025-06-08T05:31:10,864           to the `packages` configuration field.

2025-06-08T05:31:10,865           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,866           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,866           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,868           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,869           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,870           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2025-06-08T05:31:10,871           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2025-06-08T05:31:10,871           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,872           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,872           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,873           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,874           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,875           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,876                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,876                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,877                 directory, all directories are treated like packages.
2025-06-08T05:31:10,877           ********************************************************************************

2025-06-08T05:31:10,878   !!
2025-06-08T05:31:10,879     check.warn(importable)
2025-06-08T05:31:10,880   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.compile' is absent from the `packages` configuration.
2025-06-08T05:31:10,880   !!

2025-06-08T05:31:10,881           ********************************************************************************
2025-06-08T05:31:10,882           ############################
2025-06-08T05:31:10,882           # Package would be ignored #
2025-06-08T05:31:10,882           ############################
2025-06-08T05:31:10,883           Python recognizes 'deepspeed.ops.csrc.compile' as an importable package[^1],
2025-06-08T05:31:10,883           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,884           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,884           package, please make sure that 'deepspeed.ops.csrc.compile' is explicitly added
2025-06-08T05:31:10,884           to the `packages` configuration field.

2025-06-08T05:31:10,885           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,885           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,886           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,887           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,887           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,888           If you don't want 'deepspeed.ops.csrc.compile' to be distributed and are
2025-06-08T05:31:10,888           already explicitly excluding 'deepspeed.ops.csrc.compile' via
2025-06-08T05:31:10,889           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,889           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,890           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,891           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,892           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,893           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,894                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,894                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,895                 directory, all directories are treated like packages.
2025-06-08T05:31:10,895           ********************************************************************************

2025-06-08T05:31:10,896   !!
2025-06-08T05:31:10,897     check.warn(importable)
2025-06-08T05:31:10,897   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2025-06-08T05:31:10,898   !!

2025-06-08T05:31:10,899           ********************************************************************************
2025-06-08T05:31:10,899           ############################
2025-06-08T05:31:10,900           # Package would be ignored #
2025-06-08T05:31:10,900           ############################
2025-06-08T05:31:10,901           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2025-06-08T05:31:10,901           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,902           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,903           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2025-06-08T05:31:10,903           to the `packages` configuration field.

2025-06-08T05:31:10,904           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,905           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,905           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,907           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,907           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,908           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2025-06-08T05:31:10,908           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2025-06-08T05:31:10,909           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,909           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,910           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,910           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,911           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,912           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,913                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,913                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,913                 directory, all directories are treated like packages.
2025-06-08T05:31:10,914           ********************************************************************************

2025-06-08T05:31:10,914   !!
2025-06-08T05:31:10,915     check.warn(importable)
2025-06-08T05:31:10,915   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2025-06-08T05:31:10,916   !!

2025-06-08T05:31:10,917           ********************************************************************************
2025-06-08T05:31:10,917           ############################
2025-06-08T05:31:10,918           # Package would be ignored #
2025-06-08T05:31:10,918           ############################
2025-06-08T05:31:10,919           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2025-06-08T05:31:10,919           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,920           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,921           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2025-06-08T05:31:10,922           to the `packages` configuration field.

2025-06-08T05:31:10,923           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,923           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,924           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,925           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,926           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,927           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2025-06-08T05:31:10,927           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2025-06-08T05:31:10,928           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,928           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,929           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,930           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,931           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,933           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,933                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,934                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,935                 directory, all directories are treated like packages.
2025-06-08T05:31:10,935           ********************************************************************************

2025-06-08T05:31:10,936   !!
2025-06-08T05:31:10,936     check.warn(importable)
2025-06-08T05:31:10,936   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2025-06-08T05:31:10,937   !!

2025-06-08T05:31:10,937           ********************************************************************************
2025-06-08T05:31:10,938           ############################
2025-06-08T05:31:10,938           # Package would be ignored #
2025-06-08T05:31:10,938           ############################
2025-06-08T05:31:10,939           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2025-06-08T05:31:10,939           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,940           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,940           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2025-06-08T05:31:10,941           to the `packages` configuration field.

2025-06-08T05:31:10,941           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,942           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,942           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,943           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,944           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,945           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2025-06-08T05:31:10,946           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2025-06-08T05:31:10,946           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,947           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,947           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,948           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,950           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,951           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,952                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,952                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,953                 directory, all directories are treated like packages.
2025-06-08T05:31:10,953           ********************************************************************************

2025-06-08T05:31:10,954   !!
2025-06-08T05:31:10,955     check.warn(importable)
2025-06-08T05:31:10,955   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2025-06-08T05:31:10,956   !!

2025-06-08T05:31:10,957           ********************************************************************************
2025-06-08T05:31:10,957           ############################
2025-06-08T05:31:10,958           # Package would be ignored #
2025-06-08T05:31:10,958           ############################
2025-06-08T05:31:10,959           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2025-06-08T05:31:10,959           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,960           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,961           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2025-06-08T05:31:10,962           to the `packages` configuration field.

2025-06-08T05:31:10,962           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,963           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,963           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,964           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,965           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,965           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2025-06-08T05:31:10,966           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2025-06-08T05:31:10,966           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,966           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,967           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,968           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,968           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,970           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,970                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,970                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,971                 directory, all directories are treated like packages.
2025-06-08T05:31:10,971           ********************************************************************************

2025-06-08T05:31:10,973   !!
2025-06-08T05:31:10,973     check.warn(importable)
2025-06-08T05:31:10,974   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2025-06-08T05:31:10,974   !!

2025-06-08T05:31:10,976           ********************************************************************************
2025-06-08T05:31:10,976           ############################
2025-06-08T05:31:10,977           # Package would be ignored #
2025-06-08T05:31:10,977           ############################
2025-06-08T05:31:10,978           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2025-06-08T05:31:10,978           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,980           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,980           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2025-06-08T05:31:10,980           to the `packages` configuration field.

2025-06-08T05:31:10,981           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:10,982           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:10,982           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:10,983           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:10,985           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:10,986           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2025-06-08T05:31:10,986           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2025-06-08T05:31:10,987           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:10,987           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:10,988           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:10,989           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:10,990           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:10,991           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:10,991                 even if it does not contain any `.py` files.
2025-06-08T05:31:10,992                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:10,992                 directory, all directories are treated like packages.
2025-06-08T05:31:10,992           ********************************************************************************

2025-06-08T05:31:10,993   !!
2025-06-08T05:31:10,993     check.warn(importable)
2025-06-08T05:31:10,994   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2025-06-08T05:31:10,994   !!

2025-06-08T05:31:10,995           ********************************************************************************
2025-06-08T05:31:10,995           ############################
2025-06-08T05:31:10,996           # Package would be ignored #
2025-06-08T05:31:10,996           ############################
2025-06-08T05:31:10,997           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2025-06-08T05:31:10,997           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:10,998           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:10,999           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2025-06-08T05:31:10,999           to the `packages` configuration field.

2025-06-08T05:31:11,000           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,001           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,001           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,002           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,004           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,005           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2025-06-08T05:31:11,005           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2025-06-08T05:31:11,006           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,006           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,007           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,008           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,009           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,010           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,011                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,011                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,012                 directory, all directories are treated like packages.
2025-06-08T05:31:11,012           ********************************************************************************

2025-06-08T05:31:11,013   !!
2025-06-08T05:31:11,014     check.warn(importable)
2025-06-08T05:31:11,014   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2025-06-08T05:31:11,015   !!

2025-06-08T05:31:11,016           ********************************************************************************
2025-06-08T05:31:11,016           ############################
2025-06-08T05:31:11,017           # Package would be ignored #
2025-06-08T05:31:11,017           ############################
2025-06-08T05:31:11,017           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2025-06-08T05:31:11,018           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,018           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,019           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2025-06-08T05:31:11,019           to the `packages` configuration field.

2025-06-08T05:31:11,020           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,020           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,021           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,021           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,022           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,023           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2025-06-08T05:31:11,023           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2025-06-08T05:31:11,024           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,024           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,025           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,026           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,027           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,028           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,029                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,029                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,030                 directory, all directories are treated like packages.
2025-06-08T05:31:11,031           ********************************************************************************

2025-06-08T05:31:11,031   !!
2025-06-08T05:31:11,032     check.warn(importable)
2025-06-08T05:31:11,032   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2025-06-08T05:31:11,033   !!

2025-06-08T05:31:11,034           ********************************************************************************
2025-06-08T05:31:11,034           ############################
2025-06-08T05:31:11,035           # Package would be ignored #
2025-06-08T05:31:11,035           ############################
2025-06-08T05:31:11,036           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2025-06-08T05:31:11,036           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,038           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,038           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2025-06-08T05:31:11,039           to the `packages` configuration field.

2025-06-08T05:31:11,040           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,041           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,041           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,042           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,043           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,044           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2025-06-08T05:31:11,044           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2025-06-08T05:31:11,045           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,045           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,046           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,047           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,048           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,049           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,050                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,050                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,051                 directory, all directories are treated like packages.
2025-06-08T05:31:11,051           ********************************************************************************

2025-06-08T05:31:11,053   !!
2025-06-08T05:31:11,053     check.warn(importable)
2025-06-08T05:31:11,054   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2025-06-08T05:31:11,054   !!

2025-06-08T05:31:11,056           ********************************************************************************
2025-06-08T05:31:11,056           ############################
2025-06-08T05:31:11,057           # Package would be ignored #
2025-06-08T05:31:11,058           ############################
2025-06-08T05:31:11,058           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2025-06-08T05:31:11,059           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,060           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,061           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2025-06-08T05:31:11,062           to the `packages` configuration field.

2025-06-08T05:31:11,063           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,064           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,064           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,065           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,066           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,068           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2025-06-08T05:31:11,068           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2025-06-08T05:31:11,069           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,070           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,070           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,072           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,073           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,074           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,075                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,075                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,076                 directory, all directories are treated like packages.
2025-06-08T05:31:11,076           ********************************************************************************

2025-06-08T05:31:11,077   !!
2025-06-08T05:31:11,077     check.warn(importable)
2025-06-08T05:31:11,078   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2025-06-08T05:31:11,078   !!

2025-06-08T05:31:11,079           ********************************************************************************
2025-06-08T05:31:11,080           ############################
2025-06-08T05:31:11,080           # Package would be ignored #
2025-06-08T05:31:11,081           ############################
2025-06-08T05:31:11,081           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2025-06-08T05:31:11,082           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,083           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,083           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2025-06-08T05:31:11,084           to the `packages` configuration field.

2025-06-08T05:31:11,085           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,085           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,086           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,087           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,089           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,090           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2025-06-08T05:31:11,090           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2025-06-08T05:31:11,091           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,092           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,092           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,094           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,095           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,097           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,097                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,098                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,099                 directory, all directories are treated like packages.
2025-06-08T05:31:11,099           ********************************************************************************

2025-06-08T05:31:11,101   !!
2025-06-08T05:31:11,101     check.warn(importable)
2025-06-08T05:31:11,102   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2025-06-08T05:31:11,103   !!

2025-06-08T05:31:11,104           ********************************************************************************
2025-06-08T05:31:11,105           ############################
2025-06-08T05:31:11,106           # Package would be ignored #
2025-06-08T05:31:11,106           ############################
2025-06-08T05:31:11,107           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2025-06-08T05:31:11,107           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,108           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,109           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2025-06-08T05:31:11,109           to the `packages` configuration field.

2025-06-08T05:31:11,110           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,111           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,111           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,112           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,113           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,115           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2025-06-08T05:31:11,115           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2025-06-08T05:31:11,116           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,116           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,117           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,118           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,120           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,122           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,123                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,123                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,124                 directory, all directories are treated like packages.
2025-06-08T05:31:11,124           ********************************************************************************

2025-06-08T05:31:11,126   !!
2025-06-08T05:31:11,126     check.warn(importable)
2025-06-08T05:31:11,127   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2025-06-08T05:31:11,128   !!

2025-06-08T05:31:11,129           ********************************************************************************
2025-06-08T05:31:11,130           ############################
2025-06-08T05:31:11,131           # Package would be ignored #
2025-06-08T05:31:11,131           ############################
2025-06-08T05:31:11,132           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2025-06-08T05:31:11,133           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,134           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,135           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2025-06-08T05:31:11,136           to the `packages` configuration field.

2025-06-08T05:31:11,137           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,138           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,139           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,140           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,141           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,143           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2025-06-08T05:31:11,144           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2025-06-08T05:31:11,145           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,146           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,146           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,147           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,149           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,150           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,151                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,151                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,152                 directory, all directories are treated like packages.
2025-06-08T05:31:11,152           ********************************************************************************

2025-06-08T05:31:11,154   !!
2025-06-08T05:31:11,154     check.warn(importable)
2025-06-08T05:31:11,155   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2025-06-08T05:31:11,155   !!

2025-06-08T05:31:11,157           ********************************************************************************
2025-06-08T05:31:11,157           ############################
2025-06-08T05:31:11,158           # Package would be ignored #
2025-06-08T05:31:11,158           ############################
2025-06-08T05:31:11,159           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2025-06-08T05:31:11,160           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,161           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,162           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2025-06-08T05:31:11,163           to the `packages` configuration field.

2025-06-08T05:31:11,164           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,165           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,165           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,167           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,168           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,170           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2025-06-08T05:31:11,170           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2025-06-08T05:31:11,171           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,172           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,172           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,174           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,175           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,177           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,178                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,179                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,179                 directory, all directories are treated like packages.
2025-06-08T05:31:11,180           ********************************************************************************

2025-06-08T05:31:11,181   !!
2025-06-08T05:31:11,182     check.warn(importable)
2025-06-08T05:31:11,183   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2025-06-08T05:31:11,184   !!

2025-06-08T05:31:11,185           ********************************************************************************
2025-06-08T05:31:11,185           ############################
2025-06-08T05:31:11,186           # Package would be ignored #
2025-06-08T05:31:11,187           ############################
2025-06-08T05:31:11,187           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2025-06-08T05:31:11,188           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,189           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,189           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2025-06-08T05:31:11,190           to the `packages` configuration field.

2025-06-08T05:31:11,191           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,192           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,192           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,194           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,195           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,196           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2025-06-08T05:31:11,197           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2025-06-08T05:31:11,197           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,198           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,199           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,200           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,201           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,203           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,204                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,205                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,205                 directory, all directories are treated like packages.
2025-06-08T05:31:11,206           ********************************************************************************

2025-06-08T05:31:11,207   !!
2025-06-08T05:31:11,208     check.warn(importable)
2025-06-08T05:31:11,209   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2025-06-08T05:31:11,209   !!

2025-06-08T05:31:11,211           ********************************************************************************
2025-06-08T05:31:11,211           ############################
2025-06-08T05:31:11,212           # Package would be ignored #
2025-06-08T05:31:11,213           ############################
2025-06-08T05:31:11,213           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2025-06-08T05:31:11,214           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,216           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,216           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2025-06-08T05:31:11,217           to the `packages` configuration field.

2025-06-08T05:31:11,218           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,219           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,220           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,221           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,222           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,223           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2025-06-08T05:31:11,224           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2025-06-08T05:31:11,224           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,225           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,225           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,226           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,228           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,230           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,230                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,231                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,231                 directory, all directories are treated like packages.
2025-06-08T05:31:11,232           ********************************************************************************

2025-06-08T05:31:11,233   !!
2025-06-08T05:31:11,234     check.warn(importable)
2025-06-08T05:31:11,234   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2025-06-08T05:31:11,235   !!

2025-06-08T05:31:11,236           ********************************************************************************
2025-06-08T05:31:11,237           ############################
2025-06-08T05:31:11,237           # Package would be ignored #
2025-06-08T05:31:11,238           ############################
2025-06-08T05:31:11,238           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2025-06-08T05:31:11,239           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,240           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,240           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2025-06-08T05:31:11,241           to the `packages` configuration field.

2025-06-08T05:31:11,242           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,242           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,243           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,244           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,245           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,246           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2025-06-08T05:31:11,246           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2025-06-08T05:31:11,247           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,248           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,248           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,249           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,250           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,252           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,252                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,253                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,254                 directory, all directories are treated like packages.
2025-06-08T05:31:11,254           ********************************************************************************

2025-06-08T05:31:11,255   !!
2025-06-08T05:31:11,256     check.warn(importable)
2025-06-08T05:31:11,256   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2025-06-08T05:31:11,256   !!

2025-06-08T05:31:11,257           ********************************************************************************
2025-06-08T05:31:11,258           ############################
2025-06-08T05:31:11,258           # Package would be ignored #
2025-06-08T05:31:11,259           ############################
2025-06-08T05:31:11,259           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2025-06-08T05:31:11,260           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,261           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,261           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2025-06-08T05:31:11,262           to the `packages` configuration field.

2025-06-08T05:31:11,263           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,263           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,264           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,265           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,266           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,267           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2025-06-08T05:31:11,267           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2025-06-08T05:31:11,268           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,268           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,269           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,270           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,271           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,273           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,273                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,274                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,274                 directory, all directories are treated like packages.
2025-06-08T05:31:11,275           ********************************************************************************

2025-06-08T05:31:11,276   !!
2025-06-08T05:31:11,276     check.warn(importable)
2025-06-08T05:31:11,277   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2025-06-08T05:31:11,277   !!

2025-06-08T05:31:11,278           ********************************************************************************
2025-06-08T05:31:11,279           ############################
2025-06-08T05:31:11,279           # Package would be ignored #
2025-06-08T05:31:11,280           ############################
2025-06-08T05:31:11,281           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2025-06-08T05:31:11,281           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,282           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,283           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2025-06-08T05:31:11,283           to the `packages` configuration field.

2025-06-08T05:31:11,284           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,284           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,285           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,286           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,287           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,288           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2025-06-08T05:31:11,288           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2025-06-08T05:31:11,289           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,289           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,290           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,291           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,292           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,293           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,293                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,294                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,294                 directory, all directories are treated like packages.
2025-06-08T05:31:11,295           ********************************************************************************

2025-06-08T05:31:11,296   !!
2025-06-08T05:31:11,296     check.warn(importable)
2025-06-08T05:31:11,297   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2025-06-08T05:31:11,297   !!

2025-06-08T05:31:11,298           ********************************************************************************
2025-06-08T05:31:11,299           ############################
2025-06-08T05:31:11,299           # Package would be ignored #
2025-06-08T05:31:11,300           ############################
2025-06-08T05:31:11,301           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2025-06-08T05:31:11,301           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,302           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,303           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2025-06-08T05:31:11,303           to the `packages` configuration field.

2025-06-08T05:31:11,304           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,305           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,306           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,307           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,308           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,309           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2025-06-08T05:31:11,309           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2025-06-08T05:31:11,310           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,310           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,311           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,312           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,313           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,314           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,314                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,315                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,315                 directory, all directories are treated like packages.
2025-06-08T05:31:11,316           ********************************************************************************

2025-06-08T05:31:11,317   !!
2025-06-08T05:31:11,317     check.warn(importable)
2025-06-08T05:31:11,318   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2025-06-08T05:31:11,318   !!

2025-06-08T05:31:11,319           ********************************************************************************
2025-06-08T05:31:11,320           ############################
2025-06-08T05:31:11,320           # Package would be ignored #
2025-06-08T05:31:11,321           ############################
2025-06-08T05:31:11,321           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2025-06-08T05:31:11,321           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,322           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,323           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2025-06-08T05:31:11,323           to the `packages` configuration field.

2025-06-08T05:31:11,324           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,325           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,325           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,326           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,327           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,328           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2025-06-08T05:31:11,329           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2025-06-08T05:31:11,329           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,330           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,330           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,331           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,332           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,334           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,335                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,335                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,336                 directory, all directories are treated like packages.
2025-06-08T05:31:11,336           ********************************************************************************

2025-06-08T05:31:11,337   !!
2025-06-08T05:31:11,338     check.warn(importable)
2025-06-08T05:31:11,338   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2025-06-08T05:31:11,339   !!

2025-06-08T05:31:11,340           ********************************************************************************
2025-06-08T05:31:11,341           ############################
2025-06-08T05:31:11,341           # Package would be ignored #
2025-06-08T05:31:11,342           ############################
2025-06-08T05:31:11,342           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2025-06-08T05:31:11,343           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,344           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,344           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2025-06-08T05:31:11,345           to the `packages` configuration field.

2025-06-08T05:31:11,345           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,346           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,346           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,347           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,348           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,349           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2025-06-08T05:31:11,350           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2025-06-08T05:31:11,350           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,351           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,351           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,352           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,353           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,355           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,356                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,356                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,357                 directory, all directories are treated like packages.
2025-06-08T05:31:11,357           ********************************************************************************

2025-06-08T05:31:11,359   !!
2025-06-08T05:31:11,360     check.warn(importable)
2025-06-08T05:31:11,360   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2025-06-08T05:31:11,361   !!

2025-06-08T05:31:11,362           ********************************************************************************
2025-06-08T05:31:11,362           ############################
2025-06-08T05:31:11,363           # Package would be ignored #
2025-06-08T05:31:11,364           ############################
2025-06-08T05:31:11,364           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2025-06-08T05:31:11,365           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,366           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,366           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2025-06-08T05:31:11,367           to the `packages` configuration field.

2025-06-08T05:31:11,368           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,369           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,369           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,370           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,371           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,372           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2025-06-08T05:31:11,373           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2025-06-08T05:31:11,373           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,373           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,374           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,375           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,375           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,377           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,377                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,378                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,378                 directory, all directories are treated like packages.
2025-06-08T05:31:11,379           ********************************************************************************

2025-06-08T05:31:11,380   !!
2025-06-08T05:31:11,380     check.warn(importable)
2025-06-08T05:31:11,381   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2025-06-08T05:31:11,381   !!

2025-06-08T05:31:11,382           ********************************************************************************
2025-06-08T05:31:11,383           ############################
2025-06-08T05:31:11,383           # Package would be ignored #
2025-06-08T05:31:11,384           ############################
2025-06-08T05:31:11,384           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2025-06-08T05:31:11,384           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,385           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,386           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2025-06-08T05:31:11,386           to the `packages` configuration field.

2025-06-08T05:31:11,387           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,388           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,388           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,390           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,391           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,392           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2025-06-08T05:31:11,392           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2025-06-08T05:31:11,393           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,393           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,394           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,395           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,396           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,397           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,398                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,398                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,399                 directory, all directories are treated like packages.
2025-06-08T05:31:11,400           ********************************************************************************

2025-06-08T05:31:11,400   !!
2025-06-08T05:31:11,401     check.warn(importable)
2025-06-08T05:31:11,401   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2025-06-08T05:31:11,402   !!

2025-06-08T05:31:11,403           ********************************************************************************
2025-06-08T05:31:11,403           ############################
2025-06-08T05:31:11,404           # Package would be ignored #
2025-06-08T05:31:11,404           ############################
2025-06-08T05:31:11,405           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2025-06-08T05:31:11,405           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,406           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,407           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2025-06-08T05:31:11,407           to the `packages` configuration field.

2025-06-08T05:31:11,408           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,408           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,409           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,410           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,411           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,412           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2025-06-08T05:31:11,412           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2025-06-08T05:31:11,413           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,413           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,414           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,415           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,416           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,417           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,418                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,419                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,419                 directory, all directories are treated like packages.
2025-06-08T05:31:11,420           ********************************************************************************

2025-06-08T05:31:11,421   !!
2025-06-08T05:31:11,421     check.warn(importable)
2025-06-08T05:31:11,422   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2025-06-08T05:31:11,422   !!

2025-06-08T05:31:11,423           ********************************************************************************
2025-06-08T05:31:11,424           ############################
2025-06-08T05:31:11,425           # Package would be ignored #
2025-06-08T05:31:11,425           ############################
2025-06-08T05:31:11,426           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2025-06-08T05:31:11,426           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,427           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,428           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2025-06-08T05:31:11,429           to the `packages` configuration field.

2025-06-08T05:31:11,430           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,430           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,430           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,431           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,432           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,433           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2025-06-08T05:31:11,433           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2025-06-08T05:31:11,434           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,434           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,435           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,436           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,437           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,438           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,439                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,439                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,440                 directory, all directories are treated like packages.
2025-06-08T05:31:11,440           ********************************************************************************

2025-06-08T05:31:11,441   !!
2025-06-08T05:31:11,442     check.warn(importable)
2025-06-08T05:31:11,442   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2025-06-08T05:31:11,443   !!

2025-06-08T05:31:11,444           ********************************************************************************
2025-06-08T05:31:11,444           ############################
2025-06-08T05:31:11,445           # Package would be ignored #
2025-06-08T05:31:11,445           ############################
2025-06-08T05:31:11,446           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2025-06-08T05:31:11,446           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,447           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,448           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2025-06-08T05:31:11,448           to the `packages` configuration field.

2025-06-08T05:31:11,450           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,450           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,451           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,452           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,453           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,454           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2025-06-08T05:31:11,454           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2025-06-08T05:31:11,455           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,455           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,456           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,457           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,458           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,459           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,460                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,460                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,460                 directory, all directories are treated like packages.
2025-06-08T05:31:11,461           ********************************************************************************

2025-06-08T05:31:11,462   !!
2025-06-08T05:31:11,462     check.warn(importable)
2025-06-08T05:31:11,463   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2025-06-08T05:31:11,463   !!

2025-06-08T05:31:11,464           ********************************************************************************
2025-06-08T05:31:11,464           ############################
2025-06-08T05:31:11,465           # Package would be ignored #
2025-06-08T05:31:11,465           ############################
2025-06-08T05:31:11,466           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2025-06-08T05:31:11,466           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,467           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,467           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2025-06-08T05:31:11,468           to the `packages` configuration field.

2025-06-08T05:31:11,469           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,469           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,470           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,471           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,472           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,473           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2025-06-08T05:31:11,473           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2025-06-08T05:31:11,474           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,474           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,474           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,475           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,476           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,478           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,478                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,479                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,479                 directory, all directories are treated like packages.
2025-06-08T05:31:11,480           ********************************************************************************

2025-06-08T05:31:11,481   !!
2025-06-08T05:31:11,481     check.warn(importable)
2025-06-08T05:31:11,482   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2025-06-08T05:31:11,482   !!

2025-06-08T05:31:11,483           ********************************************************************************
2025-06-08T05:31:11,484           ############################
2025-06-08T05:31:11,485           # Package would be ignored #
2025-06-08T05:31:11,485           ############################
2025-06-08T05:31:11,486           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2025-06-08T05:31:11,486           but it is absent from setuptools' `packages` configuration.

2025-06-08T05:31:11,487           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T05:31:11,487           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2025-06-08T05:31:11,488           to the `packages` configuration field.

2025-06-08T05:31:11,488           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T05:31:11,489           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T05:31:11,489           instead of `find_packages(...)`/`find:`).

2025-06-08T05:31:11,490           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T05:31:11,491           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T05:31:11,492           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2025-06-08T05:31:11,492           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2025-06-08T05:31:11,493           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T05:31:11,493           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T05:31:11,494           combination with a more fine grained `package-data` configuration.

2025-06-08T05:31:11,495           You can read more about "package data files" on setuptools documentation page:

2025-06-08T05:31:11,496           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T05:31:11,497           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T05:31:11,498                 even if it does not contain any `.py` files.
2025-06-08T05:31:11,498                 On the other hand, currently there is no concept of package data
2025-06-08T05:31:11,499                 directory, all directories are treated like packages.
2025-06-08T05:31:11,499           ********************************************************************************

2025-06-08T05:31:11,500   !!
2025-06-08T05:31:11,501     check.warn(importable)
2025-06-08T05:31:11,501   creating build/lib/deepspeed/ops/csrc/adagrad
2025-06-08T05:31:11,501   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2025-06-08T05:31:11,502   creating build/lib/deepspeed/ops/csrc/adam
2025-06-08T05:31:11,503   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-08T05:31:11,503   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-08T05:31:11,504   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-08T05:31:11,504   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2025-06-08T05:31:11,505   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2025-06-08T05:31:11,505   creating build/lib/deepspeed/ops/csrc/aio/common
2025-06-08T05:31:11,506   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-08T05:31:11,506   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-08T05:31:11,507   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-08T05:31:11,507   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-08T05:31:11,508   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-08T05:31:11,509   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-08T05:31:11,509   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,510   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,510   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,511   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,511   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,512   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,512   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,512   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,513   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,513   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,514   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,514   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,515   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,515   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,515   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,516   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,516   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,517   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:11,517   creating build/lib/deepspeed/ops/csrc/aio/py_test
2025-06-08T05:31:11,518   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2025-06-08T05:31:11,518   creating build/lib/deepspeed/ops/csrc/compile
2025-06-08T05:31:11,519   copying deepspeed/ops/csrc/compile/deepcompile.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-08T05:31:11,519   copying deepspeed/ops/csrc/compile/init.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-08T05:31:11,520   copying deepspeed/ops/csrc/compile/util.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-08T05:31:11,521   copying deepspeed/ops/csrc/compile/z1.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-08T05:31:11,521   copying deepspeed/ops/csrc/compile/z1.h -> build/lib/deepspeed/ops/csrc/compile
2025-06-08T05:31:11,522   copying deepspeed/ops/csrc/compile/z3.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-08T05:31:11,522   copying deepspeed/ops/csrc/compile/z3.h -> build/lib/deepspeed/ops/csrc/compile
2025-06-08T05:31:11,523   creating build/lib/deepspeed/ops/csrc/cpu/adam
2025-06-08T05:31:11,523   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2025-06-08T05:31:11,524   creating build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-08T05:31:11,524   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-08T05:31:11,525   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-08T05:31:11,525   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-08T05:31:11,526   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-08T05:31:11,526   creating build/lib/deepspeed/ops/csrc/cpu/lion
2025-06-08T05:31:11,527   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2025-06-08T05:31:11,528   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T05:31:11,528   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T05:31:11,529   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T05:31:11,529   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T05:31:11,530   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T05:31:11,530   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T05:31:11,531   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T05:31:11,531   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T05:31:11,532   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T05:31:11,532   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T05:31:11,533   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T05:31:11,534   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T05:31:11,534   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T05:31:11,534   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T05:31:11,535   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T05:31:11,536   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T05:31:11,536   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T05:31:11,537   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T05:31:11,537   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T05:31:11,538   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T05:31:11,538   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T05:31:11,539   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T05:31:11,539   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T05:31:11,540   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T05:31:11,540   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T05:31:11,541   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T05:31:11,541   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T05:31:11,541   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T05:31:11,542   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-08T05:31:11,543   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-08T05:31:11,543   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-08T05:31:11,544   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-08T05:31:11,544   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-08T05:31:11,544   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-08T05:31:11,545   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-08T05:31:11,545   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-08T05:31:11,546   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-08T05:31:11,546   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-08T05:31:11,547   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-08T05:31:11,547   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-08T05:31:11,548   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-08T05:31:11,548   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-08T05:31:11,549   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-08T05:31:11,549   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-08T05:31:11,550   creating build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,550   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,551   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,551   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,552   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,552   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,553   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,554   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,554   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,555   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,555   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,556   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,556   copying deepspeed/ops/csrc/includes/deepcompile.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,557   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,557   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,557   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,558   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,558   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,559   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,559   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,560   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,560   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,561   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,561   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,562   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,562   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,563   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,563   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,564   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,564   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,565   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T05:31:11,565   creating build/lib/deepspeed/ops/csrc/lamb
2025-06-08T05:31:11,566   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2025-06-08T05:31:11,566   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2025-06-08T05:31:11,569   creating build/lib/deepspeed/ops/csrc/lion
2025-06-08T05:31:11,570   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-08T05:31:11,572   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-08T05:31:11,575   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-08T05:31:11,577   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2025-06-08T05:31:11,580   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2025-06-08T05:31:11,582   creating build/lib/deepspeed/ops/csrc/quantization
2025-06-08T05:31:11,583   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-08T05:31:11,585   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-08T05:31:11,588   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2025-06-08T05:31:11,591   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-08T05:31:11,594   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-08T05:31:11,596   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-08T05:31:11,598   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-08T05:31:11,601   creating build/lib/deepspeed/ops/csrc/random_ltd
2025-06-08T05:31:11,602   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-08T05:31:11,605   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-08T05:31:11,607   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-08T05:31:11,610   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-08T05:31:11,612   creating build/lib/deepspeed/ops/csrc/sparse_attention
2025-06-08T05:31:11,613   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2025-06-08T05:31:11,615   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-08T05:31:11,616   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-08T05:31:11,619   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-08T05:31:11,621   creating build/lib/deepspeed/ops/csrc/spatial/includes
2025-06-08T05:31:11,622   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2025-06-08T05:31:11,624   creating build/lib/deepspeed/ops/csrc/transformer
2025-06-08T05:31:11,625   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-08T05:31:11,628   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-08T05:31:11,631   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2025-06-08T05:31:11,634   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-08T05:31:11,636   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-08T05:31:11,639   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-08T05:31:11,643   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-08T05:31:11,646   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-08T05:31:11,648   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:11,650   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:11,653   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:11,655   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:11,658   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:11,661   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:11,664   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:11,667   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:11,670   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:11,673   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:11,676   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:11,679   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-08T05:31:11,680   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-08T05:31:11,682   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-08T05:31:11,685   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-08T05:31:11,688   creating build/lib/deepspeed/ops/csrc/utils
2025-06-08T05:31:11,689   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2025-06-08T05:31:11,691   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-06-08T05:31:11,692   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-06-08T05:31:11,695   creating build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-08T05:31:11,696   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-08T05:31:11,698   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-08T05:31:11,701   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-08T05:31:11,703   creating build/lib/deepspeed/ops/csrc/xpu/common
2025-06-08T05:31:11,704   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2025-06-08T05:31:11,706   creating build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-08T05:31:11,707   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-08T05:31:11,710   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-08T05:31:11,712   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-08T05:31:11,714   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-08T05:31:11,717   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-08T05:31:11,720   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2025-06-08T05:31:11,721   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2025-06-08T05:31:11,723   creating build/lib/deepspeed/autotuning/config_templates
2025-06-08T05:31:11,724   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-08T05:31:11,726   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-08T05:31:11,728   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-08T05:31:11,730   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-08T05:31:11,732   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-08T05:31:11,735   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-08T05:31:11,737   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-08T05:31:11,740   creating build/lib/deepspeed/inference/v2/kernels/includes
2025-06-08T05:31:11,741   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-08T05:31:11,743   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-08T05:31:11,746   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-08T05:31:11,748   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-08T05:31:11,751   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-08T05:31:11,754   creating build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-08T05:31:11,755   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-08T05:31:11,757   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-08T05:31:11,759   creating build/lib/deepspeed/inference/v2/ragged/includes
2025-06-08T05:31:11,760   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2025-06-08T05:31:11,762   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-08T05:31:11,764   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-08T05:31:11,765   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-08T05:31:11,767   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-08T05:31:11,769   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-08T05:31:11,771   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-08T05:31:11,771   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-08T05:31:11,774   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-08T05:31:11,775   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-08T05:31:11,777   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-08T05:31:11,779   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-08T05:31:11,781   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T05:31:11,783   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T05:31:11,785   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T05:31:11,787   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T05:31:11,790   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T05:31:11,792   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T05:31:11,794   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T05:31:11,796   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T05:31:11,798   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T05:31:11,801   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T05:31:11,803   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T05:31:11,805   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T05:31:11,808   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T05:31:11,810   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T05:31:11,813   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T05:31:11,815   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T05:31:11,817   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T05:31:11,820   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:11,822   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:11,824   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:11,827   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T05:31:11,830   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T05:31:11,832   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T05:31:11,835   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T05:31:11,837   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:11,838   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:11,841   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:11,844   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:11,846   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:11,848   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:11,851   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:11,854   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:11,856   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:11,858   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:11,861   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T05:31:11,863   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T05:31:11,865   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T05:31:11,867   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T05:31:11,870   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T05:31:11,872   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T05:31:11,874   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T05:31:11,876   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T05:31:11,879   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T05:31:11,881   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T05:31:11,883   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T05:31:11,885   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T05:31:11,887   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T05:31:11,890   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T05:31:11,892   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T05:31:11,895   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T05:31:11,897   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T05:31:11,899   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T05:31:11,902   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:11,905   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:11,907   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:11,910   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:11,912   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T05:31:11,915   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T05:31:11,917   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T05:31:11,919   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T05:31:11,921   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T05:31:11,923   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T05:31:11,926   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T05:31:11,928   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T05:31:11,987   running build_scripts
2025-06-08T05:31:11,987   creating build/scripts-3.11
2025-06-08T05:31:11,988   copying and adjusting bin/deepspeed -> build/scripts-3.11
2025-06-08T05:31:11,990   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2025-06-08T05:31:11,992   copying and adjusting bin/ds -> build/scripts-3.11
2025-06-08T05:31:11,993   copying bin/ds_ssh -> build/scripts-3.11
2025-06-08T05:31:11,995   copying and adjusting bin/ds_report -> build/scripts-3.11
2025-06-08T05:31:11,997   copying and adjusting bin/ds_bench -> build/scripts-3.11
2025-06-08T05:31:11,998   copying and adjusting bin/dsr -> build/scripts-3.11
2025-06-08T05:31:12,000   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2025-06-08T05:31:12,001   copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11
2025-06-08T05:31:12,003   copying and adjusting bin/ds_io -> build/scripts-3.11
2025-06-08T05:31:12,004   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2025-06-08T05:31:12,004   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2025-06-08T05:31:12,005   changing mode of build/scripts-3.11/ds from 644 to 755
2025-06-08T05:31:12,005   changing mode of build/scripts-3.11/ds_report from 644 to 755
2025-06-08T05:31:12,006   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2025-06-08T05:31:12,006   changing mode of build/scripts-3.11/dsr from 644 to 755
2025-06-08T05:31:12,007   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2025-06-08T05:31:12,007   changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755
2025-06-08T05:31:12,008   changing mode of build/scripts-3.11/ds_io from 644 to 755
2025-06-08T05:31:12,035   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2025-06-08T05:31:12,036   !!

2025-06-08T05:31:12,037           ********************************************************************************
2025-06-08T05:31:12,038           Please avoid running ``setup.py`` directly.
2025-06-08T05:31:12,038           Instead, use pypa/build, pypa/installer or other
2025-06-08T05:31:12,039           standards-based tools.

2025-06-08T05:31:12,040           By 2025-Oct-31, you need to update your project and remove deprecated calls
2025-06-08T05:31:12,041           or your builds will no longer be supported.

2025-06-08T05:31:12,042           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2025-06-08T05:31:12,043           ********************************************************************************

2025-06-08T05:31:12,044   !!
2025-06-08T05:31:12,044     self.initialize_options()
2025-06-08T05:31:12,065   installing to build/bdist.linux-armv7l/wheel
2025-06-08T05:31:12,066   running install
2025-06-08T05:31:12,089   running install_lib
2025-06-08T05:31:12,117   creating build/bdist.linux-armv7l/wheel
2025-06-08T05:31:12,120   creating build/bdist.linux-armv7l/wheel/deepspeed
2025-06-08T05:31:12,121   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2025-06-08T05:31:12,123   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2025-06-08T05:31:12,124   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-06-08T05:31:12,126   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-06-08T05:31:12,129   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2025-06-08T05:31:12,130   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2025-06-08T05:31:12,132   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2025-06-08T05:31:12,133   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-08T05:31:12,136   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-08T05:31:12,138   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-08T05:31:12,141   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-08T05:31:12,143   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2025-06-08T05:31:12,144   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2025-06-08T05:31:12,146   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2025-06-08T05:31:12,147   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2025-06-08T05:31:12,149   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2025-06-08T05:31:12,150   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-06-08T05:31:12,153   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-06-08T05:31:12,156   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2025-06-08T05:31:12,157   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,158   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,160   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,163   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,165   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,167   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,169   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,171   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,173   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,175   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,177   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,180   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,181   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,183   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,185   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,187   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,189   copying build/lib/deepspeed/ops/csrc/includes/deepcompile.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,192   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,193   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,195   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,198   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,200   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,202   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,204   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,206   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,209   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,211   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,213   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,215   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,216   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T05:31:12,219   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2025-06-08T05:31:12,220   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2025-06-08T05:31:12,223   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2025-06-08T05:31:12,225   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2025-06-08T05:31:12,226   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2025-06-08T05:31:12,229   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2025-06-08T05:31:12,230   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-08T05:31:12,232   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-08T05:31:12,234   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-08T05:31:12,236   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-08T05:31:12,237   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-08T05:31:12,240   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2025-06-08T05:31:12,241   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-08T05:31:12,243   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-08T05:31:12,246   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-08T05:31:12,248   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2025-06-08T05:31:12,249   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2025-06-08T05:31:12,251   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2025-06-08T05:31:12,252   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2025-06-08T05:31:12,256   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2025-06-08T05:31:12,257   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2025-06-08T05:31:12,259   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-08T05:31:12,261   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-08T05:31:12,263   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-08T05:31:12,266   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-08T05:31:12,268   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-08T05:31:12,270   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-08T05:31:12,272   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2025-06-08T05:31:12,274   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2025-06-08T05:31:12,275   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-08T05:31:12,277   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-08T05:31:12,279   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-08T05:31:12,281   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-08T05:31:12,284   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-08T05:31:12,285   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-08T05:31:12,288   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,290   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,292   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,293   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,295   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,297   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,298   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,300   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,302   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,304   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,306   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,308   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,309   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,311   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,313   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,316   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,318   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,320   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T05:31:12,322   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2025-06-08T05:31:12,323   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2025-06-08T05:31:12,326   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2025-06-08T05:31:12,327   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-08T05:31:12,329   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-08T05:31:12,332   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-08T05:31:12,334   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-08T05:31:12,337   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-08T05:31:12,339   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-08T05:31:12,341   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-08T05:31:12,344   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2025-06-08T05:31:12,345   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2025-06-08T05:31:12,347   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2025-06-08T05:31:12,349   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T05:31:12,350   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T05:31:12,352   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T05:31:12,354   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T05:31:12,357   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T05:31:12,358   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T05:31:12,361   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T05:31:12,363   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T05:31:12,365   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T05:31:12,368   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T05:31:12,370   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T05:31:12,373   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-08T05:31:12,374   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-08T05:31:12,377   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-08T05:31:12,379   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T05:31:12,383   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T05:31:12,384   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T05:31:12,387   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T05:31:12,390   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T05:31:12,392   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T05:31:12,394   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T05:31:12,396   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T05:31:12,399   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T05:31:12,402   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T05:31:12,403   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T05:31:12,407   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T05:31:12,409   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T05:31:12,412   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T05:31:12,414   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T05:31:12,416   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T05:31:12,419   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T05:31:12,422   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2025-06-08T05:31:12,423   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2025-06-08T05:31:12,424   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2025-06-08T05:31:12,427   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2025-06-08T05:31:12,428   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-06-08T05:31:12,430   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-06-08T05:31:12,433   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2025-06-08T05:31:12,434   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-06-08T05:31:12,437   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-08T05:31:12,438   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-06-08T05:31:12,441   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-06-08T05:31:12,442   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-06-08T05:31:12,445   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2025-06-08T05:31:12,446   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-08T05:31:12,448   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-08T05:31:12,450   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-08T05:31:12,452   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-08T05:31:12,454   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-08T05:31:12,457   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2025-06-08T05:31:12,458   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-08T05:31:12,460   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-08T05:31:12,462   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-08T05:31:12,464   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-08T05:31:12,467   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2025-06-08T05:31:12,468   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-08T05:31:12,470   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-08T05:31:12,472   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-08T05:31:12,475   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-08T05:31:12,476   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-08T05:31:12,479   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2025-06-08T05:31:12,480   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2025-06-08T05:31:12,483   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2025-06-08T05:31:12,484   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-08T05:31:12,486   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-08T05:31:12,490   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-08T05:31:12,492   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-08T05:31:12,495   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-08T05:31:12,498   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2025-06-08T05:31:12,500   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2025-06-08T05:31:12,501   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-08T05:31:12,503   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-08T05:31:12,506   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-08T05:31:12,508   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:12,509   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:12,512   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:12,514   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:12,516   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:12,520   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:12,522   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:12,524   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:12,526   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:12,529   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:12,531   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T05:31:12,534   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-08T05:31:12,536   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-08T05:31:12,539   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-08T05:31:12,543   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/compile
2025-06-08T05:31:12,544   copying build/lib/deepspeed/ops/csrc/compile/z1.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-08T05:31:12,546   copying build/lib/deepspeed/ops/csrc/compile/z3.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-08T05:31:12,548   copying build/lib/deepspeed/ops/csrc/compile/util.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-08T05:31:12,550   copying build/lib/deepspeed/ops/csrc/compile/init.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-08T05:31:12,553   copying build/lib/deepspeed/ops/csrc/compile/z3.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-08T05:31:12,554   copying build/lib/deepspeed/ops/csrc/compile/z1.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-08T05:31:12,556   copying build/lib/deepspeed/ops/csrc/compile/deepcompile.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-08T05:31:12,559   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2025-06-08T05:31:12,561   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2025-06-08T05:31:12,562   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-08T05:31:12,564   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-08T05:31:12,566   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-08T05:31:12,568   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-08T05:31:12,569   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-08T05:31:12,572   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-08T05:31:12,573   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-08T05:31:12,575   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-08T05:31:12,577   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-08T05:31:12,580   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-08T05:31:12,582   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-08T05:31:12,585   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2025-06-08T05:31:12,586   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2025-06-08T05:31:12,589   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2025-06-08T05:31:12,590   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2025-06-08T05:31:12,591   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2025-06-08T05:31:12,594   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2025-06-08T05:31:12,595   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-06-08T05:31:12,596   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-06-08T05:31:12,599   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2025-06-08T05:31:12,600   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-08T05:31:12,602   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-08T05:31:12,604   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-08T05:31:12,606   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-08T05:31:12,609   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2025-06-08T05:31:12,610   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-08T05:31:12,612   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-08T05:31:12,614   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-08T05:31:12,616   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-08T05:31:12,618   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2025-06-08T05:31:12,619   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-06-08T05:31:12,621   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-06-08T05:31:12,624   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2025-06-08T05:31:12,625   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-08T05:31:12,627   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-08T05:31:12,628   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-08T05:31:12,630   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-08T05:31:12,632   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2025-06-08T05:31:12,633   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-06-08T05:31:12,635   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-06-08T05:31:12,638   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2025-06-08T05:31:12,639   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-06-08T05:31:12,641   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-06-08T05:31:12,644   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2025-06-08T05:31:12,645   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T05:31:12,647   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T05:31:12,649   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T05:31:12,651   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T05:31:12,653   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T05:31:12,655   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T05:31:12,657   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T05:31:12,659   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,660   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,662   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,664   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,666   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,668   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,670   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,672   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,673   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,676   copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,677   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,679   copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,681   copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,683   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,684   copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,687   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,688   copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,690   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,692   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,694   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,696   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,698   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,700   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,702   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T05:31:12,704   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T05:31:12,707   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:12,708   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:12,711   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:12,714   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:12,716   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:12,718   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:12,721   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:12,724   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:12,726   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:12,728   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:12,730   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T05:31:12,732   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T05:31:12,734   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T05:31:12,737   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/compile
2025-06-08T05:31:12,738   copying build/lib/deepspeed/ops/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/compile
2025-06-08T05:31:12,741   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2025-06-08T05:31:12,742   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,744   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,745   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,747   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,749   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,751   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2025-06-08T05:31:12,752   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-08T05:31:12,754   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-08T05:31:12,756   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-08T05:31:12,757   copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-08T05:31:12,759   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-08T05:31:12,761   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-08T05:31:12,763   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-08T05:31:12,765   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/sdaa
2025-06-08T05:31:12,766   copying build/lib/deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-08T05:31:12,768   copying build/lib/deepspeed/ops/op_builder/sdaa/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-08T05:31:12,770   copying build/lib/deepspeed/ops/op_builder/sdaa/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-08T05:31:12,771   copying build/lib/deepspeed/ops/op_builder/sdaa/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-08T05:31:12,773   copying build/lib/deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-08T05:31:12,775   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,777   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,779   copying build/lib/deepspeed/ops/op_builder/dc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,780   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,783   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2025-06-08T05:31:12,784   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T05:31:12,786   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T05:31:12,787   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T05:31:12,789   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T05:31:12,791   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T05:31:12,793   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T05:31:12,795   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T05:31:12,797   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T05:31:12,799   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T05:31:12,801   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T05:31:12,803   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,804   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,806   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,808   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,810   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,812   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,814   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,816   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,818   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,820   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,822   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2025-06-08T05:31:12,823   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T05:31:12,825   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T05:31:12,827   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T05:31:12,828   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T05:31:12,830   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T05:31:12,832   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T05:31:12,834   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T05:31:12,836   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T05:31:12,838   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T05:31:12,841   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2025-06-08T05:31:12,842   copying build/lib/deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-08T05:31:12,844   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-08T05:31:12,845   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-08T05:31:12,847   copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-08T05:31:12,849   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-08T05:31:12,850   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-08T05:31:12,852   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-08T05:31:12,854   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,856   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,859   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu
2025-06-08T05:31:12,860   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-08T05:31:12,862   copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-08T05:31:12,864   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-08T05:31:12,866   copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-08T05:31:12,867   copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-08T05:31:12,869   copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-08T05:31:12,871   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,873   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,875   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,877   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T05:31:12,879   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2025-06-08T05:31:12,880   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-06-08T05:31:12,882   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-06-08T05:31:12,884   creating build/bdist.linux-armv7l/wheel/deepspeed/nvme
2025-06-08T05:31:12,885   copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T05:31:12,887   copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T05:31:12,889   copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T05:31:12,891   copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T05:31:12,893   copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T05:31:12,895   copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T05:31:12,897   copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T05:31:12,899   copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T05:31:12,901   copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T05:31:12,903   copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T05:31:12,905   copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T05:31:12,907   copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T05:31:12,909   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2025-06-08T05:31:12,910   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2025-06-08T05:31:12,913   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2025-06-08T05:31:12,914   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-08T05:31:12,916   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-08T05:31:12,918   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-08T05:31:12,920   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-08T05:31:12,922   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-08T05:31:12,925   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-08T05:31:12,927   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2025-06-08T05:31:12,928   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T05:31:12,930   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T05:31:12,932   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T05:31:12,934   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T05:31:12,937   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T05:31:12,939   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T05:31:12,941   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T05:31:12,943   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T05:31:12,945   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T05:31:12,947   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T05:31:12,949   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2025-06-08T05:31:12,950   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-08T05:31:12,953   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-08T05:31:12,954   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-08T05:31:12,956   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-08T05:31:12,958   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-08T05:31:12,960   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-08T05:31:12,962   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-08T05:31:12,963   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-08T05:31:12,966   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2025-06-08T05:31:12,967   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2025-06-08T05:31:12,968   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T05:31:12,970   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T05:31:12,972   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T05:31:12,973   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T05:31:12,975   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T05:31:12,977   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T05:31:12,979   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T05:31:12,981   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T05:31:12,983   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T05:31:12,985   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T05:31:12,987   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2025-06-08T05:31:12,988   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-08T05:31:12,990   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-08T05:31:12,992   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-08T05:31:12,994   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2025-06-08T05:31:12,996   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2025-06-08T05:31:12,997   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-06-08T05:31:12,999   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-06-08T05:31:13,001   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-08T05:31:13,003   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2025-06-08T05:31:13,004   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-08T05:31:13,006   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-08T05:31:13,008   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-08T05:31:13,010   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2025-06-08T05:31:13,011   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-08T05:31:13,014   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-08T05:31:13,016   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-08T05:31:13,018   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-08T05:31:13,021   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-08T05:31:13,022   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-08T05:31:13,025   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-08T05:31:13,028   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-08T05:31:13,030   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-08T05:31:13,033   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2025-06-08T05:31:13,034   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T05:31:13,036   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T05:31:13,039   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T05:31:13,041   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T05:31:13,043   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T05:31:13,045   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T05:31:13,047   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T05:31:13,049   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T05:31:13,051   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T05:31:13,054   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2025-06-08T05:31:13,055   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-08T05:31:13,057   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-08T05:31:13,059   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-08T05:31:13,062   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-08T05:31:13,063   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-08T05:31:13,065   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-08T05:31:13,067   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-08T05:31:13,070   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2025-06-08T05:31:13,071   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,074   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,076   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,079   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,081   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,083   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,085   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,087   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,089   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,091   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,093   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,095   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,097   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,099   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,100   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,103   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,105   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,107   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T05:31:13,110   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2025-06-08T05:31:13,111   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T05:31:13,113   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T05:31:13,116   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T05:31:13,117   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T05:31:13,119   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T05:31:13,122   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T05:31:13,123   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T05:31:13,125   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T05:31:13,128   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T05:31:13,130   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T05:31:13,132   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T05:31:13,134   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T05:31:13,136   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2025-06-08T05:31:13,137   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,139   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,142   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,143   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,145   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,147   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,149   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,152   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,154   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,156   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,158   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,160   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,162   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,164   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,166   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,169   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,172   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2025-06-08T05:31:13,173   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-08T05:31:13,175   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-08T05:31:13,177   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-08T05:31:13,179   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-08T05:31:13,181   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-08T05:31:13,183   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-08T05:31:13,185   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-08T05:31:13,187   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,189   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,191   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T05:31:13,193   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T05:31:13,197   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2025-06-08T05:31:13,197   copying build/lib/deepspeed/accelerator/sdaa_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T05:31:13,200   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T05:31:13,202   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T05:31:13,204   copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T05:31:13,206   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T05:31:13,208   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T05:31:13,210   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T05:31:13,213   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T05:31:13,215   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T05:31:13,217   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T05:31:13,219   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T05:31:13,222   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-08T05:31:13,224   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2025-06-08T05:31:13,225   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-08T05:31:13,228   copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-08T05:31:13,231   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-08T05:31:13,233   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-08T05:31:13,235   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2025-06-08T05:31:13,236   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-08T05:31:13,238   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-08T05:31:13,240   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-08T05:31:13,242   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-08T05:31:13,244   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-08T05:31:13,246   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-08T05:31:13,249   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2025-06-08T05:31:13,249   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-08T05:31:13,252   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2025-06-08T05:31:13,254   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2025-06-08T05:31:13,255   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2025-06-08T05:31:13,256   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-08T05:31:13,259   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-08T05:31:13,261   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-08T05:31:13,263   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-08T05:31:13,266   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-08T05:31:13,268   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-06-08T05:31:13,269   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-06-08T05:31:13,272   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-08T05:31:13,273   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T05:31:13,274   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T05:31:13,276   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T05:31:13,278   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T05:31:13,280   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T05:31:13,282   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T05:31:13,284   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-06-08T05:31:13,286   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-08T05:31:13,287   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-08T05:31:13,288   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-06-08T05:31:13,291   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T05:31:13,292   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T05:31:13,294   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T05:31:13,295   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T05:31:13,297   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T05:31:13,299   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T05:31:13,301   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T05:31:13,304   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2025-06-08T05:31:13,305   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T05:31:13,306   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T05:31:13,308   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T05:31:13,310   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T05:31:13,312   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T05:31:13,314   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T05:31:13,317   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T05:31:13,317   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T05:31:13,319   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T05:31:13,321   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T05:31:13,324   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T05:31:13,326   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T05:31:13,328   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T05:31:13,330   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T05:31:13,332   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-06-08T05:31:13,334   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-06-08T05:31:13,336   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T05:31:13,337   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T05:31:13,340   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T05:31:13,342   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T05:31:13,344   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T05:31:13,347   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T05:31:13,348   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T05:31:13,350   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T05:31:13,352   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T05:31:13,354   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T05:31:13,356   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T05:31:13,359   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:13,360   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:13,362   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:13,364   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:13,367   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:13,369   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:13,370   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:13,372   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:13,374   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T05:31:13,376   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T05:31:13,378   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:13,379   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:13,381   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:13,383   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:13,385   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:13,387   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:13,390   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:13,391   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:13,394   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:13,396   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T05:31:13,398   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T05:31:13,400   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T05:31:13,401   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T05:31:13,403   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T05:31:13,405   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T05:31:13,408   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T05:31:13,411   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2025-06-08T05:31:13,412   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T05:31:13,413   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T05:31:13,416   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T05:31:13,418   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T05:31:13,419   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T05:31:13,421   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T05:31:13,423   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T05:31:13,425   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T05:31:13,426   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T05:31:13,428   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T05:31:13,430   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T05:31:13,432   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T05:31:13,434   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T05:31:13,436   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T05:31:13,438   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-08T05:31:13,439   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-08T05:31:13,441   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T05:31:13,442   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T05:31:13,444   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T05:31:13,446   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T05:31:13,448   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T05:31:13,450   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T05:31:13,451   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T05:31:13,453   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T05:31:13,454   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T05:31:13,456   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T05:31:13,458   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T05:31:13,460   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T05:31:13,462   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-06-08T05:31:13,464   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T05:31:13,465   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T05:31:13,467   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T05:31:13,469   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T05:31:13,471   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T05:31:13,473   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T05:31:13,475   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T05:31:13,477   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-08T05:31:13,478   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-08T05:31:13,480   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-08T05:31:13,482   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-08T05:31:13,484   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:13,485   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:13,487   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:13,490   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:13,492   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:13,493   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:13,496   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:13,497   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:13,499   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T05:31:13,501   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T05:31:13,502   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T05:31:13,504   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T05:31:13,506   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T05:31:13,508   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T05:31:13,510   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T05:31:13,512   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T05:31:13,514   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T05:31:13,515   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T05:31:13,517   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T05:31:13,519   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T05:31:13,521   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T05:31:13,523   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T05:31:13,525   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T05:31:13,527   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-06-08T05:31:13,529   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2025-06-08T05:31:13,530   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-08T05:31:13,532   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-08T05:31:13,533   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-08T05:31:13,535   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-08T05:31:13,538   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2025-06-08T05:31:13,539   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T05:31:13,540   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T05:31:13,542   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T05:31:13,544   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T05:31:13,546   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T05:31:13,549   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T05:31:13,550   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T05:31:13,552   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T05:31:13,553   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T05:31:13,555   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T05:31:13,558   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:13,559   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:13,561   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:13,564   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:13,566   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:13,568   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:13,570   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:13,571   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:13,573   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:13,575   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T05:31:13,577   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-08T05:31:13,579   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-08T05:31:13,581   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T05:31:13,582   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T05:31:13,584   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T05:31:13,586   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T05:31:13,587   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T05:31:13,590   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2025-06-08T05:31:13,591   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-08T05:31:13,593   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-08T05:31:13,595   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-08T05:31:13,597   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-08T05:31:13,599   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2025-06-08T05:31:13,600   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-08T05:31:13,602   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-08T05:31:13,604   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-08T05:31:13,606   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-08T05:31:13,609   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:13,610   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:13,612   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:13,613   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:13,615   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:13,617   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:13,618   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:13,620   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:13,622   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:13,624   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T05:31:13,626   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-08T05:31:13,628   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-08T05:31:13,630   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-08T05:31:13,632   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-08T05:31:13,635   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2025-06-08T05:31:13,638   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-08T05:31:13,640   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-08T05:31:13,642   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-08T05:31:13,644   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-08T05:31:13,647   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2025-06-08T05:31:13,648   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-08T05:31:13,650   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-08T05:31:13,652   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-08T05:31:13,653   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-08T05:31:13,656   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2025-06-08T05:31:13,657   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-08T05:31:13,659   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-08T05:31:13,661   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-08T05:31:13,662   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-08T05:31:13,665   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-08T05:31:13,668   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2025-06-08T05:31:13,669   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-08T05:31:13,670   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-08T05:31:13,672   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-08T05:31:13,674   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-08T05:31:13,677   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T05:31:13,678   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T05:31:13,680   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T05:31:13,682   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T05:31:13,684   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T05:31:13,686   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T05:31:13,688   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T05:31:13,690   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T05:31:13,692   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T05:31:13,694   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2025-06-08T05:31:13,695   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-08T05:31:13,698   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2025-06-08T05:31:13,699   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-08T05:31:13,701   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-08T05:31:13,702   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-08T05:31:13,704   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-08T05:31:13,706   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-08T05:31:13,708   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-08T05:31:13,709   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-08T05:31:13,712   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2025-06-08T05:31:13,713   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2025-06-08T05:31:13,714   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-06-08T05:31:13,716   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-06-08T05:31:13,719   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2025-06-08T05:31:13,720   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-06-08T05:31:13,722   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-06-08T05:31:13,724   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2025-06-08T05:31:13,726   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-08T05:31:13,727   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-06-08T05:31:13,729   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-06-08T05:31:13,731   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-08T05:31:13,732   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-08T05:31:13,734   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-08T05:31:13,736   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-08T05:31:13,738   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2025-06-08T05:31:13,739   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-06-08T05:31:13,742   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-06-08T05:31:13,744   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2025-06-08T05:31:13,745   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-08T05:31:13,747   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-08T05:31:13,748   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-08T05:31:13,751   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2025-06-08T05:31:13,752   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-06-08T05:31:13,755   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-06-08T05:31:13,756   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-08T05:31:13,758   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-08T05:31:13,761   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:13,762   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:13,764   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:13,765   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:13,767   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:13,769   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:13,771   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:13,773   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:13,775   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-08T05:31:13,777   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-08T05:31:13,779   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T05:31:13,781   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T05:31:13,783   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T05:31:13,785   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T05:31:13,787   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2025-06-08T05:31:13,789   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2025-06-08T05:31:13,790   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2025-06-08T05:31:13,792   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-08T05:31:13,795   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2025-06-08T05:31:13,796   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-06-08T05:31:13,798   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-06-08T05:31:13,799   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-08T05:31:13,801   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-08T05:31:13,803   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-08T05:31:13,805   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-08T05:31:13,808   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-08T05:31:13,810   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-08T05:31:13,812   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T05:31:13,814   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2025-06-08T05:31:13,815   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-08T05:31:13,817   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-08T05:31:13,819   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-08T05:31:13,822   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-08T05:31:13,823   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-08T05:31:13,826   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-08T05:31:13,827   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-08T05:31:13,830   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2025-06-08T05:31:13,831   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-08T05:31:13,834   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2025-06-08T05:31:13,835   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-06-08T05:31:13,838   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-06-08T05:31:13,840   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-08T05:31:13,841   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-08T05:31:13,843   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-08T05:31:13,845   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2025-06-08T05:31:13,846   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-08T05:31:13,848   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-08T05:31:13,849   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-08T05:31:13,851   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-08T05:31:13,853   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-08T05:31:13,856   creating build/bdist.linux-armv7l/wheel/deepspeed/compile
2025-06-08T05:31:13,857   copying build/lib/deepspeed/compile/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T05:31:13,859   copying build/lib/deepspeed/compile/patch_compiled_func.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T05:31:13,861   copying build/lib/deepspeed/compile/init_z3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T05:31:13,863   copying build/lib/deepspeed/compile/fx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T05:31:13,865   copying build/lib/deepspeed/compile/graph_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T05:31:13,867   copying build/lib/deepspeed/compile/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T05:31:13,869   copying build/lib/deepspeed/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T05:31:13,871   creating build/bdist.linux-armv7l/wheel/deepspeed/compile/profilers
2025-06-08T05:31:13,872   copying build/lib/deepspeed/compile/profilers/comm_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-08T05:31:13,875   copying build/lib/deepspeed/compile/profilers/graph_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-08T05:31:13,877   copying build/lib/deepspeed/compile/profilers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-08T05:31:13,879   copying build/lib/deepspeed/compile/patch_fake_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T05:31:13,881   copying build/lib/deepspeed/compile/inductor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T05:31:13,883   creating build/bdist.linux-armv7l/wheel/deepspeed/compile/passes
2025-06-08T05:31:13,885   copying build/lib/deepspeed/compile/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-08T05:31:13,886   copying build/lib/deepspeed/compile/passes/zero3_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-08T05:31:13,889   copying build/lib/deepspeed/compile/passes/prefetch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-08T05:31:13,891   copying build/lib/deepspeed/compile/passes/offload_adam_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-08T05:31:13,894   copying build/lib/deepspeed/compile/passes/offload_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-08T05:31:13,896   copying build/lib/deepspeed/compile/passes/offload_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-08T05:31:13,898   copying build/lib/deepspeed/compile/passes/zero1_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-08T05:31:13,900   copying build/lib/deepspeed/compile/passes/selective_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-08T05:31:13,902   copying build/lib/deepspeed/compile/list_schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T05:31:13,904   copying build/lib/deepspeed/compile/partitioner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T05:31:13,906   copying build/lib/deepspeed/compile/util.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T05:31:13,909   copying build/lib/deepspeed/compile/init_z1.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T05:31:13,911   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2025-06-08T05:31:13,912   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:13,915   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:13,917   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:13,921   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2025-06-08T05:31:13,921   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-08T05:31:13,923   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-08T05:31:13,926   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-08T05:31:13,928   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-08T05:31:13,931   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-08T05:31:13,934   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-08T05:31:13,937   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2025-06-08T05:31:13,938   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-08T05:31:13,941   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-08T05:31:13,943   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-08T05:31:13,945   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-08T05:31:13,948   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2025-06-08T05:31:13,949   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-08T05:31:13,951   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-08T05:31:13,953   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-08T05:31:13,955   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-08T05:31:13,957   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-08T05:31:13,960   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T05:31:13,961   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T05:31:13,964   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T05:31:13,966   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T05:31:13,968   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T05:31:13,971   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T05:31:13,973   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T05:31:13,975   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:13,977   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:13,980   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:13,983   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2025-06-08T05:31:13,984   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-08T05:31:13,986   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-08T05:31:13,988   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-08T05:31:13,989   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-08T05:31:13,992   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino
2025-06-08T05:31:13,993   copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-08T05:31:13,996   copying build/lib/deepspeed/runtime/domino/async_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-08T05:31:13,998   copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-08T05:31:14,000   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2025-06-08T05:31:14,001   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-06-08T05:31:14,003   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-06-08T05:31:14,005   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:14,008   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2025-06-08T05:31:14,009   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-08T05:31:14,011   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-08T05:31:14,013   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-08T05:31:14,015   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-08T05:31:14,017   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-08T05:31:14,019   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-08T05:31:14,021   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:14,023   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:14,026   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:14,027   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:14,030   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2025-06-08T05:31:14,031   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T05:31:14,033   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T05:31:14,035   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T05:31:14,038   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T05:31:14,040   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T05:31:14,042   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T05:31:14,045   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T05:31:14,046   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T05:31:14,049   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T05:31:14,051   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/tensor_parallel
2025-06-08T05:31:14,052   copying build/lib/deepspeed/runtime/tensor_parallel/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-08T05:31:14,054   copying build/lib/deepspeed/runtime/tensor_parallel/tp_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-08T05:31:14,056   copying build/lib/deepspeed/runtime/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-08T05:31:14,058   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:14,061   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2025-06-08T05:31:14,062   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-08T05:31:14,064   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-08T05:31:14,065   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-08T05:31:14,069   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:14,075   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:14,077   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:14,080   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:14,083   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:14,085   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T05:31:14,087   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2025-06-08T05:31:14,088   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-08T05:31:14,091   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-08T05:31:14,093   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2025-06-08T05:31:14,094   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-08T05:31:14,096   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-08T05:31:14,098   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-08T05:31:14,101   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-08T05:31:14,104   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-08T05:31:14,106   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-08T05:31:14,109   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2025-06-08T05:31:14,110   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T05:31:14,114   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T05:31:14,116   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T05:31:14,118   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T05:31:14,120   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T05:31:14,122   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T05:31:14,124   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T05:31:14,126   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T05:31:14,129   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T05:31:14,134   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T05:31:14,136   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T05:31:14,141   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T05:31:14,144   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T05:31:14,146   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T05:31:14,148   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T05:31:14,151   copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T05:31:14,153   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T05:31:14,156   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2025-06-08T05:31:14,158   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-08T05:31:14,160   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-08T05:31:14,162   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-08T05:31:14,164   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-08T05:31:14,166   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2025-06-08T05:31:14,167   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-08T05:31:14,169   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-08T05:31:14,171   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-08T05:31:14,173   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-08T05:31:14,174   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-08T05:31:14,178   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2025-06-08T05:31:14,179   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-08T05:31:14,181   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-08T05:31:14,182   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-08T05:31:14,184   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-08T05:31:14,186   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-08T05:31:14,188   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-08T05:31:14,190   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-08T05:31:14,192   running install_egg_info
2025-06-08T05:31:14,226   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.16.8-py3.11.egg-info
2025-06-08T05:31:14,241   running install_scripts
2025-06-08T05:31:14,242   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts
2025-06-08T05:31:14,243   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts
2025-06-08T05:31:14,245   copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts
2025-06-08T05:31:14,247   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts
2025-06-08T05:31:14,249   copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts
2025-06-08T05:31:14,251   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts
2025-06-08T05:31:14,253   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts
2025-06-08T05:31:14,255   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts
2025-06-08T05:31:14,257   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts
2025-06-08T05:31:14,259   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts
2025-06-08T05:31:14,261   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts
2025-06-08T05:31:14,262   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts/dsr to 755
2025-06-08T05:31:14,263   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts/ds_io to 755
2025-06-08T05:31:14,263   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts/deepspeed.pt to 755
2025-06-08T05:31:14,264   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts/ds_nvme_tune to 755
2025-06-08T05:31:14,264   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts/ds_bench to 755
2025-06-08T05:31:14,265   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts/ds_elastic to 755
2025-06-08T05:31:14,265   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts/ds_ssh to 755
2025-06-08T05:31:14,266   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts/ds to 755
2025-06-08T05:31:14,266   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts/deepspeed to 755
2025-06-08T05:31:14,267   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.data/scripts/ds_report to 755
2025-06-08T05:31:14,280   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.8.dist-info/WHEEL
2025-06-08T05:31:14,282   creating '/tmp/pip-wheel-fjxcrjjz/deepspeed-0.16.8-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2025-06-08T05:31:14,286   adding 'deepspeed/__init__.py'
2025-06-08T05:31:14,287   adding 'deepspeed/constants.py'
2025-06-08T05:31:14,289   adding 'deepspeed/env_report.py'
2025-06-08T05:31:14,290   adding 'deepspeed/git_version_info.py'
2025-06-08T05:31:14,292   adding 'deepspeed/git_version_info_installed.py'
2025-06-08T05:31:14,293   adding 'deepspeed/accelerator/__init__.py'
2025-06-08T05:31:14,294   adding 'deepspeed/accelerator/abstract_accelerator.py'
2025-06-08T05:31:14,296   adding 'deepspeed/accelerator/cpu_accelerator.py'
2025-06-08T05:31:14,298   adding 'deepspeed/accelerator/cuda_accelerator.py'
2025-06-08T05:31:14,300   adding 'deepspeed/accelerator/hpu_accelerator.py'
2025-06-08T05:31:14,302   adding 'deepspeed/accelerator/mlu_accelerator.py'
2025-06-08T05:31:14,303   adding 'deepspeed/accelerator/mps_accelerator.py'
2025-06-08T05:31:14,305   adding 'deepspeed/accelerator/npu_accelerator.py'
2025-06-08T05:31:14,307   adding 'deepspeed/accelerator/real_accelerator.py'
2025-06-08T05:31:14,309   adding 'deepspeed/accelerator/sdaa_accelerator.py'
2025-06-08T05:31:14,311   adding 'deepspeed/accelerator/xpu_accelerator.py'
2025-06-08T05:31:14,312   adding 'deepspeed/autotuning/__init__.py'
2025-06-08T05:31:14,318   adding 'deepspeed/autotuning/autotuner.py'
2025-06-08T05:31:14,319   adding 'deepspeed/autotuning/config.py'
2025-06-08T05:31:14,321   adding 'deepspeed/autotuning/constants.py'
2025-06-08T05:31:14,323   adding 'deepspeed/autotuning/scheduler.py'
2025-06-08T05:31:14,325   adding 'deepspeed/autotuning/utils.py'
2025-06-08T05:31:14,327   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2025-06-08T05:31:14,329   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2025-06-08T05:31:14,330   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2025-06-08T05:31:14,331   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2025-06-08T05:31:14,333   adding 'deepspeed/autotuning/tuner/__init__.py'
2025-06-08T05:31:14,334   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2025-06-08T05:31:14,336   adding 'deepspeed/autotuning/tuner/cost_model.py'
2025-06-08T05:31:14,337   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2025-06-08T05:31:14,338   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2025-06-08T05:31:14,340   adding 'deepspeed/autotuning/tuner/utils.py'
2025-06-08T05:31:14,342   adding 'deepspeed/checkpoint/__init__.py'
2025-06-08T05:31:14,343   adding 'deepspeed/checkpoint/constants.py'
2025-06-08T05:31:14,345   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2025-06-08T05:31:14,348   adding 'deepspeed/checkpoint/ds_to_universal.py'
2025-06-08T05:31:14,349   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2025-06-08T05:31:14,351   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2025-06-08T05:31:14,352   adding 'deepspeed/checkpoint/reshape_utils.py'
2025-06-08T05:31:14,354   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2025-06-08T05:31:14,355   adding 'deepspeed/checkpoint/utils.py'
2025-06-08T05:31:14,357   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2025-06-08T05:31:14,358   adding 'deepspeed/comm/__init__.py'
2025-06-08T05:31:14,360   adding 'deepspeed/comm/backend.py'
2025-06-08T05:31:14,361   adding 'deepspeed/comm/ccl.py'
2025-06-08T05:31:14,364   adding 'deepspeed/comm/comm.py'
2025-06-08T05:31:14,366   adding 'deepspeed/comm/config.py'
2025-06-08T05:31:14,367   adding 'deepspeed/comm/constants.py'
2025-06-08T05:31:14,368   adding 'deepspeed/comm/reduce_op.py'
2025-06-08T05:31:14,371   adding 'deepspeed/comm/torch.py'
2025-06-08T05:31:14,372   adding 'deepspeed/comm/utils.py'
2025-06-08T05:31:14,374   adding 'deepspeed/compile/__init__.py'
2025-06-08T05:31:14,376   adding 'deepspeed/compile/backend.py'
2025-06-08T05:31:14,378   adding 'deepspeed/compile/config.py'
2025-06-08T05:31:14,379   adding 'deepspeed/compile/fx.py'
2025-06-08T05:31:14,381   adding 'deepspeed/compile/graph_param.py'
2025-06-08T05:31:14,382   adding 'deepspeed/compile/inductor.py'
2025-06-08T05:31:14,384   adding 'deepspeed/compile/init_z1.py'
2025-06-08T05:31:14,385   adding 'deepspeed/compile/init_z3.py'
2025-06-08T05:31:14,387   adding 'deepspeed/compile/list_schedule.py'
2025-06-08T05:31:14,389   adding 'deepspeed/compile/partitioner.py'
2025-06-08T05:31:14,390   adding 'deepspeed/compile/patch_compiled_func.py'
2025-06-08T05:31:14,392   adding 'deepspeed/compile/patch_fake_tensor.py'
2025-06-08T05:31:14,394   adding 'deepspeed/compile/util.py'
2025-06-08T05:31:14,396   adding 'deepspeed/compile/passes/__init__.py'
2025-06-08T05:31:14,397   adding 'deepspeed/compile/passes/offload_activation.py'
2025-06-08T05:31:14,399   adding 'deepspeed/compile/passes/offload_adam_states.py'
2025-06-08T05:31:14,401   adding 'deepspeed/compile/passes/offload_parameters.py'
2025-06-08T05:31:14,402   adding 'deepspeed/compile/passes/prefetch.py'
2025-06-08T05:31:14,404   adding 'deepspeed/compile/passes/selective_gather.py'
2025-06-08T05:31:14,405   adding 'deepspeed/compile/passes/zero1_compile.py'
2025-06-08T05:31:14,407   adding 'deepspeed/compile/passes/zero3_compile.py'
2025-06-08T05:31:14,409   adding 'deepspeed/compile/profilers/__init__.py'
2025-06-08T05:31:14,410   adding 'deepspeed/compile/profilers/comm_profile.py'
2025-06-08T05:31:14,412   adding 'deepspeed/compile/profilers/graph_profile.py'
2025-06-08T05:31:14,414   adding 'deepspeed/compression/__init__.py'
2025-06-08T05:31:14,417   adding 'deepspeed/compression/basic_layer.py'
2025-06-08T05:31:14,419   adding 'deepspeed/compression/compress.py'
2025-06-08T05:31:14,421   adding 'deepspeed/compression/config.py'
2025-06-08T05:31:14,423   adding 'deepspeed/compression/constants.py'
2025-06-08T05:31:14,425   adding 'deepspeed/compression/helper.py'
2025-06-08T05:31:14,427   adding 'deepspeed/compression/scheduler.py'
2025-06-08T05:31:14,428   adding 'deepspeed/compression/utils.py'
2025-06-08T05:31:14,430   adding 'deepspeed/elasticity/__init__.py'
2025-06-08T05:31:14,432   adding 'deepspeed/elasticity/config.py'
2025-06-08T05:31:14,433   adding 'deepspeed/elasticity/constants.py'
2025-06-08T05:31:14,435   adding 'deepspeed/elasticity/elastic_agent.py'
2025-06-08T05:31:14,438   adding 'deepspeed/elasticity/elasticity.py'
2025-06-08T05:31:14,439   adding 'deepspeed/elasticity/utils.py'
2025-06-08T05:31:14,441   adding 'deepspeed/inference/__init__.py'
2025-06-08T05:31:14,443   adding 'deepspeed/inference/config.py'
2025-06-08T05:31:14,447   adding 'deepspeed/inference/engine.py'
2025-06-08T05:31:14,448   adding 'deepspeed/inference/quantization/__init__.py'
2025-06-08T05:31:14,450   adding 'deepspeed/inference/quantization/layers.py'
2025-06-08T05:31:14,451   adding 'deepspeed/inference/quantization/quantization.py'
2025-06-08T05:31:14,453   adding 'deepspeed/inference/quantization/quantization_context.py'
2025-06-08T05:31:14,454   adding 'deepspeed/inference/quantization/utils.py'
2025-06-08T05:31:14,456   adding 'deepspeed/inference/v2/__init__.py'
2025-06-08T05:31:14,457   adding 'deepspeed/inference/v2/allocator.py'
2025-06-08T05:31:14,459   adding 'deepspeed/inference/v2/config_v2.py'
2025-06-08T05:31:14,460   adding 'deepspeed/inference/v2/engine_factory.py'
2025-06-08T05:31:14,462   adding 'deepspeed/inference/v2/engine_v2.py'
2025-06-08T05:31:14,463   adding 'deepspeed/inference/v2/inference_parameter.py'
2025-06-08T05:31:14,465   adding 'deepspeed/inference/v2/inference_utils.py'
2025-06-08T05:31:14,466   adding 'deepspeed/inference/v2/logging.py'
2025-06-08T05:31:14,467   adding 'deepspeed/inference/v2/scheduling_utils.py'
2025-06-08T05:31:14,469   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2025-06-08T05:31:14,470   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2025-06-08T05:31:14,471   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2025-06-08T05:31:14,473   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2025-06-08T05:31:14,474   adding 'deepspeed/inference/v2/kernels/__init__.py'
2025-06-08T05:31:14,476   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2025-06-08T05:31:14,477   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2025-06-08T05:31:14,478   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2025-06-08T05:31:14,480   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2025-06-08T05:31:14,481   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2025-06-08T05:31:14,483   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2025-06-08T05:31:14,484   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2025-06-08T05:31:14,485   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2025-06-08T05:31:14,487   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2025-06-08T05:31:14,488   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2025-06-08T05:31:14,490   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2025-06-08T05:31:14,491   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2025-06-08T05:31:14,493   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2025-06-08T05:31:14,494   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2025-06-08T05:31:14,496   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2025-06-08T05:31:14,497   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2025-06-08T05:31:14,498   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2025-06-08T05:31:14,500   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2025-06-08T05:31:14,501   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2025-06-08T05:31:14,503   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2025-06-08T05:31:14,506   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2025-06-08T05:31:14,507   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2025-06-08T05:31:14,509   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2025-06-08T05:31:14,510   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2025-06-08T05:31:14,512   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2025-06-08T05:31:14,513   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2025-06-08T05:31:14,515   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2025-06-08T05:31:14,517   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2025-06-08T05:31:14,518   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2025-06-08T05:31:14,520   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2025-06-08T05:31:14,521   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2025-06-08T05:31:14,523   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2025-06-08T05:31:14,524   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2025-06-08T05:31:14,525   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2025-06-08T05:31:14,527   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2025-06-08T05:31:14,529   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2025-06-08T05:31:14,530   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2025-06-08T05:31:14,531   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2025-06-08T05:31:14,533   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2025-06-08T05:31:14,534   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2025-06-08T05:31:14,535   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2025-06-08T05:31:14,537   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2025-06-08T05:31:14,538   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2025-06-08T05:31:14,540   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2025-06-08T05:31:14,541   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2025-06-08T05:31:14,542   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2025-06-08T05:31:14,544   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2025-06-08T05:31:14,546   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2025-06-08T05:31:14,547   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2025-06-08T05:31:14,548   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2025-06-08T05:31:14,550   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2025-06-08T05:31:14,551   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2025-06-08T05:31:14,552   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2025-06-08T05:31:14,554   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2025-06-08T05:31:14,556   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2025-06-08T05:31:14,557   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2025-06-08T05:31:14,559   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2025-06-08T05:31:14,560   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2025-06-08T05:31:14,561   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2025-06-08T05:31:14,563   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2025-06-08T05:31:14,564   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2025-06-08T05:31:14,566   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2025-06-08T05:31:14,568   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2025-06-08T05:31:14,569   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2025-06-08T05:31:14,571   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2025-06-08T05:31:14,574   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2025-06-08T05:31:14,576   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2025-06-08T05:31:14,577   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2025-06-08T05:31:14,579   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2025-06-08T05:31:14,580   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2025-06-08T05:31:14,581   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2025-06-08T05:31:14,582   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2025-06-08T05:31:14,584   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2025-06-08T05:31:14,585   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2025-06-08T05:31:14,586   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2025-06-08T05:31:14,588   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2025-06-08T05:31:14,589   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2025-06-08T05:31:14,590   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2025-06-08T05:31:14,592   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2025-06-08T05:31:14,593   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2025-06-08T05:31:14,594   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2025-06-08T05:31:14,595   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2025-06-08T05:31:14,597   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2025-06-08T05:31:14,598   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2025-06-08T05:31:14,600   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2025-06-08T05:31:14,602   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2025-06-08T05:31:14,603   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2025-06-08T05:31:14,604   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2025-06-08T05:31:14,606   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2025-06-08T05:31:14,607   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2025-06-08T05:31:14,609   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2025-06-08T05:31:14,611   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2025-06-08T05:31:14,612   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2025-06-08T05:31:14,614   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2025-06-08T05:31:14,615   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2025-06-08T05:31:14,616   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2025-06-08T05:31:14,617   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2025-06-08T05:31:14,619   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2025-06-08T05:31:14,620   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2025-06-08T05:31:14,622   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2025-06-08T05:31:14,623   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2025-06-08T05:31:14,624   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2025-06-08T05:31:14,626   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2025-06-08T05:31:14,627   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2025-06-08T05:31:14,628   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2025-06-08T05:31:14,630   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2025-06-08T05:31:14,631   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2025-06-08T05:31:14,632   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2025-06-08T05:31:14,634   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2025-06-08T05:31:14,635   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2025-06-08T05:31:14,636   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2025-06-08T05:31:14,638   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2025-06-08T05:31:14,639   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2025-06-08T05:31:14,641   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2025-06-08T05:31:14,642   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2025-06-08T05:31:14,643   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2025-06-08T05:31:14,644   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2025-06-08T05:31:14,646   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2025-06-08T05:31:14,647   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2025-06-08T05:31:14,648   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2025-06-08T05:31:14,650   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2025-06-08T05:31:14,652   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2025-06-08T05:31:14,654   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2025-06-08T05:31:14,655   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2025-06-08T05:31:14,658   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2025-06-08T05:31:14,660   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2025-06-08T05:31:14,662   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2025-06-08T05:31:14,664   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2025-06-08T05:31:14,665   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2025-06-08T05:31:14,666   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2025-06-08T05:31:14,668   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2025-06-08T05:31:14,669   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2025-06-08T05:31:14,670   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2025-06-08T05:31:14,671   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2025-06-08T05:31:14,673   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2025-06-08T05:31:14,674   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2025-06-08T05:31:14,676   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2025-06-08T05:31:14,677   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2025-06-08T05:31:14,679   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2025-06-08T05:31:14,680   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2025-06-08T05:31:14,682   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2025-06-08T05:31:14,683   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2025-06-08T05:31:14,684   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2025-06-08T05:31:14,685   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2025-06-08T05:31:14,687   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2025-06-08T05:31:14,688   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2025-06-08T05:31:14,690   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2025-06-08T05:31:14,691   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2025-06-08T05:31:14,693   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2025-06-08T05:31:14,694   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2025-06-08T05:31:14,695   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2025-06-08T05:31:14,697   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2025-06-08T05:31:14,699   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2025-06-08T05:31:14,700   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2025-06-08T05:31:14,702   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2025-06-08T05:31:14,703   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2025-06-08T05:31:14,705   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2025-06-08T05:31:14,706   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2025-06-08T05:31:14,708   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2025-06-08T05:31:14,709   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2025-06-08T05:31:14,711   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2025-06-08T05:31:14,712   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2025-06-08T05:31:14,714   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2025-06-08T05:31:14,716   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2025-06-08T05:31:14,717   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2025-06-08T05:31:14,719   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2025-06-08T05:31:14,720   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2025-06-08T05:31:14,722   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2025-06-08T05:31:14,723   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2025-06-08T05:31:14,725   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2025-06-08T05:31:14,726   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2025-06-08T05:31:14,727   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2025-06-08T05:31:14,729   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2025-06-08T05:31:14,730   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2025-06-08T05:31:14,732   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2025-06-08T05:31:14,734   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2025-06-08T05:31:14,735   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2025-06-08T05:31:14,737   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2025-06-08T05:31:14,738   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2025-06-08T05:31:14,739   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2025-06-08T05:31:14,741   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2025-06-08T05:31:14,742   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2025-06-08T05:31:14,743   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2025-06-08T05:31:14,745   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2025-06-08T05:31:14,746   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2025-06-08T05:31:14,748   adding 'deepspeed/inference/v2/modules/__init__.py'
2025-06-08T05:31:14,749   adding 'deepspeed/inference/v2/modules/ds_module.py'
2025-06-08T05:31:14,750   adding 'deepspeed/inference/v2/modules/heuristics.py'
2025-06-08T05:31:14,752   adding 'deepspeed/inference/v2/modules/module_registry.py'
2025-06-08T05:31:14,753   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2025-06-08T05:31:14,754   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2025-06-08T05:31:14,756   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2025-06-08T05:31:14,757   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2025-06-08T05:31:14,758   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2025-06-08T05:31:14,759   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2025-06-08T05:31:14,760   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2025-06-08T05:31:14,762   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2025-06-08T05:31:14,763   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2025-06-08T05:31:14,765   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2025-06-08T05:31:14,767   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2025-06-08T05:31:14,768   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2025-06-08T05:31:14,770   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2025-06-08T05:31:14,771   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2025-06-08T05:31:14,773   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2025-06-08T05:31:14,774   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2025-06-08T05:31:14,776   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2025-06-08T05:31:14,778   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2025-06-08T05:31:14,779   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2025-06-08T05:31:14,781   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2025-06-08T05:31:14,782   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2025-06-08T05:31:14,784   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2025-06-08T05:31:14,785   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2025-06-08T05:31:14,787   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2025-06-08T05:31:14,788   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2025-06-08T05:31:14,790   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2025-06-08T05:31:14,791   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2025-06-08T05:31:14,792   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2025-06-08T05:31:14,794   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2025-06-08T05:31:14,795   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2025-06-08T05:31:14,796   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2025-06-08T05:31:14,798   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2025-06-08T05:31:14,799   adding 'deepspeed/inference/v2/ragged/__init__.py'
2025-06-08T05:31:14,801   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2025-06-08T05:31:14,802   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2025-06-08T05:31:14,804   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2025-06-08T05:31:14,806   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2025-06-08T05:31:14,808   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2025-06-08T05:31:14,810   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2025-06-08T05:31:14,811   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2025-06-08T05:31:14,812   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2025-06-08T05:31:14,814   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2025-06-08T05:31:14,816   adding 'deepspeed/launcher/__init__.py'
2025-06-08T05:31:14,817   adding 'deepspeed/launcher/constants.py'
2025-06-08T05:31:14,819   adding 'deepspeed/launcher/launch.py'
2025-06-08T05:31:14,820   adding 'deepspeed/launcher/launcher_helper.py'
2025-06-08T05:31:14,822   adding 'deepspeed/launcher/multinode_runner.py'
2025-06-08T05:31:14,825   adding 'deepspeed/launcher/runner.py'
2025-06-08T05:31:14,827   adding 'deepspeed/linear/__init__.py'
2025-06-08T05:31:14,828   adding 'deepspeed/linear/config.py'
2025-06-08T05:31:14,830   adding 'deepspeed/linear/context_manager.py'
2025-06-08T05:31:14,831   adding 'deepspeed/linear/optimized_linear.py'
2025-06-08T05:31:14,833   adding 'deepspeed/linear/quantization.py'
2025-06-08T05:31:14,834   adding 'deepspeed/model_implementations/__init__.py'
2025-06-08T05:31:14,836   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2025-06-08T05:31:14,837   adding 'deepspeed/model_implementations/diffusers/unet.py'
2025-06-08T05:31:14,838   adding 'deepspeed/model_implementations/diffusers/vae.py'
2025-06-08T05:31:14,840   adding 'deepspeed/model_implementations/features/__init__.py'
2025-06-08T05:31:14,841   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2025-06-08T05:31:14,843   adding 'deepspeed/model_implementations/transformers/__init__.py'
2025-06-08T05:31:14,844   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2025-06-08T05:31:14,845   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2025-06-08T05:31:14,847   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2025-06-08T05:31:14,848   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2025-06-08T05:31:14,849   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2025-06-08T05:31:14,850   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2025-06-08T05:31:14,851   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2025-06-08T05:31:14,853   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2025-06-08T05:31:14,854   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2025-06-08T05:31:14,856   adding 'deepspeed/module_inject/__init__.py'
2025-06-08T05:31:14,859   adding 'deepspeed/module_inject/auto_tp.py'
2025-06-08T05:31:14,861   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2025-06-08T05:31:14,862   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2025-06-08T05:31:14,864   adding 'deepspeed/module_inject/inject.py'
2025-06-08T05:31:14,867   adding 'deepspeed/module_inject/layers.py'
2025-06-08T05:31:14,869   adding 'deepspeed/module_inject/load_checkpoint.py'
2025-06-08T05:31:14,871   adding 'deepspeed/module_inject/module_quantize.py'
2025-06-08T05:31:14,872   adding 'deepspeed/module_inject/policy.py'
2025-06-08T05:31:14,876   adding 'deepspeed/module_inject/replace_module.py'
2025-06-08T05:31:14,877   adding 'deepspeed/module_inject/replace_policy.py'
2025-06-08T05:31:14,879   adding 'deepspeed/module_inject/tp_shard.py'
2025-06-08T05:31:14,880   adding 'deepspeed/module_inject/utils.py'
2025-06-08T05:31:14,882   adding 'deepspeed/module_inject/containers/__init__.py'
2025-06-08T05:31:14,884   adding 'deepspeed/module_inject/containers/base.py'
2025-06-08T05:31:14,885   adding 'deepspeed/module_inject/containers/base_moe.py'
2025-06-08T05:31:14,887   adding 'deepspeed/module_inject/containers/bert.py'
2025-06-08T05:31:14,888   adding 'deepspeed/module_inject/containers/bloom.py'
2025-06-08T05:31:14,890   adding 'deepspeed/module_inject/containers/clip.py'
2025-06-08T05:31:14,891   adding 'deepspeed/module_inject/containers/distil_bert.py'
2025-06-08T05:31:14,892   adding 'deepspeed/module_inject/containers/gpt2.py'
2025-06-08T05:31:14,894   adding 'deepspeed/module_inject/containers/gptj.py'
2025-06-08T05:31:14,895   adding 'deepspeed/module_inject/containers/gptneo.py'
2025-06-08T05:31:14,897   adding 'deepspeed/module_inject/containers/gptneox.py'
2025-06-08T05:31:14,898   adding 'deepspeed/module_inject/containers/internlm.py'
2025-06-08T05:31:14,899   adding 'deepspeed/module_inject/containers/llama.py'
2025-06-08T05:31:14,901   adding 'deepspeed/module_inject/containers/llama2.py'
2025-06-08T05:31:14,902   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2025-06-08T05:31:14,903   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2025-06-08T05:31:14,905   adding 'deepspeed/module_inject/containers/opt.py'
2025-06-08T05:31:14,906   adding 'deepspeed/module_inject/containers/unet.py'
2025-06-08T05:31:14,907   adding 'deepspeed/module_inject/containers/vae.py'
2025-06-08T05:31:14,909   adding 'deepspeed/module_inject/containers/features/__init__.py'
2025-06-08T05:31:14,910   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2025-06-08T05:31:14,912   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2025-06-08T05:31:14,913   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2025-06-08T05:31:14,914   adding 'deepspeed/module_inject/containers/features/megatron.py'
2025-06-08T05:31:14,916   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2025-06-08T05:31:14,917   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2025-06-08T05:31:14,919   adding 'deepspeed/moe/__init__.py'
2025-06-08T05:31:14,920   adding 'deepspeed/moe/experts.py'
2025-06-08T05:31:14,922   adding 'deepspeed/moe/layer.py'
2025-06-08T05:31:14,923   adding 'deepspeed/moe/mappings.py'
2025-06-08T05:31:14,926   adding 'deepspeed/moe/sharded_moe.py'
2025-06-08T05:31:14,928   adding 'deepspeed/moe/utils.py'
2025-06-08T05:31:14,929   adding 'deepspeed/monitor/__init__.py'
2025-06-08T05:31:14,931   adding 'deepspeed/monitor/comet.py'
2025-06-08T05:31:14,932   adding 'deepspeed/monitor/config.py'
2025-06-08T05:31:14,934   adding 'deepspeed/monitor/csv_monitor.py'
2025-06-08T05:31:14,935   adding 'deepspeed/monitor/monitor.py'
2025-06-08T05:31:14,936   adding 'deepspeed/monitor/tensorboard.py'
2025-06-08T05:31:14,937   adding 'deepspeed/monitor/utils.py'
2025-06-08T05:31:14,938   adding 'deepspeed/monitor/wandb.py'
2025-06-08T05:31:14,940   adding 'deepspeed/nebula/__init__.py'
2025-06-08T05:31:14,941   adding 'deepspeed/nebula/config.py'
2025-06-08T05:31:14,943   adding 'deepspeed/nebula/constants.py'
2025-06-08T05:31:14,944   adding 'deepspeed/nvme/__init__.py'
2025-06-08T05:31:14,946   adding 'deepspeed/nvme/ds_aio_args.py'
2025-06-08T05:31:14,947   adding 'deepspeed/nvme/ds_aio_basic.py'
2025-06-08T05:31:14,949   adding 'deepspeed/nvme/ds_aio_handle.py'
2025-06-08T05:31:14,950   adding 'deepspeed/nvme/ds_aio_job.py'
2025-06-08T05:31:14,952   adding 'deepspeed/nvme/parse_nvme_stats.py'
2025-06-08T05:31:14,953   adding 'deepspeed/nvme/perf_generate_param.py'
2025-06-08T05:31:14,955   adding 'deepspeed/nvme/perf_run_sweep.py'
2025-06-08T05:31:14,956   adding 'deepspeed/nvme/perf_sweep_utils.py'
2025-06-08T05:31:14,957   adding 'deepspeed/nvme/test_ds_aio.py'
2025-06-08T05:31:14,958   adding 'deepspeed/nvme/test_ds_aio_utils.py'
2025-06-08T05:31:14,960   adding 'deepspeed/nvme/validate_async_io.py'
2025-06-08T05:31:14,962   adding 'deepspeed/ops/__init__.py'
2025-06-08T05:31:14,963   adding 'deepspeed/ops/adagrad/__init__.py'
2025-06-08T05:31:14,965   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2025-06-08T05:31:14,966   adding 'deepspeed/ops/adam/__init__.py'
2025-06-08T05:31:14,968   adding 'deepspeed/ops/adam/cpu_adam.py'
2025-06-08T05:31:14,970   adding 'deepspeed/ops/adam/fused_adam.py'
2025-06-08T05:31:14,971   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2025-06-08T05:31:14,973   adding 'deepspeed/ops/aio/__init__.py'
2025-06-08T05:31:14,974   adding 'deepspeed/ops/compile/__init__.py'
2025-06-08T05:31:14,977   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2025-06-08T05:31:14,978   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2025-06-08T05:31:14,980   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2025-06-08T05:31:14,981   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2025-06-08T05:31:14,983   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2025-06-08T05:31:14,984   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2025-06-08T05:31:14,987   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2025-06-08T05:31:14,988   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2025-06-08T05:31:14,989   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2025-06-08T05:31:14,990   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2025-06-08T05:31:14,992   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2025-06-08T05:31:14,993   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2025-06-08T05:31:14,995   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2025-06-08T05:31:14,996   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2025-06-08T05:31:14,997   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2025-06-08T05:31:14,999   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2025-06-08T05:31:15,000   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2025-06-08T05:31:15,001   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2025-06-08T05:31:15,002   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2025-06-08T05:31:15,004   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2025-06-08T05:31:15,005   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2025-06-08T05:31:15,006   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2025-06-08T05:31:15,007   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2025-06-08T05:31:15,008   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2025-06-08T05:31:15,010   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2025-06-08T05:31:15,011   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2025-06-08T05:31:15,013   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2025-06-08T05:31:15,014   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2025-06-08T05:31:15,015   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2025-06-08T05:31:15,017   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2025-06-08T05:31:15,019   adding 'deepspeed/ops/csrc/compile/deepcompile.cpp'
2025-06-08T05:31:15,020   adding 'deepspeed/ops/csrc/compile/init.cpp'
2025-06-08T05:31:15,022   adding 'deepspeed/ops/csrc/compile/util.cpp'
2025-06-08T05:31:15,023   adding 'deepspeed/ops/csrc/compile/z1.cpp'
2025-06-08T05:31:15,024   adding 'deepspeed/ops/csrc/compile/z1.h'
2025-06-08T05:31:15,027   adding 'deepspeed/ops/csrc/compile/z3.cpp'
2025-06-08T05:31:15,028   adding 'deepspeed/ops/csrc/compile/z3.h'
2025-06-08T05:31:15,030   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2025-06-08T05:31:15,033   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2025-06-08T05:31:15,036   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2025-06-08T05:31:15,037   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2025-06-08T05:31:15,038   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2025-06-08T05:31:15,040   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2025-06-08T05:31:15,042   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2025-06-08T05:31:15,044   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2025-06-08T05:31:15,046   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2025-06-08T05:31:15,048   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2025-06-08T05:31:15,056   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2025-06-08T05:31:15,061   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2025-06-08T05:31:15,063   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2025-06-08T05:31:15,066   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2025-06-08T05:31:15,067   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2025-06-08T05:31:15,069   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2025-06-08T05:31:15,071   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2025-06-08T05:31:15,073   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2025-06-08T05:31:15,075   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2025-06-08T05:31:15,078   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2025-06-08T05:31:15,079   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2025-06-08T05:31:15,081   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2025-06-08T05:31:15,089   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2025-06-08T05:31:15,092   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2025-06-08T05:31:15,094   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2025-06-08T05:31:15,098   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2025-06-08T05:31:15,101   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2025-06-08T05:31:15,105   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2025-06-08T05:31:15,107   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2025-06-08T05:31:15,108   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2025-06-08T05:31:15,110   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2025-06-08T05:31:15,112   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2025-06-08T05:31:15,114   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2025-06-08T05:31:15,116   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2025-06-08T05:31:15,118   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2025-06-08T05:31:15,119   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2025-06-08T05:31:15,122   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2025-06-08T05:31:15,123   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2025-06-08T05:31:15,124   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2025-06-08T05:31:15,126   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2025-06-08T05:31:15,127   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2025-06-08T05:31:15,128   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2025-06-08T05:31:15,131   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2025-06-08T05:31:15,132   adding 'deepspeed/ops/csrc/includes/Timer.h'
2025-06-08T05:31:15,133   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2025-06-08T05:31:15,134   adding 'deepspeed/ops/csrc/includes/compat.h'
2025-06-08T05:31:15,136   adding 'deepspeed/ops/csrc/includes/context.h'
2025-06-08T05:31:15,137   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2025-06-08T05:31:15,139   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2025-06-08T05:31:15,140   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2025-06-08T05:31:15,142   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2025-06-08T05:31:15,143   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2025-06-08T05:31:15,145   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2025-06-08T05:31:15,147   adding 'deepspeed/ops/csrc/includes/deepcompile.h'
2025-06-08T05:31:15,149   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2025-06-08T05:31:15,150   adding 'deepspeed/ops/csrc/includes/dropout.h'
2025-06-08T05:31:15,151   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2025-06-08T05:31:15,153   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2025-06-08T05:31:15,154   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2025-06-08T05:31:15,155   adding 'deepspeed/ops/csrc/includes/gelu.h'
2025-06-08T05:31:15,157   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2025-06-08T05:31:15,158   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2025-06-08T05:31:15,160   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2025-06-08T05:31:15,162   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2025-06-08T05:31:15,163   adding 'deepspeed/ops/csrc/includes/quantization.h'
2025-06-08T05:31:15,165   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2025-06-08T05:31:15,166   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2025-06-08T05:31:15,169   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2025-06-08T05:31:15,171   adding 'deepspeed/ops/csrc/includes/simd.h'
2025-06-08T05:31:15,172   adding 'deepspeed/ops/csrc/includes/softmax.h'
2025-06-08T05:31:15,173   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2025-06-08T05:31:15,175   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2025-06-08T05:31:15,177   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2025-06-08T05:31:15,179   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2025-06-08T05:31:15,181   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2025-06-08T05:31:15,182   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2025-06-08T05:31:15,183   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2025-06-08T05:31:15,185   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2025-06-08T05:31:15,186   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2025-06-08T05:31:15,188   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2025-06-08T05:31:15,191   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2025-06-08T05:31:15,193   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2025-06-08T05:31:15,195   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2025-06-08T05:31:15,197   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2025-06-08T05:31:15,198   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2025-06-08T05:31:15,200   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2025-06-08T05:31:15,203   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2025-06-08T05:31:15,204   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2025-06-08T05:31:15,206   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2025-06-08T05:31:15,207   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2025-06-08T05:31:15,209   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2025-06-08T05:31:15,211   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2025-06-08T05:31:15,213   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2025-06-08T05:31:15,215   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2025-06-08T05:31:15,217   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2025-06-08T05:31:15,220   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2025-06-08T05:31:15,224   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2025-06-08T05:31:15,226   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2025-06-08T05:31:15,227   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2025-06-08T05:31:15,232   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2025-06-08T05:31:15,234   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2025-06-08T05:31:15,237   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2025-06-08T05:31:15,240   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2025-06-08T05:31:15,241   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2025-06-08T05:31:15,244   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2025-06-08T05:31:15,246   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2025-06-08T05:31:15,247   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2025-06-08T05:31:15,253   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2025-06-08T05:31:15,255   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2025-06-08T05:31:15,256   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2025-06-08T05:31:15,259   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2025-06-08T05:31:15,261   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2025-06-08T05:31:15,264   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2025-06-08T05:31:15,266   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2025-06-08T05:31:15,268   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2025-06-08T05:31:15,269   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2025-06-08T05:31:15,272   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2025-06-08T05:31:15,274   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2025-06-08T05:31:15,275   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2025-06-08T05:31:15,277   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2025-06-08T05:31:15,278   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2025-06-08T05:31:15,280   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2025-06-08T05:31:15,282   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2025-06-08T05:31:15,283   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2025-06-08T05:31:15,285   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2025-06-08T05:31:15,286   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2025-06-08T05:31:15,288   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2025-06-08T05:31:15,290   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2025-06-08T05:31:15,291   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2025-06-08T05:31:15,293   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2025-06-08T05:31:15,294   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2025-06-08T05:31:15,296   adding 'deepspeed/ops/fp_quantizer/fp8_gemm_triton.py'
2025-06-08T05:31:15,297   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2025-06-08T05:31:15,299   adding 'deepspeed/ops/gds/__init__.py'
2025-06-08T05:31:15,301   adding 'deepspeed/ops/lamb/__init__.py'
2025-06-08T05:31:15,302   adding 'deepspeed/ops/lamb/fused_lamb.py'
2025-06-08T05:31:15,304   adding 'deepspeed/ops/lion/__init__.py'
2025-06-08T05:31:15,306   adding 'deepspeed/ops/lion/cpu_lion.py'
2025-06-08T05:31:15,307   adding 'deepspeed/ops/lion/fused_lion.py'
2025-06-08T05:31:15,308   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2025-06-08T05:31:15,311   adding 'deepspeed/ops/op_builder/__init__.py'
2025-06-08T05:31:15,312   adding 'deepspeed/ops/op_builder/all_ops.py'
2025-06-08T05:31:15,313   adding 'deepspeed/ops/op_builder/async_io.py'
2025-06-08T05:31:15,317   adding 'deepspeed/ops/op_builder/builder.py'
2025-06-08T05:31:15,319   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2025-06-08T05:31:15,320   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2025-06-08T05:31:15,321   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2025-06-08T05:31:15,322   adding 'deepspeed/ops/op_builder/dc.py'
2025-06-08T05:31:15,324   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2025-06-08T05:31:15,325   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2025-06-08T05:31:15,326   adding 'deepspeed/ops/op_builder/fused_adam.py'
2025-06-08T05:31:15,328   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2025-06-08T05:31:15,329   adding 'deepspeed/ops/op_builder/fused_lion.py'
2025-06-08T05:31:15,330   adding 'deepspeed/ops/op_builder/gds.py'
2025-06-08T05:31:15,331   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2025-06-08T05:31:15,332   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2025-06-08T05:31:15,334   adding 'deepspeed/ops/op_builder/quantizer.py'
2025-06-08T05:31:15,335   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2025-06-08T05:31:15,336   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2025-06-08T05:31:15,337   adding 'deepspeed/ops/op_builder/random_ltd.py'
2025-06-08T05:31:15,338   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2025-06-08T05:31:15,340   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2025-06-08T05:31:15,341   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2025-06-08T05:31:15,342   adding 'deepspeed/ops/op_builder/transformer.py'
2025-06-08T05:31:15,343   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2025-06-08T05:31:15,345   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2025-06-08T05:31:15,346   adding 'deepspeed/ops/op_builder/cpu/async_io.py'
2025-06-08T05:31:15,347   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2025-06-08T05:31:15,349   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2025-06-08T05:31:15,350   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2025-06-08T05:31:15,351   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2025-06-08T05:31:15,352   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2025-06-08T05:31:15,354   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2025-06-08T05:31:15,355   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2025-06-08T05:31:15,356   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2025-06-08T05:31:15,358   adding 'deepspeed/ops/op_builder/hpu/fp_quantizer.py'
2025-06-08T05:31:15,359   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2025-06-08T05:31:15,360   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2025-06-08T05:31:15,361   adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py'
2025-06-08T05:31:15,363   adding 'deepspeed/ops/op_builder/mlu/__init__.py'
2025-06-08T05:31:15,365   adding 'deepspeed/ops/op_builder/mlu/builder.py'
2025-06-08T05:31:15,366   adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py'
2025-06-08T05:31:15,367   adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py'
2025-06-08T05:31:15,368   adding 'deepspeed/ops/op_builder/mlu/fused_adam.py'
2025-06-08T05:31:15,369   adding 'deepspeed/ops/op_builder/mlu/no_impl.py'
2025-06-08T05:31:15,371   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2025-06-08T05:31:15,373   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2025-06-08T05:31:15,374   adding 'deepspeed/ops/op_builder/npu/builder.py'
2025-06-08T05:31:15,375   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2025-06-08T05:31:15,376   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2025-06-08T05:31:15,378   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2025-06-08T05:31:15,379   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2025-06-08T05:31:15,381   adding 'deepspeed/ops/op_builder/npu/inference.py'
2025-06-08T05:31:15,382   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2025-06-08T05:31:15,384   adding 'deepspeed/ops/op_builder/sdaa/__init__.py'
2025-06-08T05:31:15,385   adding 'deepspeed/ops/op_builder/sdaa/builder.py'
2025-06-08T05:31:15,387   adding 'deepspeed/ops/op_builder/sdaa/cpu_adam.py'
2025-06-08T05:31:15,388   adding 'deepspeed/ops/op_builder/sdaa/fused_adam.py'
2025-06-08T05:31:15,390   adding 'deepspeed/ops/op_builder/sdaa/no_impl.py'
2025-06-08T05:31:15,391   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2025-06-08T05:31:15,393   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2025-06-08T05:31:15,394   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2025-06-08T05:31:15,396   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2025-06-08T05:31:15,397   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2025-06-08T05:31:15,398   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2025-06-08T05:31:15,399   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2025-06-08T05:31:15,401   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2025-06-08T05:31:15,402   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2025-06-08T05:31:15,403   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2025-06-08T05:31:15,404   adding 'deepspeed/ops/quantizer/__init__.py'
2025-06-08T05:31:15,405   adding 'deepspeed/ops/quantizer/quantizer.py'
2025-06-08T05:31:15,407   adding 'deepspeed/ops/random_ltd/__init__.py'
2025-06-08T05:31:15,408   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2025-06-08T05:31:15,410   adding 'deepspeed/ops/sparse_attention/__init__.py'
2025-06-08T05:31:15,411   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2025-06-08T05:31:15,415   adding 'deepspeed/ops/sparse_attention/matmul.py'
2025-06-08T05:31:15,417   adding 'deepspeed/ops/sparse_attention/softmax.py'
2025-06-08T05:31:15,419   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2025-06-08T05:31:15,421   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2025-06-08T05:31:15,424   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2025-06-08T05:31:15,426   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2025-06-08T05:31:15,428   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2025-06-08T05:31:15,429   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2025-06-08T05:31:15,430   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2025-06-08T05:31:15,432   adding 'deepspeed/ops/transformer/__init__.py'
2025-06-08T05:31:15,434   adding 'deepspeed/ops/transformer/transformer.py'
2025-06-08T05:31:15,436   adding 'deepspeed/ops/transformer/inference/__init__.py'
2025-06-08T05:31:15,437   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2025-06-08T05:31:15,439   adding 'deepspeed/ops/transformer/inference/config.py'
2025-06-08T05:31:15,440   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2025-06-08T05:31:15,442   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2025-06-08T05:31:15,443   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2025-06-08T05:31:15,445   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2025-06-08T05:31:15,447   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2025-06-08T05:31:15,449   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2025-06-08T05:31:15,451   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2025-06-08T05:31:15,453   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2025-06-08T05:31:15,454   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2025-06-08T05:31:15,455   adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py'
2025-06-08T05:31:15,457   adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py'
2025-06-08T05:31:15,458   adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py'
2025-06-08T05:31:15,459   adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py'
2025-06-08T05:31:15,461   adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py'
2025-06-08T05:31:15,462   adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py'
2025-06-08T05:31:15,463   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2025-06-08T05:31:15,465   adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py'
2025-06-08T05:31:15,466   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2025-06-08T05:31:15,468   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2025-06-08T05:31:15,470   adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py'
2025-06-08T05:31:15,471   adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py'
2025-06-08T05:31:15,472   adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py'
2025-06-08T05:31:15,474   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2025-06-08T05:31:15,476   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2025-06-08T05:31:15,477   adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py'
2025-06-08T05:31:15,478   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2025-06-08T05:31:15,480   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2025-06-08T05:31:15,481   adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py'
2025-06-08T05:31:15,482   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2025-06-08T05:31:15,484   adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py'
2025-06-08T05:31:15,485   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2025-06-08T05:31:15,488   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2025-06-08T05:31:15,489   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2025-06-08T05:31:15,490   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2025-06-08T05:31:15,492   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2025-06-08T05:31:15,494   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2025-06-08T05:31:15,495   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2025-06-08T05:31:15,497   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2025-06-08T05:31:15,498   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2025-06-08T05:31:15,500   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2025-06-08T05:31:15,501   adding 'deepspeed/pipe/__init__.py'
2025-06-08T05:31:15,503   adding 'deepspeed/profiling/__init__.py'
2025-06-08T05:31:15,504   adding 'deepspeed/profiling/config.py'
2025-06-08T05:31:15,505   adding 'deepspeed/profiling/constants.py'
2025-06-08T05:31:15,507   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2025-06-08T05:31:15,513   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2025-06-08T05:31:15,515   adding 'deepspeed/runtime/__init__.py'
2025-06-08T05:31:15,516   adding 'deepspeed/runtime/base_optimizer.py'
2025-06-08T05:31:15,519   adding 'deepspeed/runtime/bf16_optimizer.py'
2025-06-08T05:31:15,521   adding 'deepspeed/runtime/compiler.py'
2025-06-08T05:31:15,525   adding 'deepspeed/runtime/config.py'
2025-06-08T05:31:15,527   adding 'deepspeed/runtime/config_utils.py'
2025-06-08T05:31:15,529   adding 'deepspeed/runtime/constants.py'
2025-06-08T05:31:15,530   adding 'deepspeed/runtime/dataloader.py'
2025-06-08T05:31:15,532   adding 'deepspeed/runtime/eigenvalue.py'
2025-06-08T05:31:15,552   adding 'deepspeed/runtime/engine.py'
2025-06-08T05:31:15,555   adding 'deepspeed/runtime/hybrid_engine.py'
2025-06-08T05:31:15,559   adding 'deepspeed/runtime/lr_schedules.py'
2025-06-08T05:31:15,561   adding 'deepspeed/runtime/progressive_layer_drop.py'
2025-06-08T05:31:15,562   adding 'deepspeed/runtime/quantize.py'
2025-06-08T05:31:15,564   adding 'deepspeed/runtime/sparse_tensor.py'
2025-06-08T05:31:15,566   adding 'deepspeed/runtime/state_dict_factory.py'
2025-06-08T05:31:15,571   adding 'deepspeed/runtime/utils.py'
2025-06-08T05:31:15,573   adding 'deepspeed/runtime/weight_quantizer.py'
2025-06-08T05:31:15,574   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2025-06-08T05:31:15,579   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2025-06-08T05:31:15,581   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2025-06-08T05:31:15,583   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2025-06-08T05:31:15,584   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2025-06-08T05:31:15,585   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2025-06-08T05:31:15,587   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2025-06-08T05:31:15,589   adding 'deepspeed/runtime/comm/__init__.py'
2025-06-08T05:31:15,590   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2025-06-08T05:31:15,592   adding 'deepspeed/runtime/comm/compressed.py'
2025-06-08T05:31:15,593   adding 'deepspeed/runtime/comm/hccl.py'
2025-06-08T05:31:15,595   adding 'deepspeed/runtime/comm/mpi.py'
2025-06-08T05:31:15,597   adding 'deepspeed/runtime/comm/nccl.py'
2025-06-08T05:31:15,598   adding 'deepspeed/runtime/compression/__init__.py'
2025-06-08T05:31:15,599   adding 'deepspeed/runtime/compression/cupy.py'
2025-06-08T05:31:15,601   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2025-06-08T05:31:15,602   adding 'deepspeed/runtime/data_pipeline/config.py'
2025-06-08T05:31:15,603   adding 'deepspeed/runtime/data_pipeline/constants.py'
2025-06-08T05:31:15,605   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2025-06-08T05:31:15,607   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2025-06-08T05:31:15,608   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2025-06-08T05:31:15,609   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2025-06-08T05:31:15,611   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2025-06-08T05:31:15,612   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2025-06-08T05:31:15,614   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2025-06-08T05:31:15,619   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2025-06-08T05:31:15,621   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2025-06-08T05:31:15,624   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2025-06-08T05:31:15,625   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2025-06-08T05:31:15,628   adding 'deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py'
2025-06-08T05:31:15,630   adding 'deepspeed/runtime/domino/__init__.py'
2025-06-08T05:31:15,632   adding 'deepspeed/runtime/domino/async_linear.py'
2025-06-08T05:31:15,634   adding 'deepspeed/runtime/domino/transformer.py'
2025-06-08T05:31:15,636   adding 'deepspeed/runtime/fp16/__init__.py'
2025-06-08T05:31:15,639   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2025-06-08T05:31:15,641   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2025-06-08T05:31:15,643   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2025-06-08T05:31:15,645   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2025-06-08T05:31:15,647   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2025-06-08T05:31:15,650   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2025-06-08T05:31:15,652   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2025-06-08T05:31:15,654   adding 'deepspeed/runtime/pipe/__init__.py'
2025-06-08T05:31:15,661   adding 'deepspeed/runtime/pipe/engine.py'
2025-06-08T05:31:15,665   adding 'deepspeed/runtime/pipe/module.py'
2025-06-08T05:31:15,667   adding 'deepspeed/runtime/pipe/p2p.py'
2025-06-08T05:31:15,669   adding 'deepspeed/runtime/pipe/schedule.py'
2025-06-08T05:31:15,671   adding 'deepspeed/runtime/pipe/topology.py'
2025-06-08T05:31:15,673   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2025-06-08T05:31:15,674   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2025-06-08T05:31:15,676   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2025-06-08T05:31:15,677   adding 'deepspeed/runtime/swap_tensor/constants.py'
2025-06-08T05:31:15,680   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2025-06-08T05:31:15,682   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2025-06-08T05:31:15,684   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2025-06-08T05:31:15,686   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2025-06-08T05:31:15,688   adding 'deepspeed/runtime/swap_tensor/utils.py'
2025-06-08T05:31:15,690   adding 'deepspeed/runtime/tensor_parallel/__init__.py'
2025-06-08T05:31:15,691   adding 'deepspeed/runtime/tensor_parallel/config.py'
2025-06-08T05:31:15,693   adding 'deepspeed/runtime/tensor_parallel/tp_manager.py'
2025-06-08T05:31:15,695   adding 'deepspeed/runtime/zero/__init__.py'
2025-06-08T05:31:15,697   adding 'deepspeed/runtime/zero/config.py'
2025-06-08T05:31:15,699   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2025-06-08T05:31:15,700   adding 'deepspeed/runtime/zero/linear.py'
2025-06-08T05:31:15,703   adding 'deepspeed/runtime/zero/mics.py'
2025-06-08T05:31:15,705   adding 'deepspeed/runtime/zero/mics_utils.py'
2025-06-08T05:31:15,706   adding 'deepspeed/runtime/zero/offload_config.py'
2025-06-08T05:31:15,707   adding 'deepspeed/runtime/zero/offload_states.py'
2025-06-08T05:31:15,710   adding 'deepspeed/runtime/zero/parameter_offload.py'
2025-06-08T05:31:15,722   adding 'deepspeed/runtime/zero/partition_parameters.py'
2025-06-08T05:31:15,726   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2025-06-08T05:31:15,727   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2025-06-08T05:31:15,743   adding 'deepspeed/runtime/zero/stage3.py'
2025-06-08T05:31:15,757   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2025-06-08T05:31:15,759   adding 'deepspeed/runtime/zero/test.py'
2025-06-08T05:31:15,761   adding 'deepspeed/runtime/zero/tiling.py'
2025-06-08T05:31:15,763   adding 'deepspeed/runtime/zero/utils.py'
2025-06-08T05:31:15,764   adding 'deepspeed/sequence/__init__.py'
2025-06-08T05:31:15,765   adding 'deepspeed/sequence/cross_entropy.py'
2025-06-08T05:31:15,770   adding 'deepspeed/sequence/fpdt_layer.py'
2025-06-08T05:31:15,773   adding 'deepspeed/sequence/layer.py'
2025-06-08T05:31:15,775   adding 'deepspeed/utils/__init__.py'
2025-06-08T05:31:15,776   adding 'deepspeed/utils/bwc.py'
2025-06-08T05:31:15,777   adding 'deepspeed/utils/comms_logging.py'
2025-06-08T05:31:15,779   adding 'deepspeed/utils/config.py'
2025-06-08T05:31:15,780   adding 'deepspeed/utils/debug.py'
2025-06-08T05:31:15,781   adding 'deepspeed/utils/exceptions.py'
2025-06-08T05:31:15,784   adding 'deepspeed/utils/groups.py'
2025-06-08T05:31:15,786   adding 'deepspeed/utils/init_on_device.py'
2025-06-08T05:31:15,787   adding 'deepspeed/utils/logging.py'
2025-06-08T05:31:15,789   adding 'deepspeed/utils/mixed_precision_linkage.py'
2025-06-08T05:31:15,790   adding 'deepspeed/utils/numa.py'
2025-06-08T05:31:15,792   adding 'deepspeed/utils/nvtx.py'
2025-06-08T05:31:15,794   adding 'deepspeed/utils/tensor_fragment.py'
2025-06-08T05:31:15,796   adding 'deepspeed/utils/timer.py'
2025-06-08T05:31:15,797   adding 'deepspeed/utils/torch.py'
2025-06-08T05:31:15,798   adding 'deepspeed/utils/types.py'
2025-06-08T05:31:15,799   adding 'deepspeed/utils/z3_leaf_module.py'
2025-06-08T05:31:15,803   adding 'deepspeed/utils/zero_to_fp32.py'
2025-06-08T05:31:15,806   adding 'deepspeed-0.16.8.data/scripts/deepspeed'
2025-06-08T05:31:15,807   adding 'deepspeed-0.16.8.data/scripts/deepspeed.pt'
2025-06-08T05:31:15,808   adding 'deepspeed-0.16.8.data/scripts/ds'
2025-06-08T05:31:15,809   adding 'deepspeed-0.16.8.data/scripts/ds_bench'
2025-06-08T05:31:15,811   adding 'deepspeed-0.16.8.data/scripts/ds_elastic'
2025-06-08T05:31:15,812   adding 'deepspeed-0.16.8.data/scripts/ds_io'
2025-06-08T05:31:15,813   adding 'deepspeed-0.16.8.data/scripts/ds_nvme_tune'
2025-06-08T05:31:15,814   adding 'deepspeed-0.16.8.data/scripts/ds_report'
2025-06-08T05:31:15,815   adding 'deepspeed-0.16.8.data/scripts/ds_ssh'
2025-06-08T05:31:15,816   adding 'deepspeed-0.16.8.data/scripts/dsr'
2025-06-08T05:31:15,820   adding 'deepspeed-0.16.8.dist-info/licenses/LICENSE'
2025-06-08T05:31:15,825   adding 'deepspeed-0.16.8.dist-info/METADATA'
2025-06-08T05:31:15,826   adding 'deepspeed-0.16.8.dist-info/WHEEL'
2025-06-08T05:31:15,827   adding 'deepspeed-0.16.8.dist-info/entry_points.txt'
2025-06-08T05:31:15,828   adding 'deepspeed-0.16.8.dist-info/top_level.txt'
2025-06-08T05:31:15,843   adding 'deepspeed-0.16.8.dist-info/RECORD'
2025-06-08T05:31:15,870   removing build/bdist.linux-armv7l/wheel
2025-06-08T05:31:16,126   deepspeed build time = 11.721797943115234 secs
2025-06-08T05:31:16,267   Building wheel for deepspeed (setup.py): finished with status 'done'
2025-06-08T05:31:16,290   Created wheel for deepspeed: filename=deepspeed-0.16.8-py3-none-any.whl size=1642771 sha256=a9a578ecf810f68bb8113342e3cfd5cfddaeadb101f9c1241dae35ed1078f6b3
2025-06-08T05:31:16,291   Stored in directory: /tmp/pip-ephem-wheel-cache-_u88x2n5/wheels/66/4e/6a/91f4af9915a2d18a7d01f29072331228d9a5b1a1ea6722972a
2025-06-08T05:31:16,336 Successfully built deepspeed
2025-06-08T05:31:16,378 Removed build tracker: '/tmp/pip-build-tracker-tmcythip'