2025-06-01T13:05:48,259 Created temporary directory: /tmp/pip-build-tracker-m0l3c9sw
2025-06-01T13:05:48,260 Initialized build tracking at /tmp/pip-build-tracker-m0l3c9sw
2025-06-01T13:05:48,260 Created build tracker: /tmp/pip-build-tracker-m0l3c9sw
2025-06-01T13:05:48,261 Entered build tracker: /tmp/pip-build-tracker-m0l3c9sw
2025-06-01T13:05:48,262 Created temporary directory: /tmp/pip-wheel-zeidwmed
2025-06-01T13:05:48,266 Created temporary directory: /tmp/pip-ephem-wheel-cache-qpvpedgd
2025-06-01T13:05:48,324 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2025-06-01T13:05:48,326 2 location(s) to search for versions of deepspeed:
2025-06-01T13:05:48,326 * https://pypi.org/simple/deepspeed/
2025-06-01T13:05:48,326 * https://www.piwheels.org/simple/deepspeed/
2025-06-01T13:05:48,327 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2025-06-01T13:05:48,328 Getting page https://pypi.org/simple/deepspeed/
2025-06-01T13:05:48,329 Found index url https://pypi.org/simple/
2025-06-01T13:05:48,569 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2025-06-01T13:05:48,591   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T13:05:48,592   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2025-06-01T13:05:48,593   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T13:05:48,594   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2025-06-01T13:05:48,594   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T13:05:48,595   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2025-06-01T13:05:48,596   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T13:05:48,596   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2025-06-01T13:05:48,597   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T13:05:48,598   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2025-06-01T13:05:48,598   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2025-06-01T13:05:48,599   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2025-06-01T13:05:48,600   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2025-06-01T13:05:48,601   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2025-06-01T13:05:48,601   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2025-06-01T13:05:48,602   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2025-06-01T13:05:48,603   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2025-06-01T13:05:48,603   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2025-06-01T13:05:48,604   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2025-06-01T13:05:48,604   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2025-06-01T13:05:48,605   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2025-06-01T13:05:48,606   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2025-06-01T13:05:48,606   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2025-06-01T13:05:48,607   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2025-06-01T13:05:48,608   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2025-06-01T13:05:48,609   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2025-06-01T13:05:48,609   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2025-06-01T13:05:48,610   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2025-06-01T13:05:48,611   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2025-06-01T13:05:48,612   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2025-06-01T13:05:48,613   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2025-06-01T13:05:48,614   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2025-06-01T13:05:48,614   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2025-06-01T13:05:48,615   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2025-06-01T13:05:48,615   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2025-06-01T13:05:48,616   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2025-06-01T13:05:48,617   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2025-06-01T13:05:48,617   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2025-06-01T13:05:48,618   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2025-06-01T13:05:48,619   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2025-06-01T13:05:48,619   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2025-06-01T13:05:48,620   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2025-06-01T13:05:48,621   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2025-06-01T13:05:48,622   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2025-06-01T13:05:48,622   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2025-06-01T13:05:48,623   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2025-06-01T13:05:48,624   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2025-06-01T13:05:48,625   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2025-06-01T13:05:48,626   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2025-06-01T13:05:48,626   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2025-06-01T13:05:48,628   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2025-06-01T13:05:48,628   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2025-06-01T13:05:48,629   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2025-06-01T13:05:48,629   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2025-06-01T13:05:48,630   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2025-06-01T13:05:48,631   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2025-06-01T13:05:48,631   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2025-06-01T13:05:48,632   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2025-06-01T13:05:48,633   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2025-06-01T13:05:48,634   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2025-06-01T13:05:48,634   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2025-06-01T13:05:48,635   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2025-06-01T13:05:48,636   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2025-06-01T13:05:48,637   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2025-06-01T13:05:48,638   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2025-06-01T13:05:48,638   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2025-06-01T13:05:48,639   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2025-06-01T13:05:48,640   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2025-06-01T13:05:48,641   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2025-06-01T13:05:48,642   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2025-06-01T13:05:48,643   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2025-06-01T13:05:48,643   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2025-06-01T13:05:48,644   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2025-06-01T13:05:48,645   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2025-06-01T13:05:48,645   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2025-06-01T13:05:48,646   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2025-06-01T13:05:48,647   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2025-06-01T13:05:48,648   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2025-06-01T13:05:48,649   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2025-06-01T13:05:48,649   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2025-06-01T13:05:48,650   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2025-06-01T13:05:48,651   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2025-06-01T13:05:48,652   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2025-06-01T13:05:48,653   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2025-06-01T13:05:48,653   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2025-06-01T13:05:48,654   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2025-06-01T13:05:48,655   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2025-06-01T13:05:48,656   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2025-06-01T13:05:48,656   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2025-06-01T13:05:48,657   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2025-06-01T13:05:48,658   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2025-06-01T13:05:48,658   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2025-06-01T13:05:48,659   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2025-06-01T13:05:48,660   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2025-06-01T13:05:48,661   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2025-06-01T13:05:48,661   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2025-06-01T13:05:48,662   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T13:05:48,663   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2025-06-01T13:05:48,664   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T13:05:48,665   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2025-06-01T13:05:48,665   Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1
2025-06-01T13:05:48,666   Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2
2025-06-01T13:05:48,667   Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3
2025-06-01T13:05:48,668   Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4
2025-06-01T13:05:48,669   Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0
2025-06-01T13:05:48,669   Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1
2025-06-01T13:05:48,670   Found link https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.2
2025-06-01T13:05:48,671   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/52/23/cfe2166f06f1817b73b8695addd2fded55f4189322bcf181cfb7feaba550/deepspeed-0.16.3-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T13:05:48,671   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/ce/92/853de2a32b3f9c0945e0c9e145eddac98e570c1faebcd58aa85e6dcd89ba/deepspeed-0.16.3-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T13:05:48,672   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/55/8f/57ee424e114478a667c604b2f3f05bbc1addc0afc089b9ab6a64b233063d/deepspeed-0.16.3-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T13:05:48,672   Found link https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.3
2025-06-01T13:05:48,673   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/3d/65/1a6394f5d6dee851e9ea59e385f6d6428e3bfe36f83c06e0336e14dcfd11/deepspeed-0.16.4-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T13:05:48,674   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a3/aa/bb67b63cc25c5e29e4ca3f8b155e0faf74d5a33acf2ec67e249206a36b0f/deepspeed-0.16.4-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T13:05:48,674   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d4/59/fd251661b78b049eed7ee46f0d8d51c69ae7fbb710716a1ebcc796a6b0fd/deepspeed-0.16.4-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T13:05:48,675   Found link https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.4
2025-06-01T13:05:48,676   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/15/b0/be6cc74fd1e23da20d6c34db923858a8ae5017d39a13dedc188a935c646a/deepspeed-0.16.5-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T13:05:48,677   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/0b/78/9a87d137f83f53dd57f425ac174723c746c53029bf6cdce22eb9e805e3f0/deepspeed-0.16.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T13:05:48,677   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/80/f8/a9b1fca237fe8ea25f866956778280d0b735350f29fb6f4e0b548aa02a5f/deepspeed-0.16.5-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T13:05:48,678   Found link https://files.pythonhosted.org/packages/0d/88/96569b2acb3219c9c72068f9b952c59beffe366e7d1edd9e922e5c68f08b/deepspeed-0.16.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.5
2025-06-01T13:05:48,679   Found link https://files.pythonhosted.org/packages/cb/a3/1d758fcbcdb3f5ecf4e71907e293f17bae8a9f448b112e65c6195e90c2d3/deepspeed-0.16.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.6
2025-06-01T13:05:48,680   Found link https://files.pythonhosted.org/packages/06/b3/a3903de5c5b707170c5c27e1a40f4ef613f14d241bd84d8b151a2a8786f6/deepspeed-0.16.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.7
2025-06-01T13:05:48,681   Found link https://files.pythonhosted.org/packages/e1/27/f857569546dc97f64169df1cc35d1ec5161766c4a0ec32f2af5d39614a51/deepspeed-0.16.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.8
2025-06-01T13:05:48,681   Found link https://files.pythonhosted.org/packages/4f/5c/7542904cddfaa50a9a7ae6770349d468773359f5af1718865452cea8729d/deepspeed-0.16.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.9
2025-06-01T13:05:48,682   Found link https://files.pythonhosted.org/packages/1e/35/eef570f4da4a39d0e7f2e72757295fdba3718a8eca60d8d6dcfeb9e6f26d/deepspeed-0.17.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.0
2025-06-01T13:05:48,683   Found link https://files.pythonhosted.org/packages/38/10/a7f63e086c1e1c12e290c98363c748ef5ddd6313fde739d2aeccd5ed0cd4/deepspeed-0.17.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.1
2025-06-01T13:05:48,683   Found link https://files.pythonhosted.org/packages/8c/45/1ddcf8f8500d90fad9f3396bfb1295462d46a747ddcbfafcd7714d46827e/deepspeed-0.17.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.2
2025-06-01T13:05:48,684   Found link https://files.pythonhosted.org/packages/9e/6b/89faa30a38405cd2d7a81790b262673ca4c8e8ec97c2f8c433da04d7a002/deepspeed-0.17.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.3
2025-06-01T13:05:48,685   Found link https://files.pythonhosted.org/packages/84/b3/02d000bfd0d6f0ba3f5dac487e4151b3e9b4b3ee71336882102dc9ad79ad/deepspeed-0.17.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.4
2025-06-01T13:05:48,685 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2025-06-01T13:05:48,686 Getting page https://www.piwheels.org/simple/deepspeed/
2025-06-01T13:05:48,688 Found index url https://www.piwheels.org/simple/
2025-06-01T13:05:48,856 WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-01T13:05:49,515 WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-01T13:05:50,686 WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-01T13:05:52,860 WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-01T13:05:57,036 WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-01T13:05:57,209 Could not fetch URL https://www.piwheels.org/simple/deepspeed/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='www.piwheels.org', port=443): Max retries exceeded with url: /simple/deepspeed/ (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))) - skipping
2025-06-01T13:05:57,212 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2025-06-01T13:05:57,212 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2025-06-01T13:05:57,245 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2025-06-01T13:05:57,247 Collecting deepspeed==0.16.6
2025-06-01T13:05:57,249   Created temporary directory: /tmp/pip-unpack-cnd1b_ke
2025-06-01T13:05:57,398   Downloading deepspeed-0.16.6.tar.gz (1.5 MB)
2025-06-01T13:06:00,404   Added deepspeed==0.16.6 from https://files.pythonhosted.org/packages/cb/a3/1d758fcbcdb3f5ecf4e71907e293f17bae8a9f448b112e65c6195e90c2d3/deepspeed-0.16.6.tar.gz to build tracker '/tmp/pip-build-tracker-m0l3c9sw'
2025-06-01T13:06:00,406   Running setup.py (path:/tmp/pip-wheel-zeidwmed/deepspeed_1f53909e04b54737a7670dd744e538dd/setup.py) egg_info for package deepspeed
2025-06-01T13:06:00,407   Created temporary directory: /tmp/pip-pip-egg-info-k6rq09l8
2025-06-01T13:06:00,408   Preparing metadata (setup.py): started
2025-06-01T13:06:00,409   Running command python setup.py egg_info
2025-06-01T13:06:01,499   fatal: not a git repository (or any of the parent directories): .git
2025-06-01T13:06:02,008   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-06-01T13:06:02,009    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-06-01T13:06:02,009   DS_BUILD_OPS=0
2025-06-01T13:06:02,010   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-06-01T13:06:02,010   version=0.16.6, git_hash=unknown, git_branch=unknown
2025-06-01T13:06:02,011   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-06-01T13:06:02,011   ext_modules=[]
2025-06-01T13:06:02,012   running egg_info
2025-06-01T13:06:02,037   creating /tmp/pip-pip-egg-info-k6rq09l8/deepspeed.egg-info
2025-06-01T13:06:02,038   writing /tmp/pip-pip-egg-info-k6rq09l8/deepspeed.egg-info/PKG-INFO
2025-06-01T13:06:02,074   writing dependency_links to /tmp/pip-pip-egg-info-k6rq09l8/deepspeed.egg-info/dependency_links.txt
2025-06-01T13:06:02,076   writing entry points to /tmp/pip-pip-egg-info-k6rq09l8/deepspeed.egg-info/entry_points.txt
2025-06-01T13:06:02,095   writing requirements to /tmp/pip-pip-egg-info-k6rq09l8/deepspeed.egg-info/requires.txt
2025-06-01T13:06:02,097   writing top-level names to /tmp/pip-pip-egg-info-k6rq09l8/deepspeed.egg-info/top_level.txt
2025-06-01T13:06:02,098   writing manifest file '/tmp/pip-pip-egg-info-k6rq09l8/deepspeed.egg-info/SOURCES.txt'
2025-06-01T13:06:02,369   reading manifest file '/tmp/pip-pip-egg-info-k6rq09l8/deepspeed.egg-info/SOURCES.txt'
2025-06-01T13:06:02,371   reading manifest template 'MANIFEST.in'
2025-06-01T13:06:02,373   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-06-01T13:06:02,373   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-06-01T13:06:04,489   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-06-01T13:06:06,074   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-06-01T13:06:06,881   warning: no files found matching '*.tr' under directory 'csrc'
2025-06-01T13:06:07,044   warning: no files found matching '*.cc' under directory 'csrc'
2025-06-01T13:06:07,108   warning: no files found matching '*.py' under directory 'benchmarks'
2025-06-01T13:06:07,115   adding license file 'LICENSE'
2025-06-01T13:06:07,161   writing manifest file '/tmp/pip-pip-egg-info-k6rq09l8/deepspeed.egg-info/SOURCES.txt'
2025-06-01T13:06:07,163   deepspeed build time = 5.660552740097046 secs
2025-06-01T13:06:07,280   Preparing metadata (setup.py): finished with status 'done'
2025-06-01T13:06:07,287   Source in /tmp/pip-wheel-zeidwmed/deepspeed_1f53909e04b54737a7670dd744e538dd has version 0.16.6, which satisfies requirement deepspeed==0.16.6 from https://files.pythonhosted.org/packages/cb/a3/1d758fcbcdb3f5ecf4e71907e293f17bae8a9f448b112e65c6195e90c2d3/deepspeed-0.16.6.tar.gz
2025-06-01T13:06:07,288   Removed deepspeed==0.16.6 from https://files.pythonhosted.org/packages/cb/a3/1d758fcbcdb3f5ecf4e71907e293f17bae8a9f448b112e65c6195e90c2d3/deepspeed-0.16.6.tar.gz from build tracker '/tmp/pip-build-tracker-m0l3c9sw'
2025-06-01T13:06:07,368 Created temporary directory: /tmp/pip-unpack-__chnjtz
2025-06-01T13:06:07,369 Created temporary directory: /tmp/pip-unpack-accz46jd
2025-06-01T13:06:07,370 Building wheels for collected packages: deepspeed
2025-06-01T13:06:07,374   Created temporary directory: /tmp/pip-wheel-kjpqfp08
2025-06-01T13:06:07,375   DEPRECATION: Building 'deepspeed' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'deepspeed'. Discussion can be found at https://github.com/pypa/pip/issues/6334
2025-06-01T13:06:07,376   Building wheel for deepspeed (setup.py): started
2025-06-01T13:06:07,377   Destination directory: /tmp/pip-wheel-kjpqfp08
2025-06-01T13:06:07,378   Running command python setup.py bdist_wheel
2025-06-01T13:06:07,892   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-06-01T13:06:07,896    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-06-01T13:06:08,036   DS_BUILD_OPS=0
2025-06-01T13:06:08,170   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-06-01T13:06:08,196   fatal: not a git repository (or any of the parent directories): .git
2025-06-01T13:06:08,197   version=0.16.6, git_hash=unknown, git_branch=unknown
2025-06-01T13:06:08,198   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-06-01T13:06:08,199   ext_modules=[]
2025-06-01T13:06:08,607   running bdist_wheel
2025-06-01T13:06:08,744   running build
2025-06-01T13:06:08,744   running build_py
2025-06-01T13:06:08,775   creating build/lib/deepspeed
2025-06-01T13:06:08,778   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2025-06-01T13:06:08,780   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2025-06-01T13:06:08,782   copying deepspeed/__init__.py -> build/lib/deepspeed
2025-06-01T13:06:08,785   copying deepspeed/env_report.py -> build/lib/deepspeed
2025-06-01T13:06:08,787   copying deepspeed/constants.py -> build/lib/deepspeed
2025-06-01T13:06:08,790   creating build/lib/deepspeed/moe
2025-06-01T13:06:08,791   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2025-06-01T13:06:08,794   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2025-06-01T13:06:08,796   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2025-06-01T13:06:08,798   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2025-06-01T13:06:08,801   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2025-06-01T13:06:08,804   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2025-06-01T13:06:08,808   creating build/lib/deepspeed/runtime
2025-06-01T13:06:08,809   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,812   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,815   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,818   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,821   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,827   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,829   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,832   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,834   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,836   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,839   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,842   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,844   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,847   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,850   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,852   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,855   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,858   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2025-06-01T13:06:08,861   creating build/lib/deepspeed/sequence
2025-06-01T13:06:08,862   copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence
2025-06-01T13:06:08,867   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2025-06-01T13:06:08,869   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2025-06-01T13:06:08,871   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2025-06-01T13:06:08,875   creating build/lib/deepspeed/compression
2025-06-01T13:06:08,876   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2025-06-01T13:06:08,879   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2025-06-01T13:06:08,882   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2025-06-01T13:06:08,884   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2025-06-01T13:06:08,887   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2025-06-01T13:06:08,890   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2025-06-01T13:06:08,893   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2025-06-01T13:06:08,896   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2025-06-01T13:06:08,899   creating build/lib/deepspeed/ops
2025-06-01T13:06:08,900   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2025-06-01T13:06:08,903   creating build/lib/deepspeed/launcher
2025-06-01T13:06:08,905   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2025-06-01T13:06:08,908   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2025-06-01T13:06:08,910   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2025-06-01T13:06:08,913   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2025-06-01T13:06:08,915   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2025-06-01T13:06:08,917   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2025-06-01T13:06:08,921   creating build/lib/deepspeed/linear
2025-06-01T13:06:08,922   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2025-06-01T13:06:08,924   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2025-06-01T13:06:08,927   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2025-06-01T13:06:08,930   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2025-06-01T13:06:08,932   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2025-06-01T13:06:08,935   creating build/lib/deepspeed/model_implementations
2025-06-01T13:06:08,936   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2025-06-01T13:06:08,939   creating build/lib/deepspeed/monitor
2025-06-01T13:06:08,940   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2025-06-01T13:06:08,942   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2025-06-01T13:06:08,944   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2025-06-01T13:06:08,947   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2025-06-01T13:06:08,949   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2025-06-01T13:06:08,951   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2025-06-01T13:06:08,953   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2025-06-01T13:06:08,956   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2025-06-01T13:06:08,958   creating build/lib/deepspeed/pipe
2025-06-01T13:06:08,959   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2025-06-01T13:06:08,962   creating build/lib/deepspeed/profiling
2025-06-01T13:06:08,963   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2025-06-01T13:06:08,965   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2025-06-01T13:06:08,968   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2025-06-01T13:06:08,971   creating build/lib/deepspeed/checkpoint
2025-06-01T13:06:08,972   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2025-06-01T13:06:08,974   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2025-06-01T13:06:08,977   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-01T13:06:08,980   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2025-06-01T13:06:08,982   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-01T13:06:08,985   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2025-06-01T13:06:08,988   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2025-06-01T13:06:08,990   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2025-06-01T13:06:08,993   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-01T13:06:08,996   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2025-06-01T13:06:08,999   creating build/lib/deepspeed/nebula
2025-06-01T13:06:09,000   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2025-06-01T13:06:09,002   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2025-06-01T13:06:09,005   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2025-06-01T13:06:09,007   creating build/lib/deepspeed/inference
2025-06-01T13:06:09,009   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2025-06-01T13:06:09,012   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2025-06-01T13:06:09,015   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2025-06-01T13:06:09,018   creating build/lib/deepspeed/module_inject
2025-06-01T13:06:09,020   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2025-06-01T13:06:09,023   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2025-06-01T13:06:09,025   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2025-06-01T13:06:09,028   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2025-06-01T13:06:09,030   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2025-06-01T13:06:09,032   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2025-06-01T13:06:09,036   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2025-06-01T13:06:09,039   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2025-06-01T13:06:09,042   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2025-06-01T13:06:09,046   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2025-06-01T13:06:09,048   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2025-06-01T13:06:09,051   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2025-06-01T13:06:09,053   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2025-06-01T13:06:09,056   creating build/lib/deepspeed/elasticity
2025-06-01T13:06:09,057   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2025-06-01T13:06:09,060   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2025-06-01T13:06:09,063   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2025-06-01T13:06:09,065   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2025-06-01T13:06:09,067   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2025-06-01T13:06:09,070   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2025-06-01T13:06:09,073   creating build/lib/deepspeed/comm
2025-06-01T13:06:09,074   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2025-06-01T13:06:09,077   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2025-06-01T13:06:09,080   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2025-06-01T13:06:09,082   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2025-06-01T13:06:09,085   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2025-06-01T13:06:09,088   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2025-06-01T13:06:09,090   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2025-06-01T13:06:09,092   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2025-06-01T13:06:09,094   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2025-06-01T13:06:09,097   creating build/lib/deepspeed/compile
2025-06-01T13:06:09,099   copying deepspeed/compile/patch_compiled_func.py -> build/lib/deepspeed/compile
2025-06-01T13:06:09,101   copying deepspeed/compile/inductor.py -> build/lib/deepspeed/compile
2025-06-01T13:06:09,104   copying deepspeed/compile/graph_param.py -> build/lib/deepspeed/compile
2025-06-01T13:06:09,106   copying deepspeed/compile/init_z3.py -> build/lib/deepspeed/compile
2025-06-01T13:06:09,108   copying deepspeed/compile/util.py -> build/lib/deepspeed/compile
2025-06-01T13:06:09,111   copying deepspeed/compile/partitioner.py -> build/lib/deepspeed/compile
2025-06-01T13:06:09,113   copying deepspeed/compile/init_z1.py -> build/lib/deepspeed/compile
2025-06-01T13:06:09,116   copying deepspeed/compile/__init__.py -> build/lib/deepspeed/compile
2025-06-01T13:06:09,118   copying deepspeed/compile/patch_fake_tensor.py -> build/lib/deepspeed/compile
2025-06-01T13:06:09,120   copying deepspeed/compile/config.py -> build/lib/deepspeed/compile
2025-06-01T13:06:09,122   copying deepspeed/compile/fx.py -> build/lib/deepspeed/compile
2025-06-01T13:06:09,125   copying deepspeed/compile/backend.py -> build/lib/deepspeed/compile
2025-06-01T13:06:09,127   copying deepspeed/compile/list_schedule.py -> build/lib/deepspeed/compile
2025-06-01T13:06:09,131   creating build/lib/deepspeed/autotuning
2025-06-01T13:06:09,132   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2025-06-01T13:06:09,136   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2025-06-01T13:06:09,138   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2025-06-01T13:06:09,141   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2025-06-01T13:06:09,144   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2025-06-01T13:06:09,146   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2025-06-01T13:06:09,151   creating build/lib/deepspeed/accelerator
2025-06-01T13:06:09,152   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T13:06:09,155   copying deepspeed/accelerator/sdaa_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T13:06:09,158   copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T13:06:09,160   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T13:06:09,163   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2025-06-01T13:06:09,165   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T13:06:09,168   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T13:06:09,171   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T13:06:09,173   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T13:06:09,176   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T13:06:09,179   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T13:06:09,183   creating build/lib/deepspeed/nvme
2025-06-01T13:06:09,184   copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme
2025-06-01T13:06:09,187   copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme
2025-06-01T13:06:09,189   copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme
2025-06-01T13:06:09,192   copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme
2025-06-01T13:06:09,194   copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme
2025-06-01T13:06:09,196   copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme
2025-06-01T13:06:09,199   copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme
2025-06-01T13:06:09,201   copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme
2025-06-01T13:06:09,203   copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme
2025-06-01T13:06:09,205   copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme
2025-06-01T13:06:09,208   copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme
2025-06-01T13:06:09,210   copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme
2025-06-01T13:06:09,214   creating build/lib/deepspeed/utils
2025-06-01T13:06:09,215   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,218   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,221   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,223   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,226   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,229   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,232   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,234   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,237   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,239   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,242   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,246   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,248   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,251   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,254   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,256   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,258   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,261   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2025-06-01T13:06:09,265   creating build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,266   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,269   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,272   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,275   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,278   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,281   copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,283   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,285   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,289   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,295   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,300   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,304   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,306   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,312   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,316   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,318   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,321   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2025-06-01T13:06:09,325   creating build/lib/deepspeed/runtime/fp16
2025-06-01T13:06:09,326   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-06-01T13:06:09,329   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2025-06-01T13:06:09,332   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-06-01T13:06:09,335   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2025-06-01T13:06:09,338   creating build/lib/deepspeed/runtime/domino
2025-06-01T13:06:09,340   copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino
2025-06-01T13:06:09,343   copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino
2025-06-01T13:06:09,346   copying deepspeed/runtime/domino/async_linear.py -> build/lib/deepspeed/runtime/domino
2025-06-01T13:06:09,349   creating build/lib/deepspeed/runtime/compression
2025-06-01T13:06:09,351   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2025-06-01T13:06:09,353   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2025-06-01T13:06:09,356   creating build/lib/deepspeed/runtime/activation_checkpointing
2025-06-01T13:06:09,357   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-01T13:06:09,360   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-01T13:06:09,363   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-01T13:06:09,367   creating build/lib/deepspeed/runtime/pipe
2025-06-01T13:06:09,369   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2025-06-01T13:06:09,373   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2025-06-01T13:06:09,375   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2025-06-01T13:06:09,378   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2025-06-01T13:06:09,382   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2025-06-01T13:06:09,386   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2025-06-01T13:06:09,390   creating build/lib/deepspeed/runtime/tensor_parallel
2025-06-01T13:06:09,392   copying deepspeed/runtime/tensor_parallel/__init__.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-01T13:06:09,395   copying deepspeed/runtime/tensor_parallel/config.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-01T13:06:09,397   copying deepspeed/runtime/tensor_parallel/tp_manager.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-01T13:06:09,401   creating build/lib/deepspeed/runtime/comm
2025-06-01T13:06:09,402   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2025-06-01T13:06:09,406   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2025-06-01T13:06:09,409   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2025-06-01T13:06:09,411   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2025-06-01T13:06:09,414   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2025-06-01T13:06:09,418   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2025-06-01T13:06:09,422   creating build/lib/deepspeed/runtime/swap_tensor
2025-06-01T13:06:09,424   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T13:06:09,428   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T13:06:09,431   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T13:06:09,434   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T13:06:09,437   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T13:06:09,440   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T13:06:09,443   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T13:06:09,447   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T13:06:09,450   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T13:06:09,455   creating build/lib/deepspeed/runtime/data_pipeline
2025-06-01T13:06:09,457   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-01T13:06:09,461   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-01T13:06:09,465   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-01T13:06:09,468   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-01T13:06:09,473   creating build/lib/deepspeed/runtime/checkpoint_engine
2025-06-01T13:06:09,475   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-01T13:06:09,480   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-01T13:06:09,484   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-01T13:06:09,487   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-01T13:06:09,491   creating build/lib/deepspeed/runtime/fp16/onebit
2025-06-01T13:06:09,492   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-01T13:06:09,496   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-01T13:06:09,500   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-01T13:06:09,503   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-01T13:06:09,508   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-01T13:06:09,510   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-01T13:06:09,514   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-01T13:06:09,517   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-01T13:06:09,521   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-01T13:06:09,525   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-01T13:06:09,528   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T13:06:09,529   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T13:06:09,532   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T13:06:09,536   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T13:06:09,539   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T13:06:09,541   copying deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T13:06:09,544   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T13:06:09,548   creating build/lib/deepspeed/ops/gds
2025-06-01T13:06:09,550   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2025-06-01T13:06:09,553   creating build/lib/deepspeed/ops/transformer
2025-06-01T13:06:09,554   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2025-06-01T13:06:09,558   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2025-06-01T13:06:09,561   creating build/lib/deepspeed/ops/fp_quantizer
2025-06-01T13:06:09,562   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-01T13:06:09,564   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-01T13:06:09,566   copying deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-01T13:06:09,569   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-01T13:06:09,572   creating build/lib/deepspeed/ops/adam
2025-06-01T13:06:09,573   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2025-06-01T13:06:09,576   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2025-06-01T13:06:09,579   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2025-06-01T13:06:09,581   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2025-06-01T13:06:09,583   creating build/lib/deepspeed/ops/lion
2025-06-01T13:06:09,585   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2025-06-01T13:06:09,587   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2025-06-01T13:06:09,589   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2025-06-01T13:06:09,592   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2025-06-01T13:06:09,594   creating build/lib/deepspeed/ops/lamb
2025-06-01T13:06:09,595   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2025-06-01T13:06:09,597   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2025-06-01T13:06:09,600   creating build/lib/deepspeed/ops/sparse_attention
2025-06-01T13:06:09,602   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-01T13:06:09,604   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-01T13:06:09,607   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-01T13:06:09,610   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-01T13:06:09,613   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-01T13:06:09,615   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-01T13:06:09,617   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-01T13:06:09,621   creating build/lib/deepspeed/ops/adagrad
2025-06-01T13:06:09,622   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2025-06-01T13:06:09,625   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2025-06-01T13:06:09,627   creating build/lib/deepspeed/ops/compile
2025-06-01T13:06:09,628   copying deepspeed/ops/compile/__init__.py -> build/lib/deepspeed/ops/compile
2025-06-01T13:06:09,631   creating build/lib/deepspeed/ops/aio
2025-06-01T13:06:09,632   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2025-06-01T13:06:09,636   creating build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,637   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,640   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,642   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,644   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,648   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,650   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,652   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,655   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,657   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,660   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,662   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,665   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,667   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,669   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,671   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,674   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,676   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,679   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,681   copying deepspeed/ops/op_builder/dc.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,683   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,686   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,689   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,691   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,693   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,696   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T13:06:09,699   creating build/lib/deepspeed/ops/quantizer
2025-06-01T13:06:09,700   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2025-06-01T13:06:09,703   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2025-06-01T13:06:09,705   creating build/lib/deepspeed/ops/deepspeed4science
2025-06-01T13:06:09,706   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2025-06-01T13:06:09,709   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2025-06-01T13:06:09,712   creating build/lib/deepspeed/ops/random_ltd
2025-06-01T13:06:09,713   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2025-06-01T13:06:09,715   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2025-06-01T13:06:09,719   creating build/lib/deepspeed/ops/transformer/inference
2025-06-01T13:06:09,720   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T13:06:09,723   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T13:06:09,725   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T13:06:09,727   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T13:06:09,730   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T13:06:09,733   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T13:06:09,735   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T13:06:09,738   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T13:06:09,740   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T13:06:09,743   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T13:06:09,747   creating build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:09,748   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:09,751   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:09,754   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:09,757   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:09,759   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:09,762   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:09,764   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:09,766   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:09,769   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:09,771   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:09,775   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,777   copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,779   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,782   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,784   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,786   copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,789   copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,791   copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,793   copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,795   copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,798   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,800   copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,802   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,804   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,807   copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,809   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,811   copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,813   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,815   copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,817   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,820   copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,822   copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,825   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,828   copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:09,830   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-01T13:06:09,831   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-01T13:06:09,834   creating build/lib/deepspeed/ops/op_builder/hpu
2025-06-01T13:06:09,836   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-01T13:06:09,838   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-01T13:06:09,840   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-01T13:06:09,842   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-01T13:06:09,844   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-01T13:06:09,847   copying deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-01T13:06:09,849   copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-01T13:06:09,852   creating build/lib/deepspeed/ops/op_builder/cpu
2025-06-01T13:06:09,853   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-01T13:06:09,855   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-01T13:06:09,857   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-01T13:06:09,860   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-01T13:06:09,862   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-01T13:06:09,864   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-01T13:06:09,866   copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-01T13:06:09,869   creating build/lib/deepspeed/ops/op_builder/npu
2025-06-01T13:06:09,871   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T13:06:09,873   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T13:06:09,876   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T13:06:09,879   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T13:06:09,881   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T13:06:09,883   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T13:06:09,885   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T13:06:09,887   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T13:06:09,890   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T13:06:09,893   creating build/lib/deepspeed/ops/op_builder/sdaa
2025-06-01T13:06:09,894   copying deepspeed/ops/op_builder/sdaa/no_impl.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-01T13:06:09,897   copying deepspeed/ops/op_builder/sdaa/builder.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-01T13:06:09,899   copying deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-01T13:06:09,902   copying deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-01T13:06:09,904   copying deepspeed/ops/op_builder/sdaa/__init__.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-01T13:06:09,907   creating build/lib/deepspeed/ops/op_builder/mlu
2025-06-01T13:06:09,908   copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-01T13:06:09,910   copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-01T13:06:09,913   copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-01T13:06:09,915   copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-01T13:06:09,917   copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-01T13:06:09,919   copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-01T13:06:09,922   creating build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T13:06:09,923   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T13:06:09,925   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T13:06:09,927   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T13:06:09,929   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T13:06:09,932   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T13:06:09,934   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T13:06:09,937   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T13:06:09,940   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T13:06:09,943   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T13:06:09,945   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T13:06:09,948   creating build/lib/deepspeed/model_implementations/diffusers
2025-06-01T13:06:09,949   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-01T13:06:09,952   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-01T13:06:09,954   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-01T13:06:09,957   creating build/lib/deepspeed/model_implementations/features
2025-06-01T13:06:09,958   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2025-06-01T13:06:09,960   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2025-06-01T13:06:09,963   creating build/lib/deepspeed/model_implementations/transformers
2025-06-01T13:06:09,964   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T13:06:09,967   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T13:06:09,970   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T13:06:09,972   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T13:06:09,974   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T13:06:09,976   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T13:06:09,978   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T13:06:09,981   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T13:06:09,983   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T13:06:09,986   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T13:06:09,988   creating build/lib/deepspeed/profiling/flops_profiler
2025-06-01T13:06:09,990   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2025-06-01T13:06:09,994   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2025-06-01T13:06:09,997   creating build/lib/deepspeed/inference/quantization
2025-06-01T13:06:09,998   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2025-06-01T13:06:10,001   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2025-06-01T13:06:10,003   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2025-06-01T13:06:10,005   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2025-06-01T13:06:10,007   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2025-06-01T13:06:10,010   creating build/lib/deepspeed/inference/v2
2025-06-01T13:06:10,012   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2025-06-01T13:06:10,014   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2025-06-01T13:06:10,016   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2025-06-01T13:06:10,018   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2025-06-01T13:06:10,020   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2025-06-01T13:06:10,023   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2025-06-01T13:06:10,025   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2025-06-01T13:06:10,027   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2025-06-01T13:06:10,029   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2025-06-01T13:06:10,033   creating build/lib/deepspeed/inference/v2/model_implementations
2025-06-01T13:06:10,034   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-01T13:06:10,037   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-01T13:06:10,040   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-01T13:06:10,043   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-01T13:06:10,045   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-01T13:06:10,048   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-01T13:06:10,051   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-01T13:06:10,055   creating build/lib/deepspeed/inference/v2/ragged
2025-06-01T13:06:10,056   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-01T13:06:10,060   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-01T13:06:10,062   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-01T13:06:10,065   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-01T13:06:10,068   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-01T13:06:10,070   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-01T13:06:10,073   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-01T13:06:10,076   creating build/lib/deepspeed/inference/v2/checkpoint
2025-06-01T13:06:10,077   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-01T13:06:10,080   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-01T13:06:10,081   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-01T13:06:10,084   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-01T13:06:10,086   creating build/lib/deepspeed/inference/v2/modules
2025-06-01T13:06:10,087   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2025-06-01T13:06:10,090   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2025-06-01T13:06:10,092   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2025-06-01T13:06:10,094   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2025-06-01T13:06:10,097   creating build/lib/deepspeed/inference/v2/kernels
2025-06-01T13:06:10,098   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2025-06-01T13:06:10,100   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2025-06-01T13:06:10,103   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T13:06:10,104   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T13:06:10,107   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T13:06:10,109   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T13:06:10,112   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T13:06:10,114   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-01T13:06:10,116   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-01T13:06:10,118   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-01T13:06:10,120   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-01T13:06:10,123   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-01T13:06:10,126   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-01T13:06:10,128   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-01T13:06:10,130   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-01T13:06:10,132   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-01T13:06:10,135   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-01T13:06:10,137   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-01T13:06:10,138   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-01T13:06:10,141   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-01T13:06:10,143   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-01T13:06:10,146   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-01T13:06:10,149   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:10,150   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:10,152   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:10,154   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:10,157   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:10,159   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:10,161   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:10,163   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:10,165   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:10,168   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:10,170   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T13:06:10,172   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T13:06:10,174   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T13:06:10,176   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T13:06:10,179   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T13:06:10,182   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T13:06:10,183   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T13:06:10,185   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T13:06:10,188   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T13:06:10,190   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T13:06:10,193   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-01T13:06:10,194   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-01T13:06:10,196   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-01T13:06:10,198   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-01T13:06:10,200   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-01T13:06:10,203   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:10,204   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:10,207   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:10,209   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:10,211   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:10,213   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:10,215   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:10,217   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:10,220   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:10,222   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:10,225   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-01T13:06:10,226   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-01T13:06:10,229   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-01T13:06:10,231   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-01T13:06:10,233   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-01T13:06:10,236   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-01T13:06:10,237   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-01T13:06:10,239   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-01T13:06:10,242   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-01T13:06:10,244   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-01T13:06:10,247   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T13:06:10,248   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T13:06:10,251   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T13:06:10,253   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T13:06:10,255   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T13:06:10,258   creating build/lib/deepspeed/inference/v2/modules/configs
2025-06-01T13:06:10,259   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-01T13:06:10,262   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-01T13:06:10,264   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-01T13:06:10,266   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-01T13:06:10,268   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-01T13:06:10,271   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-01T13:06:10,273   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-01T13:06:10,276   creating build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:10,277   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:10,279   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:10,282   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:10,284   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:10,286   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:10,289   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:10,291   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:10,293   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:10,296   creating build/lib/deepspeed/inference/v2/modules/implementations
2025-06-01T13:06:10,297   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2025-06-01T13:06:10,300   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-01T13:06:10,301   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-01T13:06:10,304   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-01T13:06:10,306   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-01T13:06:10,308   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-01T13:06:10,310   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-01T13:06:10,313   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-01T13:06:10,314   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-01T13:06:10,317   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-01T13:06:10,320   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-01T13:06:10,322   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-01T13:06:10,324   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-01T13:06:10,326   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-01T13:06:10,329   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-01T13:06:10,330   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-01T13:06:10,333   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-01T13:06:10,336   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-01T13:06:10,337   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-01T13:06:10,339   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-01T13:06:10,342   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-01T13:06:10,344   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-01T13:06:10,346   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-01T13:06:10,348   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-01T13:06:10,351   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-01T13:06:10,352   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-01T13:06:10,355   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-01T13:06:10,356   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-01T13:06:10,359   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-01T13:06:10,360   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-01T13:06:10,363   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T13:06:10,365   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T13:06:10,367   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T13:06:10,370   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T13:06:10,371   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T13:06:10,373   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T13:06:10,376   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T13:06:10,378   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T13:06:10,380   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T13:06:10,382   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T13:06:10,384   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T13:06:10,386   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T13:06:10,389   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T13:06:10,390   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T13:06:10,393   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T13:06:10,395   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T13:06:10,396   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T13:06:10,399   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T13:06:10,402   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T13:06:10,403   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T13:06:10,405   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T13:06:10,408   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:10,410   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:10,412   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:10,414   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:10,416   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:10,418   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:10,421   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T13:06:10,422   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T13:06:10,424   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T13:06:10,427   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T13:06:10,428   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T13:06:10,431   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T13:06:10,434   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:10,435   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:10,437   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:10,440   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:10,442   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:10,444   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T13:06:10,445   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T13:06:10,448   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T13:06:10,451   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T13:06:10,452   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T13:06:10,454   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T13:06:10,457   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T13:06:10,459   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T13:06:10,461   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T13:06:10,464   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T13:06:10,465   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T13:06:10,468   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T13:06:10,470   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T13:06:10,472   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T13:06:10,474   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T13:06:10,477   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T13:06:10,478   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T13:06:10,481   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T13:06:10,484   creating build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,485   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,489   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,492   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,495   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,498   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,500   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,503   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,505   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,508   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,510   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,512   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,515   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,518   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,520   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,523   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,525   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,528   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,531   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,533   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T13:06:10,536   creating build/lib/deepspeed/module_inject/containers/features
2025-06-01T13:06:10,538   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-01T13:06:10,540   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-01T13:06:10,542   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-01T13:06:10,545   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-01T13:06:10,547   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-01T13:06:10,551   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-01T13:06:10,554   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-01T13:06:10,557   creating build/lib/deepspeed/compile/passes
2025-06-01T13:06:10,558   copying deepspeed/compile/passes/selective_gather.py -> build/lib/deepspeed/compile/passes
2025-06-01T13:06:10,561   copying deepspeed/compile/passes/zero3_compile.py -> build/lib/deepspeed/compile/passes
2025-06-01T13:06:10,564   copying deepspeed/compile/passes/zero1_compile.py -> build/lib/deepspeed/compile/passes
2025-06-01T13:06:10,566   copying deepspeed/compile/passes/offload_adam_states.py -> build/lib/deepspeed/compile/passes
2025-06-01T13:06:10,569   copying deepspeed/compile/passes/__init__.py -> build/lib/deepspeed/compile/passes
2025-06-01T13:06:10,571   copying deepspeed/compile/passes/prefetch.py -> build/lib/deepspeed/compile/passes
2025-06-01T13:06:10,574   copying deepspeed/compile/passes/offload_activation.py -> build/lib/deepspeed/compile/passes
2025-06-01T13:06:10,576   copying deepspeed/compile/passes/offload_parameters.py -> build/lib/deepspeed/compile/passes
2025-06-01T13:06:10,579   creating build/lib/deepspeed/compile/profilers
2025-06-01T13:06:10,580   copying deepspeed/compile/profilers/graph_profile.py -> build/lib/deepspeed/compile/profilers
2025-06-01T13:06:10,583   copying deepspeed/compile/profilers/__init__.py -> build/lib/deepspeed/compile/profilers
2025-06-01T13:06:10,585   copying deepspeed/compile/profilers/comm_profile.py -> build/lib/deepspeed/compile/profilers
2025-06-01T13:06:10,588   creating build/lib/deepspeed/autotuning/tuner
2025-06-01T13:06:10,589   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2025-06-01T13:06:10,591   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-01T13:06:10,593   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2025-06-01T13:06:10,595   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2025-06-01T13:06:10,597   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-01T13:06:10,600   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-01T13:06:10,603   running egg_info
2025-06-01T13:06:10,633   writing deepspeed.egg-info/PKG-INFO
2025-06-01T13:06:10,670   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2025-06-01T13:06:10,672   writing entry points to deepspeed.egg-info/entry_points.txt
2025-06-01T13:06:10,691   writing requirements to deepspeed.egg-info/requires.txt
2025-06-01T13:06:10,692   writing top-level names to deepspeed.egg-info/top_level.txt
2025-06-01T13:06:10,844   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-06-01T13:06:10,917   reading manifest template 'MANIFEST.in'
2025-06-01T13:06:10,919   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-06-01T13:06:10,919   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-06-01T13:06:12,903   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-06-01T13:06:14,090   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-06-01T13:06:15,107   warning: no files found matching '*.tr' under directory 'csrc'
2025-06-01T13:06:15,271   warning: no files found matching '*.cc' under directory 'csrc'
2025-06-01T13:06:15,331   warning: no files found matching '*.py' under directory 'benchmarks'
2025-06-01T13:06:15,337   adding license file 'LICENSE'
2025-06-01T13:06:15,396   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-06-01T13:06:15,406   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2025-06-01T13:06:15,406   !!

2025-06-01T13:06:15,408           ********************************************************************************
2025-06-01T13:06:15,408           ############################
2025-06-01T13:06:15,409           # Package would be ignored #
2025-06-01T13:06:15,409           ############################
2025-06-01T13:06:15,410           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2025-06-01T13:06:15,410           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,411           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,412           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2025-06-01T13:06:15,413           to the `packages` configuration field.

2025-06-01T13:06:15,414           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,415           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,415           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,417           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,417           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,418           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2025-06-01T13:06:15,419           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2025-06-01T13:06:15,419           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,420           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,420           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,421           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,422           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,423           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,424                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,424                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,425                 directory, all directories are treated like packages.
2025-06-01T13:06:15,425           ********************************************************************************

2025-06-01T13:06:15,426   !!
2025-06-01T13:06:15,426     check.warn(importable)
2025-06-01T13:06:15,427   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2025-06-01T13:06:15,427   !!

2025-06-01T13:06:15,429           ********************************************************************************
2025-06-01T13:06:15,429           ############################
2025-06-01T13:06:15,430           # Package would be ignored #
2025-06-01T13:06:15,430           ############################
2025-06-01T13:06:15,431           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2025-06-01T13:06:15,431           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,432           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,433           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2025-06-01T13:06:15,433           to the `packages` configuration field.

2025-06-01T13:06:15,434           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,435           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,435           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,436           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,437           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,438           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2025-06-01T13:06:15,438           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2025-06-01T13:06:15,439           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,439           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,440           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,441           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,442           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,444           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,445                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,445                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,445                 directory, all directories are treated like packages.
2025-06-01T13:06:15,446           ********************************************************************************

2025-06-01T13:06:15,446   !!
2025-06-01T13:06:15,447     check.warn(importable)
2025-06-01T13:06:15,447   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2025-06-01T13:06:15,447   !!

2025-06-01T13:06:15,448           ********************************************************************************
2025-06-01T13:06:15,449           ############################
2025-06-01T13:06:15,449           # Package would be ignored #
2025-06-01T13:06:15,449           ############################
2025-06-01T13:06:15,450           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2025-06-01T13:06:15,450           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,451           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,451           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2025-06-01T13:06:15,452           to the `packages` configuration field.

2025-06-01T13:06:15,453           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,453           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,454           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,455           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,455           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,456           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2025-06-01T13:06:15,457           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2025-06-01T13:06:15,457           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,458           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,459           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,460           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,461           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,463           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,463                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,464                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,464                 directory, all directories are treated like packages.
2025-06-01T13:06:15,465           ********************************************************************************

2025-06-01T13:06:15,466   !!
2025-06-01T13:06:15,467     check.warn(importable)
2025-06-01T13:06:15,467   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2025-06-01T13:06:15,468   !!

2025-06-01T13:06:15,469           ********************************************************************************
2025-06-01T13:06:15,470           ############################
2025-06-01T13:06:15,470           # Package would be ignored #
2025-06-01T13:06:15,471           ############################
2025-06-01T13:06:15,472           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2025-06-01T13:06:15,472           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,473           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,474           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2025-06-01T13:06:15,474           to the `packages` configuration field.

2025-06-01T13:06:15,475           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,475           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,476           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,477           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,478           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,478           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2025-06-01T13:06:15,479           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2025-06-01T13:06:15,479           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,480           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,480           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,481           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,482           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,484           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,484                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,485                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,485                 directory, all directories are treated like packages.
2025-06-01T13:06:15,486           ********************************************************************************

2025-06-01T13:06:15,487   !!
2025-06-01T13:06:15,487     check.warn(importable)
2025-06-01T13:06:15,488   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2025-06-01T13:06:15,488   !!

2025-06-01T13:06:15,489           ********************************************************************************
2025-06-01T13:06:15,490           ############################
2025-06-01T13:06:15,491           # Package would be ignored #
2025-06-01T13:06:15,491           ############################
2025-06-01T13:06:15,492           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2025-06-01T13:06:15,492           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,493           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,494           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2025-06-01T13:06:15,494           to the `packages` configuration field.

2025-06-01T13:06:15,495           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,496           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,496           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,498           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,499           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,500           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2025-06-01T13:06:15,501           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2025-06-01T13:06:15,501           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,502           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,502           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,503           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,504           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,506           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,506                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,507                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,507                 directory, all directories are treated like packages.
2025-06-01T13:06:15,508           ********************************************************************************

2025-06-01T13:06:15,509   !!
2025-06-01T13:06:15,509     check.warn(importable)
2025-06-01T13:06:15,509   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2025-06-01T13:06:15,510   !!

2025-06-01T13:06:15,511           ********************************************************************************
2025-06-01T13:06:15,511           ############################
2025-06-01T13:06:15,512           # Package would be ignored #
2025-06-01T13:06:15,512           ############################
2025-06-01T13:06:15,513           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2025-06-01T13:06:15,513           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,515           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,515           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2025-06-01T13:06:15,516           to the `packages` configuration field.

2025-06-01T13:06:15,517           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,518           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,519           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,520           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,521           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,522           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2025-06-01T13:06:15,522           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2025-06-01T13:06:15,523           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,523           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,524           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,525           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,526           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,528           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,529                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,529                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,530                 directory, all directories are treated like packages.
2025-06-01T13:06:15,530           ********************************************************************************

2025-06-01T13:06:15,531   !!
2025-06-01T13:06:15,532     check.warn(importable)
2025-06-01T13:06:15,532   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2025-06-01T13:06:15,533   !!

2025-06-01T13:06:15,534           ********************************************************************************
2025-06-01T13:06:15,534           ############################
2025-06-01T13:06:15,535           # Package would be ignored #
2025-06-01T13:06:15,535           ############################
2025-06-01T13:06:15,535           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2025-06-01T13:06:15,536           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,537           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,537           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2025-06-01T13:06:15,538           to the `packages` configuration field.

2025-06-01T13:06:15,539           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,539           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,540           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,541           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,542           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,543           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2025-06-01T13:06:15,543           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2025-06-01T13:06:15,544           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,544           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,545           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,546           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,547           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,549           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,549                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,550                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,550                 directory, all directories are treated like packages.
2025-06-01T13:06:15,551           ********************************************************************************

2025-06-01T13:06:15,552   !!
2025-06-01T13:06:15,553     check.warn(importable)
2025-06-01T13:06:15,553   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2025-06-01T13:06:15,554   !!

2025-06-01T13:06:15,555           ********************************************************************************
2025-06-01T13:06:15,555           ############################
2025-06-01T13:06:15,556           # Package would be ignored #
2025-06-01T13:06:15,557           ############################
2025-06-01T13:06:15,557           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2025-06-01T13:06:15,558           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,559           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,560           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2025-06-01T13:06:15,560           to the `packages` configuration field.

2025-06-01T13:06:15,561           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,562           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,562           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,563           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,564           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,564           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2025-06-01T13:06:15,565           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2025-06-01T13:06:15,565           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,566           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,566           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,567           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,568           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,569           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,569                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,570                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,570                 directory, all directories are treated like packages.
2025-06-01T13:06:15,571           ********************************************************************************

2025-06-01T13:06:15,572   !!
2025-06-01T13:06:15,572     check.warn(importable)
2025-06-01T13:06:15,573   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2025-06-01T13:06:15,574   !!

2025-06-01T13:06:15,575           ********************************************************************************
2025-06-01T13:06:15,575           ############################
2025-06-01T13:06:15,576           # Package would be ignored #
2025-06-01T13:06:15,577           ############################
2025-06-01T13:06:15,577           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2025-06-01T13:06:15,578           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,579           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,580           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2025-06-01T13:06:15,580           to the `packages` configuration field.

2025-06-01T13:06:15,581           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,582           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,582           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,584           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,585           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,586           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2025-06-01T13:06:15,587           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2025-06-01T13:06:15,587           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,588           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,589           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,590           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,592           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,593           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,594                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,594                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,594                 directory, all directories are treated like packages.
2025-06-01T13:06:15,595           ********************************************************************************

2025-06-01T13:06:15,596   !!
2025-06-01T13:06:15,596     check.warn(importable)
2025-06-01T13:06:15,597   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2025-06-01T13:06:15,597   !!

2025-06-01T13:06:15,598           ********************************************************************************
2025-06-01T13:06:15,598           ############################
2025-06-01T13:06:15,599           # Package would be ignored #
2025-06-01T13:06:15,599           ############################
2025-06-01T13:06:15,600           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2025-06-01T13:06:15,600           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,601           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,602           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2025-06-01T13:06:15,602           to the `packages` configuration field.

2025-06-01T13:06:15,603           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,604           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,604           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,605           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,606           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,607           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2025-06-01T13:06:15,608           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2025-06-01T13:06:15,608           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,609           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,610           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,611           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,612           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,613           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,614                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,614                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,615                 directory, all directories are treated like packages.
2025-06-01T13:06:15,616           ********************************************************************************

2025-06-01T13:06:15,617   !!
2025-06-01T13:06:15,617     check.warn(importable)
2025-06-01T13:06:15,618   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2025-06-01T13:06:15,619   !!

2025-06-01T13:06:15,620           ********************************************************************************
2025-06-01T13:06:15,620           ############################
2025-06-01T13:06:15,621           # Package would be ignored #
2025-06-01T13:06:15,622           ############################
2025-06-01T13:06:15,622           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2025-06-01T13:06:15,623           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,624           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,624           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2025-06-01T13:06:15,624           to the `packages` configuration field.

2025-06-01T13:06:15,625           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,626           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,626           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,627           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,628           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,629           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2025-06-01T13:06:15,629           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2025-06-01T13:06:15,630           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,630           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,631           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,632           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,633           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,635           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,635                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,636                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,636                 directory, all directories are treated like packages.
2025-06-01T13:06:15,637           ********************************************************************************

2025-06-01T13:06:15,638   !!
2025-06-01T13:06:15,639     check.warn(importable)
2025-06-01T13:06:15,639   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2025-06-01T13:06:15,640   !!

2025-06-01T13:06:15,641           ********************************************************************************
2025-06-01T13:06:15,642           ############################
2025-06-01T13:06:15,642           # Package would be ignored #
2025-06-01T13:06:15,643           ############################
2025-06-01T13:06:15,644           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2025-06-01T13:06:15,644           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,645           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,646           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2025-06-01T13:06:15,646           to the `packages` configuration field.

2025-06-01T13:06:15,648           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,648           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,649           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,650           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,651           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,652           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2025-06-01T13:06:15,653           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2025-06-01T13:06:15,653           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,654           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,655           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,656           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,657           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,658           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,659                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,659                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,660                 directory, all directories are treated like packages.
2025-06-01T13:06:15,660           ********************************************************************************

2025-06-01T13:06:15,661   !!
2025-06-01T13:06:15,662     check.warn(importable)
2025-06-01T13:06:15,662   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2025-06-01T13:06:15,663   !!

2025-06-01T13:06:15,664           ********************************************************************************
2025-06-01T13:06:15,664           ############################
2025-06-01T13:06:15,665           # Package would be ignored #
2025-06-01T13:06:15,665           ############################
2025-06-01T13:06:15,666           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2025-06-01T13:06:15,667           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,668           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,668           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2025-06-01T13:06:15,669           to the `packages` configuration field.

2025-06-01T13:06:15,670           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,671           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,672           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,673           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,675           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,676           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2025-06-01T13:06:15,677           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2025-06-01T13:06:15,678           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,678           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,679           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,680           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,681           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,683           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,683                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,684                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,684                 directory, all directories are treated like packages.
2025-06-01T13:06:15,685           ********************************************************************************

2025-06-01T13:06:15,686   !!
2025-06-01T13:06:15,687     check.warn(importable)
2025-06-01T13:06:15,687   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.compile' is absent from the `packages` configuration.
2025-06-01T13:06:15,688   !!

2025-06-01T13:06:15,689           ********************************************************************************
2025-06-01T13:06:15,690           ############################
2025-06-01T13:06:15,690           # Package would be ignored #
2025-06-01T13:06:15,691           ############################
2025-06-01T13:06:15,691           Python recognizes 'deepspeed.ops.csrc.compile' as an importable package[^1],
2025-06-01T13:06:15,692           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,693           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,693           package, please make sure that 'deepspeed.ops.csrc.compile' is explicitly added
2025-06-01T13:06:15,693           to the `packages` configuration field.

2025-06-01T13:06:15,694           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,695           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,695           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,696           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,697           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,698           If you don't want 'deepspeed.ops.csrc.compile' to be distributed and are
2025-06-01T13:06:15,698           already explicitly excluding 'deepspeed.ops.csrc.compile' via
2025-06-01T13:06:15,699           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,700           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,700           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,701           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,702           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,704           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,704                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,705                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,705                 directory, all directories are treated like packages.
2025-06-01T13:06:15,706           ********************************************************************************

2025-06-01T13:06:15,707   !!
2025-06-01T13:06:15,708     check.warn(importable)
2025-06-01T13:06:15,708   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2025-06-01T13:06:15,709   !!

2025-06-01T13:06:15,710           ********************************************************************************
2025-06-01T13:06:15,710           ############################
2025-06-01T13:06:15,711           # Package would be ignored #
2025-06-01T13:06:15,712           ############################
2025-06-01T13:06:15,712           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2025-06-01T13:06:15,713           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,714           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,714           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2025-06-01T13:06:15,715           to the `packages` configuration field.

2025-06-01T13:06:15,716           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,717           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,718           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,719           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,720           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,721           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2025-06-01T13:06:15,721           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2025-06-01T13:06:15,722           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,722           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,723           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,723           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,724           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,726           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,726                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,727                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,727                 directory, all directories are treated like packages.
2025-06-01T13:06:15,727           ********************************************************************************

2025-06-01T13:06:15,728   !!
2025-06-01T13:06:15,729     check.warn(importable)
2025-06-01T13:06:15,729   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2025-06-01T13:06:15,730   !!

2025-06-01T13:06:15,731           ********************************************************************************
2025-06-01T13:06:15,732           ############################
2025-06-01T13:06:15,732           # Package would be ignored #
2025-06-01T13:06:15,733           ############################
2025-06-01T13:06:15,734           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2025-06-01T13:06:15,734           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,736           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,736           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2025-06-01T13:06:15,737           to the `packages` configuration field.

2025-06-01T13:06:15,738           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,739           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,739           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,740           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,741           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,742           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2025-06-01T13:06:15,743           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2025-06-01T13:06:15,743           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,744           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,744           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,746           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,747           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,749           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,749                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,750                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,751                 directory, all directories are treated like packages.
2025-06-01T13:06:15,751           ********************************************************************************

2025-06-01T13:06:15,752   !!
2025-06-01T13:06:15,752     check.warn(importable)
2025-06-01T13:06:15,753   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2025-06-01T13:06:15,753   !!

2025-06-01T13:06:15,754           ********************************************************************************
2025-06-01T13:06:15,754           ############################
2025-06-01T13:06:15,755           # Package would be ignored #
2025-06-01T13:06:15,755           ############################
2025-06-01T13:06:15,756           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2025-06-01T13:06:15,756           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,757           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,758           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2025-06-01T13:06:15,758           to the `packages` configuration field.

2025-06-01T13:06:15,759           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,760           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,761           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,762           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,763           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,765           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2025-06-01T13:06:15,765           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2025-06-01T13:06:15,766           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,766           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,767           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,768           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,769           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,771           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,771                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,772                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,772                 directory, all directories are treated like packages.
2025-06-01T13:06:15,773           ********************************************************************************

2025-06-01T13:06:15,774   !!
2025-06-01T13:06:15,774     check.warn(importable)
2025-06-01T13:06:15,775   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2025-06-01T13:06:15,775   !!

2025-06-01T13:06:15,776           ********************************************************************************
2025-06-01T13:06:15,777           ############################
2025-06-01T13:06:15,778           # Package would be ignored #
2025-06-01T13:06:15,778           ############################
2025-06-01T13:06:15,779           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2025-06-01T13:06:15,779           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,781           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,781           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2025-06-01T13:06:15,782           to the `packages` configuration field.

2025-06-01T13:06:15,783           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,784           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,784           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,785           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,786           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,787           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2025-06-01T13:06:15,787           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2025-06-01T13:06:15,788           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,788           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,789           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,790           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,791           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,792           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,792                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,793                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,793                 directory, all directories are treated like packages.
2025-06-01T13:06:15,794           ********************************************************************************

2025-06-01T13:06:15,795   !!
2025-06-01T13:06:15,796     check.warn(importable)
2025-06-01T13:06:15,797   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2025-06-01T13:06:15,797   !!

2025-06-01T13:06:15,798           ********************************************************************************
2025-06-01T13:06:15,799           ############################
2025-06-01T13:06:15,800           # Package would be ignored #
2025-06-01T13:06:15,800           ############################
2025-06-01T13:06:15,801           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2025-06-01T13:06:15,802           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,803           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,803           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2025-06-01T13:06:15,804           to the `packages` configuration field.

2025-06-01T13:06:15,805           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,806           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,806           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,807           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,809           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,810           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2025-06-01T13:06:15,810           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2025-06-01T13:06:15,811           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,812           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,812           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,813           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,814           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,815           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,816                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,816                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,817                 directory, all directories are treated like packages.
2025-06-01T13:06:15,817           ********************************************************************************

2025-06-01T13:06:15,818   !!
2025-06-01T13:06:15,819     check.warn(importable)
2025-06-01T13:06:15,819   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2025-06-01T13:06:15,820   !!

2025-06-01T13:06:15,820           ********************************************************************************
2025-06-01T13:06:15,821           ############################
2025-06-01T13:06:15,821           # Package would be ignored #
2025-06-01T13:06:15,822           ############################
2025-06-01T13:06:15,822           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2025-06-01T13:06:15,823           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,824           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,824           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2025-06-01T13:06:15,825           to the `packages` configuration field.

2025-06-01T13:06:15,826           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,827           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,827           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,828           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,829           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,830           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2025-06-01T13:06:15,831           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2025-06-01T13:06:15,831           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,832           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,832           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,833           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,834           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,836           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,836                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,837                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,837                 directory, all directories are treated like packages.
2025-06-01T13:06:15,838           ********************************************************************************

2025-06-01T13:06:15,839   !!
2025-06-01T13:06:15,839     check.warn(importable)
2025-06-01T13:06:15,840   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2025-06-01T13:06:15,840   !!

2025-06-01T13:06:15,842           ********************************************************************************
2025-06-01T13:06:15,842           ############################
2025-06-01T13:06:15,842           # Package would be ignored #
2025-06-01T13:06:15,843           ############################
2025-06-01T13:06:15,843           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2025-06-01T13:06:15,844           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,845           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,845           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2025-06-01T13:06:15,846           to the `packages` configuration field.

2025-06-01T13:06:15,847           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,847           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,848           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,849           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,850           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,851           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2025-06-01T13:06:15,852           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2025-06-01T13:06:15,852           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,853           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,854           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,855           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,856           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,858           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,859                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,860                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,860                 directory, all directories are treated like packages.
2025-06-01T13:06:15,861           ********************************************************************************

2025-06-01T13:06:15,862   !!
2025-06-01T13:06:15,863     check.warn(importable)
2025-06-01T13:06:15,863   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2025-06-01T13:06:15,864   !!

2025-06-01T13:06:15,865           ********************************************************************************
2025-06-01T13:06:15,866           ############################
2025-06-01T13:06:15,866           # Package would be ignored #
2025-06-01T13:06:15,867           ############################
2025-06-01T13:06:15,867           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2025-06-01T13:06:15,868           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,869           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,870           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2025-06-01T13:06:15,870           to the `packages` configuration field.

2025-06-01T13:06:15,871           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,872           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,872           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,873           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,874           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,874           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2025-06-01T13:06:15,875           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2025-06-01T13:06:15,875           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,876           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,876           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,877           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,878           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,879           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,879                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,880                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,880                 directory, all directories are treated like packages.
2025-06-01T13:06:15,881           ********************************************************************************

2025-06-01T13:06:15,882   !!
2025-06-01T13:06:15,883     check.warn(importable)
2025-06-01T13:06:15,883   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2025-06-01T13:06:15,884   !!

2025-06-01T13:06:15,885           ********************************************************************************
2025-06-01T13:06:15,886           ############################
2025-06-01T13:06:15,886           # Package would be ignored #
2025-06-01T13:06:15,887           ############################
2025-06-01T13:06:15,887           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2025-06-01T13:06:15,888           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,889           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,889           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2025-06-01T13:06:15,890           to the `packages` configuration field.

2025-06-01T13:06:15,891           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,891           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,892           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,893           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,894           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,895           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2025-06-01T13:06:15,895           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2025-06-01T13:06:15,896           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,896           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,897           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,898           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,899           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,900           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,901                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,901                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,902                 directory, all directories are treated like packages.
2025-06-01T13:06:15,902           ********************************************************************************

2025-06-01T13:06:15,903   !!
2025-06-01T13:06:15,903     check.warn(importable)
2025-06-01T13:06:15,904   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2025-06-01T13:06:15,904   !!

2025-06-01T13:06:15,905           ********************************************************************************
2025-06-01T13:06:15,906           ############################
2025-06-01T13:06:15,906           # Package would be ignored #
2025-06-01T13:06:15,906           ############################
2025-06-01T13:06:15,907           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2025-06-01T13:06:15,908           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,908           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,909           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2025-06-01T13:06:15,909           to the `packages` configuration field.

2025-06-01T13:06:15,910           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,911           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,911           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,912           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,913           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,914           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2025-06-01T13:06:15,915           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2025-06-01T13:06:15,915           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,916           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,917           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,918           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,919           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,921           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,922                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,922                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,923                 directory, all directories are treated like packages.
2025-06-01T13:06:15,923           ********************************************************************************

2025-06-01T13:06:15,925   !!
2025-06-01T13:06:15,925     check.warn(importable)
2025-06-01T13:06:15,926   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2025-06-01T13:06:15,926   !!

2025-06-01T13:06:15,928           ********************************************************************************
2025-06-01T13:06:15,929           ############################
2025-06-01T13:06:15,930           # Package would be ignored #
2025-06-01T13:06:15,932           ############################
2025-06-01T13:06:15,933           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2025-06-01T13:06:15,937           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,938           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,938           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2025-06-01T13:06:15,939           to the `packages` configuration field.

2025-06-01T13:06:15,940           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,940           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,941           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,942           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,943           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,944           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2025-06-01T13:06:15,944           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2025-06-01T13:06:15,945           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,945           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,946           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,947           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,948           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,950           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,951                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,951                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,952                 directory, all directories are treated like packages.
2025-06-01T13:06:15,952           ********************************************************************************

2025-06-01T13:06:15,953   !!
2025-06-01T13:06:15,954     check.warn(importable)
2025-06-01T13:06:15,954   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2025-06-01T13:06:15,955   !!

2025-06-01T13:06:15,956           ********************************************************************************
2025-06-01T13:06:15,956           ############################
2025-06-01T13:06:15,957           # Package would be ignored #
2025-06-01T13:06:15,957           ############################
2025-06-01T13:06:15,958           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2025-06-01T13:06:15,958           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,959           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,960           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2025-06-01T13:06:15,960           to the `packages` configuration field.

2025-06-01T13:06:15,961           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,962           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,962           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,963           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,965           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,966           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2025-06-01T13:06:15,966           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2025-06-01T13:06:15,967           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,967           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,968           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,969           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,970           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,971           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,972                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,972                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,972                 directory, all directories are treated like packages.
2025-06-01T13:06:15,973           ********************************************************************************

2025-06-01T13:06:15,974   !!
2025-06-01T13:06:15,974     check.warn(importable)
2025-06-01T13:06:15,975   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2025-06-01T13:06:15,975   !!

2025-06-01T13:06:15,976           ********************************************************************************
2025-06-01T13:06:15,977           ############################
2025-06-01T13:06:15,977           # Package would be ignored #
2025-06-01T13:06:15,978           ############################
2025-06-01T13:06:15,978           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2025-06-01T13:06:15,979           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:15,980           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:15,981           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2025-06-01T13:06:15,981           to the `packages` configuration field.

2025-06-01T13:06:15,982           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:15,983           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:15,983           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:15,984           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:15,985           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:15,986           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2025-06-01T13:06:15,987           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2025-06-01T13:06:15,987           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:15,988           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:15,988           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:15,990           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:15,991           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:15,992           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:15,993                 even if it does not contain any `.py` files.
2025-06-01T13:06:15,993                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:15,994                 directory, all directories are treated like packages.
2025-06-01T13:06:15,994           ********************************************************************************

2025-06-01T13:06:15,995   !!
2025-06-01T13:06:15,996     check.warn(importable)
2025-06-01T13:06:15,997   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2025-06-01T13:06:15,997   !!

2025-06-01T13:06:15,998           ********************************************************************************
2025-06-01T13:06:15,999           ############################
2025-06-01T13:06:15,999           # Package would be ignored #
2025-06-01T13:06:15,999           ############################
2025-06-01T13:06:16,000           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2025-06-01T13:06:16,000           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:16,001           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:16,002           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2025-06-01T13:06:16,002           to the `packages` configuration field.

2025-06-01T13:06:16,003           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:16,003           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:16,004           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:16,005           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:16,006           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:16,007           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2025-06-01T13:06:16,007           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2025-06-01T13:06:16,008           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:16,008           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:16,009           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:16,010           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:16,011           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:16,012           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:16,013                 even if it does not contain any `.py` files.
2025-06-01T13:06:16,013                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:16,014                 directory, all directories are treated like packages.
2025-06-01T13:06:16,014           ********************************************************************************

2025-06-01T13:06:16,015   !!
2025-06-01T13:06:16,016     check.warn(importable)
2025-06-01T13:06:16,016   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2025-06-01T13:06:16,017   !!

2025-06-01T13:06:16,018           ********************************************************************************
2025-06-01T13:06:16,018           ############################
2025-06-01T13:06:16,019           # Package would be ignored #
2025-06-01T13:06:16,019           ############################
2025-06-01T13:06:16,020           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2025-06-01T13:06:16,020           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:16,021           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:16,022           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2025-06-01T13:06:16,022           to the `packages` configuration field.

2025-06-01T13:06:16,023           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:16,024           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:16,025           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:16,026           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:16,027           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:16,028           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2025-06-01T13:06:16,028           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2025-06-01T13:06:16,028           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:16,029           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:16,029           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:16,030           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:16,031           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:16,032           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:16,033                 even if it does not contain any `.py` files.
2025-06-01T13:06:16,033                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:16,034                 directory, all directories are treated like packages.
2025-06-01T13:06:16,034           ********************************************************************************

2025-06-01T13:06:16,035   !!
2025-06-01T13:06:16,036     check.warn(importable)
2025-06-01T13:06:16,036   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2025-06-01T13:06:16,037   !!

2025-06-01T13:06:16,038           ********************************************************************************
2025-06-01T13:06:16,038           ############################
2025-06-01T13:06:16,039           # Package would be ignored #
2025-06-01T13:06:16,039           ############################
2025-06-01T13:06:16,040           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2025-06-01T13:06:16,040           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:16,041           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:16,042           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2025-06-01T13:06:16,042           to the `packages` configuration field.

2025-06-01T13:06:16,043           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:16,044           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:16,044           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:16,045           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:16,046           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:16,048           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2025-06-01T13:06:16,048           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2025-06-01T13:06:16,049           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:16,049           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:16,050           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:16,051           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:16,052           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:16,054           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:16,054                 even if it does not contain any `.py` files.
2025-06-01T13:06:16,055                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:16,055                 directory, all directories are treated like packages.
2025-06-01T13:06:16,056           ********************************************************************************

2025-06-01T13:06:16,057   !!
2025-06-01T13:06:16,057     check.warn(importable)
2025-06-01T13:06:16,058   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2025-06-01T13:06:16,058   !!

2025-06-01T13:06:16,059           ********************************************************************************
2025-06-01T13:06:16,060           ############################
2025-06-01T13:06:16,060           # Package would be ignored #
2025-06-01T13:06:16,061           ############################
2025-06-01T13:06:16,061           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2025-06-01T13:06:16,062           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:16,062           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:16,063           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2025-06-01T13:06:16,063           to the `packages` configuration field.

2025-06-01T13:06:16,064           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:16,065           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:16,066           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:16,067           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:16,068           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:16,069           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2025-06-01T13:06:16,069           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2025-06-01T13:06:16,070           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:16,070           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:16,071           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:16,072           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:16,073           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:16,074           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:16,075                 even if it does not contain any `.py` files.
2025-06-01T13:06:16,075                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:16,076                 directory, all directories are treated like packages.
2025-06-01T13:06:16,077           ********************************************************************************

2025-06-01T13:06:16,078   !!
2025-06-01T13:06:16,078     check.warn(importable)
2025-06-01T13:06:16,079   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2025-06-01T13:06:16,079   !!

2025-06-01T13:06:16,080           ********************************************************************************
2025-06-01T13:06:16,081           ############################
2025-06-01T13:06:16,081           # Package would be ignored #
2025-06-01T13:06:16,082           ############################
2025-06-01T13:06:16,082           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2025-06-01T13:06:16,083           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:16,084           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:16,084           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2025-06-01T13:06:16,085           to the `packages` configuration field.

2025-06-01T13:06:16,086           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:16,086           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:16,086           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:16,087           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:16,088           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:16,089           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2025-06-01T13:06:16,090           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2025-06-01T13:06:16,090           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:16,091           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:16,091           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:16,092           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:16,093           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:16,095           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:16,095                 even if it does not contain any `.py` files.
2025-06-01T13:06:16,096                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:16,096                 directory, all directories are treated like packages.
2025-06-01T13:06:16,097           ********************************************************************************

2025-06-01T13:06:16,098   !!
2025-06-01T13:06:16,098     check.warn(importable)
2025-06-01T13:06:16,098   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2025-06-01T13:06:16,099   !!

2025-06-01T13:06:16,100           ********************************************************************************
2025-06-01T13:06:16,100           ############################
2025-06-01T13:06:16,101           # Package would be ignored #
2025-06-01T13:06:16,101           ############################
2025-06-01T13:06:16,102           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2025-06-01T13:06:16,102           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:16,103           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:16,104           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2025-06-01T13:06:16,105           to the `packages` configuration field.

2025-06-01T13:06:16,106           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:16,106           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:16,107           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:16,108           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:16,109           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:16,110           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2025-06-01T13:06:16,111           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2025-06-01T13:06:16,111           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:16,112           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:16,113           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:16,113           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:16,114           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:16,116           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:16,116                 even if it does not contain any `.py` files.
2025-06-01T13:06:16,117                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:16,117                 directory, all directories are treated like packages.
2025-06-01T13:06:16,118           ********************************************************************************

2025-06-01T13:06:16,119   !!
2025-06-01T13:06:16,119     check.warn(importable)
2025-06-01T13:06:16,119   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2025-06-01T13:06:16,120   !!

2025-06-01T13:06:16,121           ********************************************************************************
2025-06-01T13:06:16,121           ############################
2025-06-01T13:06:16,122           # Package would be ignored #
2025-06-01T13:06:16,122           ############################
2025-06-01T13:06:16,123           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2025-06-01T13:06:16,123           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:16,124           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:16,125           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2025-06-01T13:06:16,125           to the `packages` configuration field.

2025-06-01T13:06:16,126           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:16,127           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:16,128           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:16,129           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:16,130           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:16,131           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2025-06-01T13:06:16,131           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2025-06-01T13:06:16,132           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:16,132           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:16,133           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:16,134           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:16,135           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:16,137           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:16,138                 even if it does not contain any `.py` files.
2025-06-01T13:06:16,138                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:16,139                 directory, all directories are treated like packages.
2025-06-01T13:06:16,139           ********************************************************************************

2025-06-01T13:06:16,140   !!
2025-06-01T13:06:16,141     check.warn(importable)
2025-06-01T13:06:16,142   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2025-06-01T13:06:16,142   !!

2025-06-01T13:06:16,143           ********************************************************************************
2025-06-01T13:06:16,144           ############################
2025-06-01T13:06:16,145           # Package would be ignored #
2025-06-01T13:06:16,145           ############################
2025-06-01T13:06:16,146           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2025-06-01T13:06:16,146           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:16,147           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:16,148           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2025-06-01T13:06:16,148           to the `packages` configuration field.

2025-06-01T13:06:16,149           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:16,150           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:16,150           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:16,151           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:16,152           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:16,153           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2025-06-01T13:06:16,154           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2025-06-01T13:06:16,154           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:16,155           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:16,156           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:16,157           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:16,158           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:16,160           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:16,160                 even if it does not contain any `.py` files.
2025-06-01T13:06:16,161                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:16,161                 directory, all directories are treated like packages.
2025-06-01T13:06:16,162           ********************************************************************************

2025-06-01T13:06:16,163   !!
2025-06-01T13:06:16,163     check.warn(importable)
2025-06-01T13:06:16,164   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2025-06-01T13:06:16,164   !!

2025-06-01T13:06:16,165           ********************************************************************************
2025-06-01T13:06:16,166           ############################
2025-06-01T13:06:16,167           # Package would be ignored #
2025-06-01T13:06:16,167           ############################
2025-06-01T13:06:16,168           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2025-06-01T13:06:16,168           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:16,169           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:16,170           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2025-06-01T13:06:16,170           to the `packages` configuration field.

2025-06-01T13:06:16,171           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:16,172           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:16,172           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:16,174           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:16,175           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:16,176           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2025-06-01T13:06:16,176           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2025-06-01T13:06:16,177           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:16,177           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:16,177           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:16,179           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:16,180           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:16,181           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:16,182                 even if it does not contain any `.py` files.
2025-06-01T13:06:16,182                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:16,182                 directory, all directories are treated like packages.
2025-06-01T13:06:16,183           ********************************************************************************

2025-06-01T13:06:16,184   !!
2025-06-01T13:06:16,184     check.warn(importable)
2025-06-01T13:06:16,185   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2025-06-01T13:06:16,186   !!

2025-06-01T13:06:16,187           ********************************************************************************
2025-06-01T13:06:16,188           ############################
2025-06-01T13:06:16,188           # Package would be ignored #
2025-06-01T13:06:16,189           ############################
2025-06-01T13:06:16,190           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2025-06-01T13:06:16,191           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:16,192           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:16,192           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2025-06-01T13:06:16,193           to the `packages` configuration field.

2025-06-01T13:06:16,194           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:16,195           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:16,196           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:16,197           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:16,198           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:16,199           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2025-06-01T13:06:16,199           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2025-06-01T13:06:16,200           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:16,201           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:16,201           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:16,202           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:16,204           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:16,206           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:16,206                 even if it does not contain any `.py` files.
2025-06-01T13:06:16,207                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:16,208                 directory, all directories are treated like packages.
2025-06-01T13:06:16,208           ********************************************************************************

2025-06-01T13:06:16,210   !!
2025-06-01T13:06:16,210     check.warn(importable)
2025-06-01T13:06:16,211   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2025-06-01T13:06:16,211   !!

2025-06-01T13:06:16,212           ********************************************************************************
2025-06-01T13:06:16,213           ############################
2025-06-01T13:06:16,214           # Package would be ignored #
2025-06-01T13:06:16,214           ############################
2025-06-01T13:06:16,215           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2025-06-01T13:06:16,215           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:16,216           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:16,217           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2025-06-01T13:06:16,218           to the `packages` configuration field.

2025-06-01T13:06:16,219           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:16,220           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:16,220           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:16,222           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:16,223           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:16,225           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2025-06-01T13:06:16,225           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2025-06-01T13:06:16,226           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:16,227           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:16,227           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:16,228           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:16,229           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:16,231           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:16,232                 even if it does not contain any `.py` files.
2025-06-01T13:06:16,232                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:16,233                 directory, all directories are treated like packages.
2025-06-01T13:06:16,233           ********************************************************************************

2025-06-01T13:06:16,234   !!
2025-06-01T13:06:16,235     check.warn(importable)
2025-06-01T13:06:16,235   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2025-06-01T13:06:16,236   !!

2025-06-01T13:06:16,238           ********************************************************************************
2025-06-01T13:06:16,238           ############################
2025-06-01T13:06:16,239           # Package would be ignored #
2025-06-01T13:06:16,239           ############################
2025-06-01T13:06:16,240           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2025-06-01T13:06:16,240           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:16,241           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:16,242           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2025-06-01T13:06:16,243           to the `packages` configuration field.

2025-06-01T13:06:16,244           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:16,244           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:16,245           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:16,246           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:16,247           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:16,248           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2025-06-01T13:06:16,249           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2025-06-01T13:06:16,249           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:16,250           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:16,251           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:16,252           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:16,253           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:16,255           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:16,255                 even if it does not contain any `.py` files.
2025-06-01T13:06:16,256                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:16,256                 directory, all directories are treated like packages.
2025-06-01T13:06:16,257           ********************************************************************************

2025-06-01T13:06:16,258   !!
2025-06-01T13:06:16,259     check.warn(importable)
2025-06-01T13:06:16,259   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2025-06-01T13:06:16,260   !!

2025-06-01T13:06:16,261           ********************************************************************************
2025-06-01T13:06:16,262           ############################
2025-06-01T13:06:16,262           # Package would be ignored #
2025-06-01T13:06:16,263           ############################
2025-06-01T13:06:16,263           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2025-06-01T13:06:16,264           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:16,265           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:16,266           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2025-06-01T13:06:16,266           to the `packages` configuration field.

2025-06-01T13:06:16,267           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:16,268           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:16,268           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:16,270           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:16,271           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:16,272           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2025-06-01T13:06:16,272           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2025-06-01T13:06:16,273           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:16,273           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:16,274           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:16,275           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:16,276           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:16,277           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:16,278                 even if it does not contain any `.py` files.
2025-06-01T13:06:16,278                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:16,279                 directory, all directories are treated like packages.
2025-06-01T13:06:16,279           ********************************************************************************

2025-06-01T13:06:16,280   !!
2025-06-01T13:06:16,280     check.warn(importable)
2025-06-01T13:06:16,281   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2025-06-01T13:06:16,281   !!

2025-06-01T13:06:16,282           ********************************************************************************
2025-06-01T13:06:16,283           ############################
2025-06-01T13:06:16,283           # Package would be ignored #
2025-06-01T13:06:16,284           ############################
2025-06-01T13:06:16,284           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2025-06-01T13:06:16,284           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:16,286           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:16,286           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2025-06-01T13:06:16,287           to the `packages` configuration field.

2025-06-01T13:06:16,288           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:16,288           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:16,289           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:16,289           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:16,290           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:16,292           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2025-06-01T13:06:16,292           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2025-06-01T13:06:16,292           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:16,293           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:16,293           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:16,294           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:16,295           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:16,297           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:16,298                 even if it does not contain any `.py` files.
2025-06-01T13:06:16,298                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:16,299                 directory, all directories are treated like packages.
2025-06-01T13:06:16,299           ********************************************************************************

2025-06-01T13:06:16,300   !!
2025-06-01T13:06:16,301     check.warn(importable)
2025-06-01T13:06:16,301   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2025-06-01T13:06:16,302   !!

2025-06-01T13:06:16,303           ********************************************************************************
2025-06-01T13:06:16,303           ############################
2025-06-01T13:06:16,304           # Package would be ignored #
2025-06-01T13:06:16,304           ############################
2025-06-01T13:06:16,305           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2025-06-01T13:06:16,305           but it is absent from setuptools' `packages` configuration.

2025-06-01T13:06:16,306           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T13:06:16,307           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2025-06-01T13:06:16,307           to the `packages` configuration field.

2025-06-01T13:06:16,308           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T13:06:16,308           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T13:06:16,309           instead of `find_packages(...)`/`find:`).

2025-06-01T13:06:16,310           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T13:06:16,311           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T13:06:16,311           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2025-06-01T13:06:16,312           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2025-06-01T13:06:16,312           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T13:06:16,313           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T13:06:16,313           combination with a more fine grained `package-data` configuration.

2025-06-01T13:06:16,314           You can read more about "package data files" on setuptools documentation page:

2025-06-01T13:06:16,315           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T13:06:16,317           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T13:06:16,318                 even if it does not contain any `.py` files.
2025-06-01T13:06:16,318                 On the other hand, currently there is no concept of package data
2025-06-01T13:06:16,319                 directory, all directories are treated like packages.
2025-06-01T13:06:16,319           ********************************************************************************

2025-06-01T13:06:16,320   !!
2025-06-01T13:06:16,320     check.warn(importable)
2025-06-01T13:06:16,321   creating build/lib/deepspeed/ops/csrc/adagrad
2025-06-01T13:06:16,321   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2025-06-01T13:06:16,322   creating build/lib/deepspeed/ops/csrc/adam
2025-06-01T13:06:16,322   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-01T13:06:16,323   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-01T13:06:16,323   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-01T13:06:16,324   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2025-06-01T13:06:16,324   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2025-06-01T13:06:16,325   creating build/lib/deepspeed/ops/csrc/aio/common
2025-06-01T13:06:16,325   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-01T13:06:16,326   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-01T13:06:16,326   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-01T13:06:16,327   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-01T13:06:16,328   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-01T13:06:16,328   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-01T13:06:16,329   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,329   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,330   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,330   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,331   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,331   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,331   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,332   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,332   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,333   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,333   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,334   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,334   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,335   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,335   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,336   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,336   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,337   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:16,337   creating build/lib/deepspeed/ops/csrc/aio/py_test
2025-06-01T13:06:16,338   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2025-06-01T13:06:16,338   creating build/lib/deepspeed/ops/csrc/compile
2025-06-01T13:06:16,339   copying deepspeed/ops/csrc/compile/deepcompile.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-01T13:06:16,339   copying deepspeed/ops/csrc/compile/init.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-01T13:06:16,340   copying deepspeed/ops/csrc/compile/util.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-01T13:06:16,340   copying deepspeed/ops/csrc/compile/z1.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-01T13:06:16,341   copying deepspeed/ops/csrc/compile/z1.h -> build/lib/deepspeed/ops/csrc/compile
2025-06-01T13:06:16,341   copying deepspeed/ops/csrc/compile/z3.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-01T13:06:16,342   copying deepspeed/ops/csrc/compile/z3.h -> build/lib/deepspeed/ops/csrc/compile
2025-06-01T13:06:16,343   creating build/lib/deepspeed/ops/csrc/cpu/adam
2025-06-01T13:06:16,343   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2025-06-01T13:06:16,344   creating build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-01T13:06:16,344   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-01T13:06:16,345   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-01T13:06:16,345   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-01T13:06:16,346   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-01T13:06:16,347   creating build/lib/deepspeed/ops/csrc/cpu/lion
2025-06-01T13:06:16,347   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2025-06-01T13:06:16,348   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T13:06:16,348   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T13:06:16,349   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T13:06:16,349   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T13:06:16,349   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T13:06:16,350   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T13:06:16,350   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T13:06:16,351   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T13:06:16,351   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T13:06:16,352   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T13:06:16,352   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T13:06:16,353   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T13:06:16,353   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T13:06:16,354   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T13:06:16,354   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T13:06:16,355   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T13:06:16,355   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T13:06:16,356   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T13:06:16,356   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T13:06:16,357   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T13:06:16,357   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T13:06:16,358   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T13:06:16,358   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T13:06:16,359   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T13:06:16,359   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T13:06:16,360   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T13:06:16,360   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T13:06:16,361   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T13:06:16,361   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-01T13:06:16,362   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-01T13:06:16,362   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-01T13:06:16,362   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-01T13:06:16,363   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-01T13:06:16,364   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-01T13:06:16,364   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-01T13:06:16,365   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-01T13:06:16,365   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-01T13:06:16,366   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-01T13:06:16,366   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-01T13:06:16,367   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-01T13:06:16,367   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-01T13:06:16,368   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-01T13:06:16,368   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-01T13:06:16,369   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-01T13:06:16,369   creating build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,370   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,370   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,371   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,371   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,372   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,372   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,373   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,374   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,374   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,375   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,375   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,376   copying deepspeed/ops/csrc/includes/deepcompile.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,376   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,376   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,377   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,377   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,378   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,378   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,379   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,380   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,382   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,386   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,388   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,391   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,394   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,397   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,400   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,403   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,405   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,408   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T13:06:16,411   creating build/lib/deepspeed/ops/csrc/lamb
2025-06-01T13:06:16,412   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2025-06-01T13:06:16,415   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2025-06-01T13:06:16,417   creating build/lib/deepspeed/ops/csrc/lion
2025-06-01T13:06:16,419   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-01T13:06:16,421   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-01T13:06:16,424   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-01T13:06:16,427   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2025-06-01T13:06:16,430   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2025-06-01T13:06:16,433   creating build/lib/deepspeed/ops/csrc/quantization
2025-06-01T13:06:16,434   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-01T13:06:16,437   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-01T13:06:16,441   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2025-06-01T13:06:16,444   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-01T13:06:16,448   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-01T13:06:16,451   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-01T13:06:16,454   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-01T13:06:16,457   creating build/lib/deepspeed/ops/csrc/random_ltd
2025-06-01T13:06:16,458   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-01T13:06:16,461   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-01T13:06:16,463   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-01T13:06:16,466   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-01T13:06:16,468   creating build/lib/deepspeed/ops/csrc/sparse_attention
2025-06-01T13:06:16,469   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2025-06-01T13:06:16,472   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-01T13:06:16,474   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-01T13:06:16,477   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-01T13:06:16,479   creating build/lib/deepspeed/ops/csrc/spatial/includes
2025-06-01T13:06:16,480   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2025-06-01T13:06:16,483   creating build/lib/deepspeed/ops/csrc/transformer
2025-06-01T13:06:16,484   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-01T13:06:16,487   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-01T13:06:16,490   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2025-06-01T13:06:16,494   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-01T13:06:16,498   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-01T13:06:16,501   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-01T13:06:16,505   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-01T13:06:16,509   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-01T13:06:16,512   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:16,514   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:16,517   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:16,520   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:16,523   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:16,526   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:16,529   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:16,533   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:16,535   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:16,538   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:16,541   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:16,544   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-01T13:06:16,545   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-01T13:06:16,548   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-01T13:06:16,551   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-01T13:06:16,554   creating build/lib/deepspeed/ops/csrc/utils
2025-06-01T13:06:16,555   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2025-06-01T13:06:16,558   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-06-01T13:06:16,559   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-06-01T13:06:16,562   creating build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-01T13:06:16,563   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-01T13:06:16,566   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-01T13:06:16,569   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-01T13:06:16,571   creating build/lib/deepspeed/ops/csrc/xpu/common
2025-06-01T13:06:16,572   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2025-06-01T13:06:16,575   creating build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-01T13:06:16,576   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-01T13:06:16,579   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-01T13:06:16,581   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-01T13:06:16,584   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-01T13:06:16,587   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-01T13:06:16,590   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2025-06-01T13:06:16,591   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2025-06-01T13:06:16,594   creating build/lib/deepspeed/autotuning/config_templates
2025-06-01T13:06:16,595   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-01T13:06:16,598   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-01T13:06:16,600   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-01T13:06:16,603   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-01T13:06:16,605   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-01T13:06:16,608   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-01T13:06:16,610   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-01T13:06:16,613   creating build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-01T13:06:16,614   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-01T13:06:16,617   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-01T13:06:16,619   creating build/lib/deepspeed/inference/v2/ragged/includes
2025-06-01T13:06:16,620   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2025-06-01T13:06:16,622   creating build/lib/deepspeed/inference/v2/kernels/includes
2025-06-01T13:06:16,623   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-01T13:06:16,626   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-01T13:06:16,629   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-01T13:06:16,631   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-01T13:06:16,634   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-01T13:06:16,637   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-01T13:06:16,639   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-01T13:06:16,640   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-01T13:06:16,643   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-01T13:06:16,645   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-01T13:06:16,647   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-01T13:06:16,648   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-01T13:06:16,651   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-01T13:06:16,652   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-01T13:06:16,654   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-01T13:06:16,657   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-01T13:06:16,659   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T13:06:16,662   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T13:06:16,664   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T13:06:16,667   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T13:06:16,670   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T13:06:16,672   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T13:06:16,675   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T13:06:16,678   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T13:06:16,680   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T13:06:16,683   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T13:06:16,685   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T13:06:16,688   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T13:06:16,691   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T13:06:16,693   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T13:06:16,696   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T13:06:16,699   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T13:06:16,702   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T13:06:16,705   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T13:06:16,707   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:16,709   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:16,712   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:16,715   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:16,717   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:16,720   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:16,723   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:16,726   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:16,729   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:16,731   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:16,734   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:16,737   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:16,740   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:16,743   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T13:06:16,745   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T13:06:16,748   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T13:06:16,751   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T13:06:16,753   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T13:06:16,755   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T13:06:16,757   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T13:06:16,760   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:16,763   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:16,765   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:16,768   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:16,771   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T13:06:16,773   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T13:06:16,776   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T13:06:16,778   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T13:06:16,781   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T13:06:16,784   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T13:06:16,786   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T13:06:16,789   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T13:06:16,792   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T13:06:16,794   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T13:06:16,797   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T13:06:16,800   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T13:06:16,802   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T13:06:16,804   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T13:06:16,807   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T13:06:16,810   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T13:06:16,812   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T13:06:16,815   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T13:06:16,817   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T13:06:16,820   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T13:06:16,822   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T13:06:16,825   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T13:06:16,889   running build_scripts
2025-06-01T13:06:16,889   creating build/scripts-3.11
2025-06-01T13:06:16,891   copying and adjusting bin/deepspeed -> build/scripts-3.11
2025-06-01T13:06:16,892   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2025-06-01T13:06:16,894   copying and adjusting bin/ds -> build/scripts-3.11
2025-06-01T13:06:16,895   copying bin/ds_ssh -> build/scripts-3.11
2025-06-01T13:06:16,897   copying and adjusting bin/ds_report -> build/scripts-3.11
2025-06-01T13:06:16,899   copying and adjusting bin/ds_bench -> build/scripts-3.11
2025-06-01T13:06:16,900   copying and adjusting bin/dsr -> build/scripts-3.11
2025-06-01T13:06:16,902   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2025-06-01T13:06:16,903   copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11
2025-06-01T13:06:16,905   copying and adjusting bin/ds_io -> build/scripts-3.11
2025-06-01T13:06:16,906   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2025-06-01T13:06:16,907   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2025-06-01T13:06:16,907   changing mode of build/scripts-3.11/ds from 644 to 755
2025-06-01T13:06:16,908   changing mode of build/scripts-3.11/ds_report from 644 to 755
2025-06-01T13:06:16,908   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2025-06-01T13:06:16,909   changing mode of build/scripts-3.11/dsr from 644 to 755
2025-06-01T13:06:16,909   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2025-06-01T13:06:16,910   changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755
2025-06-01T13:06:16,910   changing mode of build/scripts-3.11/ds_io from 644 to 755
2025-06-01T13:06:16,941   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2025-06-01T13:06:16,941   !!

2025-06-01T13:06:16,943           ********************************************************************************
2025-06-01T13:06:16,943           Please avoid running ``setup.py`` directly.
2025-06-01T13:06:16,944           Instead, use pypa/build, pypa/installer or other
2025-06-01T13:06:16,945           standards-based tools.

2025-06-01T13:06:16,946           By 2025-Oct-31, you need to update your project and remove deprecated calls
2025-06-01T13:06:16,946           or your builds will no longer be supported.

2025-06-01T13:06:16,948           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2025-06-01T13:06:16,948           ********************************************************************************

2025-06-01T13:06:16,949   !!
2025-06-01T13:06:16,949     self.initialize_options()
2025-06-01T13:06:16,971   installing to build/bdist.linux-armv7l/wheel
2025-06-01T13:06:16,971   running install
2025-06-01T13:06:16,996   running install_lib
2025-06-01T13:06:17,023   creating build/bdist.linux-armv7l/wheel
2025-06-01T13:06:17,025   creating build/bdist.linux-armv7l/wheel/deepspeed
2025-06-01T13:06:17,027   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2025-06-01T13:06:17,028   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-01T13:06:17,030   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-01T13:06:17,032   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-01T13:06:17,034   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-01T13:06:17,036   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-01T13:06:17,039   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-01T13:06:17,041   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-01T13:06:17,044   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2025-06-01T13:06:17,045   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,049   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,052   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2025-06-01T13:06:17,053   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T13:06:17,056   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T13:06:17,058   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T13:06:17,061   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T13:06:17,063   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T13:06:17,065   copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T13:06:17,068   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T13:06:17,070   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T13:06:17,072   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T13:06:17,077   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T13:06:17,082   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T13:06:17,085   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T13:06:17,087   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T13:06:17,093   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T13:06:17,096   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T13:06:17,098   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T13:06:17,101   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T13:06:17,104   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,106   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,109   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2025-06-01T13:06:17,110   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-01T13:06:17,113   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-01T13:06:17,116   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2025-06-01T13:06:17,117   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-01T13:06:17,120   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-01T13:06:17,122   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-01T13:06:17,124   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-01T13:06:17,127   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-01T13:06:17,130   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-01T13:06:17,132   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,139   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino
2025-06-01T13:06:17,140   copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-01T13:06:17,143   copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-01T13:06:17,145   copying build/lib/deepspeed/runtime/domino/async_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-01T13:06:17,147   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,150   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2025-06-01T13:06:17,151   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-06-01T13:06:17,154   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-06-01T13:06:17,156   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2025-06-01T13:06:17,157   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-01T13:06:17,160   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-01T13:06:17,162   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-01T13:06:17,165   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,167   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,169   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,172   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,175   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2025-06-01T13:06:17,177   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-01T13:06:17,181   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-01T13:06:17,183   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-01T13:06:17,185   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-01T13:06:17,188   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-01T13:06:17,191   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-01T13:06:17,194   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/tensor_parallel
2025-06-01T13:06:17,195   copying build/lib/deepspeed/runtime/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-01T13:06:17,197   copying build/lib/deepspeed/runtime/tensor_parallel/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-01T13:06:17,199   copying build/lib/deepspeed/runtime/tensor_parallel/tp_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-01T13:06:17,201   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,203   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,206   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2025-06-01T13:06:17,207   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-01T13:06:17,210   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-01T13:06:17,212   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-01T13:06:17,214   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-01T13:06:17,216   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-01T13:06:17,219   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-01T13:06:17,221   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,224   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,228   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2025-06-01T13:06:17,229   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T13:06:17,232   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T13:06:17,234   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T13:06:17,237   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T13:06:17,240   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T13:06:17,242   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T13:06:17,244   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T13:06:17,246   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T13:06:17,249   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T13:06:17,252   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,253   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,256   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,260   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2025-06-01T13:06:17,261   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2025-06-01T13:06:17,263   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-01T13:06:17,265   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-01T13:06:17,267   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-01T13:06:17,269   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-01T13:06:17,271   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-01T13:06:17,274   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T13:06:17,275   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T13:06:17,278   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T13:06:17,281   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T13:06:17,284   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T13:06:17,286   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T13:06:17,288   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T13:06:17,291   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-01T13:06:17,293   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-01T13:06:17,296   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-01T13:06:17,298   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-01T13:06:17,301   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2025-06-01T13:06:17,303   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-01T13:06:17,305   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-01T13:06:17,307   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-01T13:06:17,309   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-01T13:06:17,311   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T13:06:17,313   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2025-06-01T13:06:17,315   copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-01T13:06:17,318   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-01T13:06:17,320   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-01T13:06:17,322   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-01T13:06:17,324   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-01T13:06:17,327   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2025-06-01T13:06:17,328   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-01T13:06:17,331   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-01T13:06:17,334   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-01T13:06:17,336   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-01T13:06:17,339   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-01T13:06:17,341   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-01T13:06:17,343   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-01T13:06:17,346   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-01T13:06:17,349   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2025-06-01T13:06:17,351   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2025-06-01T13:06:17,352   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2025-06-01T13:06:17,355   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2025-06-01T13:06:17,356   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-06-01T13:06:17,359   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-06-01T13:06:17,362   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2025-06-01T13:06:17,363   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T13:06:17,366   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T13:06:17,368   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T13:06:17,370   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T13:06:17,373   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T13:06:17,377   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:17,378   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:17,380   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:17,382   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:17,385   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:17,387   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:17,390   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:17,392   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:17,394   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:17,397   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:17,399   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T13:06:17,402   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T13:06:17,404   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T13:06:17,406   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T13:06:17,409   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,411   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,413   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,415   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,418   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,420   copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,422   copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,424   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,427   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,429   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,431   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,433   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,435   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,437   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,439   copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,442   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,444   copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,446   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,448   copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,450   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,453   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,455   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,457   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,459   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T13:06:17,461   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T13:06:17,464   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T13:06:17,467   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2025-06-01T13:06:17,468   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-01T13:06:17,470   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-01T13:06:17,472   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-01T13:06:17,475   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-01T13:06:17,478   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2025-06-01T13:06:17,479   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-01T13:06:17,482   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-01T13:06:17,484   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-01T13:06:17,487   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-01T13:06:17,489   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2025-06-01T13:06:17,491   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2025-06-01T13:06:17,493   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-01T13:06:17,495   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-01T13:06:17,497   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-01T13:06:17,499   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-01T13:06:17,502   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2025-06-01T13:06:17,503   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2025-06-01T13:06:17,505   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-01T13:06:17,507   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-01T13:06:17,511   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-01T13:06:17,514   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-01T13:06:17,517   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-01T13:06:17,519   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-01T13:06:17,522   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-01T13:06:17,525   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2025-06-01T13:06:17,527   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2025-06-01T13:06:17,528   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-01T13:06:17,530   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-01T13:06:17,532   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-01T13:06:17,535   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-01T13:06:17,537   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-01T13:06:17,539   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-01T13:06:17,542   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2025-06-01T13:06:17,544   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2025-06-01T13:06:17,545   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2025-06-01T13:06:17,548   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2025-06-01T13:06:17,549   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2025-06-01T13:06:17,552   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2025-06-01T13:06:17,553   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-01T13:06:17,556   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-01T13:06:17,558   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-01T13:06:17,561   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-01T13:06:17,564   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2025-06-01T13:06:17,565   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-01T13:06:17,569   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-01T13:06:17,572   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-01T13:06:17,575   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2025-06-01T13:06:17,577   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2025-06-01T13:06:17,579   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-01T13:06:17,582   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-01T13:06:17,585   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-01T13:06:17,588   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:17,589   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:17,594   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:17,597   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:17,599   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:17,602   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:17,604   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:17,607   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:17,609   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:17,612   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:17,614   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T13:06:17,617   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-01T13:06:17,620   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-01T13:06:17,623   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-01T13:06:17,626   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-01T13:06:17,629   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-01T13:06:17,634   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2025-06-01T13:06:17,635   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-06-01T13:06:17,638   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-06-01T13:06:17,641   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-01T13:06:17,642   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-06-01T13:06:17,645   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-06-01T13:06:17,648   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2025-06-01T13:06:17,649   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-01T13:06:17,651   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-01T13:06:17,654   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-01T13:06:17,656   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-01T13:06:17,659   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-01T13:06:17,662   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2025-06-01T13:06:17,663   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,665   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,667   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,669   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,672   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,675   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,677   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,679   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,682   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,684   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,686   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,689   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,691   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,694   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,696   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,698   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,700   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,702   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,706   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,708   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,711   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,714   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,716   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,718   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,721   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,723   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,725   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,727   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,730   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,733   copying build/lib/deepspeed/ops/csrc/includes/deepcompile.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T13:06:17,737   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2025-06-01T13:06:17,738   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-01T13:06:17,740   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-01T13:06:17,742   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-01T13:06:17,744   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-01T13:06:17,747   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-01T13:06:17,750   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2025-06-01T13:06:17,752   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2025-06-01T13:06:17,753   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2025-06-01T13:06:17,756   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2025-06-01T13:06:17,758   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-06-01T13:06:17,760   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-06-01T13:06:17,763   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2025-06-01T13:06:17,764   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-06-01T13:06:17,766   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-06-01T13:06:17,769   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2025-06-01T13:06:17,770   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2025-06-01T13:06:17,774   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2025-06-01T13:06:17,775   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2025-06-01T13:06:17,778   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/compile
2025-06-01T13:06:17,779   copying build/lib/deepspeed/ops/csrc/compile/z1.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-01T13:06:17,782   copying build/lib/deepspeed/ops/csrc/compile/init.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-01T13:06:17,784   copying build/lib/deepspeed/ops/csrc/compile/deepcompile.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-01T13:06:17,787   copying build/lib/deepspeed/ops/csrc/compile/util.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-01T13:06:17,789   copying build/lib/deepspeed/ops/csrc/compile/z1.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-01T13:06:17,791   copying build/lib/deepspeed/ops/csrc/compile/z3.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-01T13:06:17,793   copying build/lib/deepspeed/ops/csrc/compile/z3.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-01T13:06:17,797   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2025-06-01T13:06:17,798   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2025-06-01T13:06:17,800   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2025-06-01T13:06:17,803   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2025-06-01T13:06:17,804   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-01T13:06:17,806   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-01T13:06:17,809   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-01T13:06:17,812   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-01T13:06:17,814   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-01T13:06:17,816   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-01T13:06:17,819   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,821   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,825   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,827   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,830   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,832   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,834   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,837   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,839   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,841   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,843   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,846   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,848   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,850   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,853   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,855   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,857   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,859   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T13:06:17,862   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2025-06-01T13:06:17,864   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T13:06:17,865   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T13:06:17,868   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T13:06:17,870   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T13:06:17,872   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T13:06:17,875   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T13:06:17,878   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T13:06:17,881   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T13:06:17,885   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T13:06:17,889   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T13:06:17,891   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T13:06:17,894   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T13:06:17,896   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T13:06:17,900   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T13:06:17,902   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T13:06:17,905   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T13:06:17,909   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T13:06:17,913   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T13:06:17,916   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T13:06:17,918   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T13:06:17,921   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T13:06:17,923   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T13:06:17,928   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T13:06:17,930   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T13:06:17,935   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T13:06:17,939   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T13:06:17,944   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T13:06:17,947   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T13:06:17,958   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-01T13:06:17,960   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-01T13:06:17,964   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-01T13:06:17,969   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2025-06-01T13:06:17,972   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2025-06-01T13:06:17,974   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2025-06-01T13:06:17,979   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2025-06-01T13:06:17,981   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-01T13:06:17,986   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-01T13:06:17,990   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-01T13:06:17,994   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2025-06-01T13:06:17,995   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-01T13:06:17,998   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-01T13:06:18,001   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-01T13:06:18,004   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-01T13:06:18,007   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-01T13:06:18,011   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2025-06-01T13:06:18,012   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2025-06-01T13:06:18,016   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2025-06-01T13:06:18,018   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2025-06-01T13:06:18,021   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2025-06-01T13:06:18,022   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-01T13:06:18,026   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-01T13:06:18,029   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-01T13:06:18,032   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-01T13:06:18,037   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2025-06-01T13:06:18,039   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2025-06-01T13:06:18,042   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2025-06-01T13:06:18,044   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-06-01T13:06:18,046   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-06-01T13:06:18,049   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2025-06-01T13:06:18,051   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-01T13:06:18,054   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-01T13:06:18,060   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-01T13:06:18,065   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-01T13:06:18,068   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-01T13:06:18,071   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2025-06-01T13:06:18,072   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-01T13:06:18,075   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-01T13:06:18,078   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-01T13:06:18,081   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-01T13:06:18,083   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-01T13:06:18,085   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-01T13:06:18,089   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2025-06-01T13:06:18,090   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-06-01T13:06:18,093   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-06-01T13:06:18,095   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/compile
2025-06-01T13:06:18,096   copying build/lib/deepspeed/ops/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/compile
2025-06-01T13:06:18,099   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2025-06-01T13:06:18,101   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2025-06-01T13:06:18,104   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2025-06-01T13:06:18,105   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,108   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,110   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2025-06-01T13:06:18,112   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-01T13:06:18,114   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-01T13:06:18,116   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-01T13:06:18,118   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-01T13:06:18,121   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-01T13:06:18,122   copying build/lib/deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-01T13:06:18,124   copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-01T13:06:18,126   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,128   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,131   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2025-06-01T13:06:18,133   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-01T13:06:18,135   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-01T13:06:18,137   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-01T13:06:18,139   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-01T13:06:18,141   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-01T13:06:18,143   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-01T13:06:18,145   copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-01T13:06:18,147   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,149   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,151   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,153   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,155   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,158   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,160   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,162   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,164   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,166   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,168   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,171   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,173   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,175   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,177   copying build/lib/deepspeed/ops/op_builder/dc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,180   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2025-06-01T13:06:18,181   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T13:06:18,183   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T13:06:18,185   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T13:06:18,187   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T13:06:18,189   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T13:06:18,191   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T13:06:18,193   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T13:06:18,195   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T13:06:18,197   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T13:06:18,201   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,203   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,206   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/sdaa
2025-06-01T13:06:18,208   copying build/lib/deepspeed/ops/op_builder/sdaa/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-01T13:06:18,210   copying build/lib/deepspeed/ops/op_builder/sdaa/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-01T13:06:18,212   copying build/lib/deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-01T13:06:18,214   copying build/lib/deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-01T13:06:18,216   copying build/lib/deepspeed/ops/op_builder/sdaa/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-01T13:06:18,219   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu
2025-06-01T13:06:18,221   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-01T13:06:18,223   copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-01T13:06:18,225   copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-01T13:06:18,227   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-01T13:06:18,229   copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-01T13:06:18,232   copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-01T13:06:18,234   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,236   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,238   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,241   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2025-06-01T13:06:18,242   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T13:06:18,244   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T13:06:18,246   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T13:06:18,248   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T13:06:18,250   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T13:06:18,252   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T13:06:18,254   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T13:06:18,256   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T13:06:18,258   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T13:06:18,261   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T13:06:18,263   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T13:06:18,265   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2025-06-01T13:06:18,266   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-06-01T13:06:18,269   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-06-01T13:06:18,271   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2025-06-01T13:06:18,272   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-06-01T13:06:18,275   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-06-01T13:06:18,278   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2025-06-01T13:06:18,279   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-06-01T13:06:18,281   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-06-01T13:06:18,284   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-01T13:06:18,287   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2025-06-01T13:06:18,288   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-01T13:06:18,292   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-01T13:06:18,294   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-01T13:06:18,297   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-01T13:06:18,299   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-01T13:06:18,301   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-01T13:06:18,305   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2025-06-01T13:06:18,306   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-01T13:06:18,309   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-01T13:06:18,312   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-01T13:06:18,314   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-01T13:06:18,317   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-01T13:06:18,322   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2025-06-01T13:06:18,324   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2025-06-01T13:06:18,325   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-01T13:06:18,328   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-01T13:06:18,330   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-01T13:06:18,333   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2025-06-01T13:06:18,335   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2025-06-01T13:06:18,337   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-06-01T13:06:18,339   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-06-01T13:06:18,342   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2025-06-01T13:06:18,343   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T13:06:18,345   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T13:06:18,348   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T13:06:18,350   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T13:06:18,352   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T13:06:18,354   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T13:06:18,356   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T13:06:18,358   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T13:06:18,360   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T13:06:18,362   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T13:06:18,365   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2025-06-01T13:06:18,366   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-01T13:06:18,368   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-01T13:06:18,370   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-01T13:06:18,371   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-01T13:06:18,373   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-01T13:06:18,375   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-01T13:06:18,377   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-01T13:06:18,380   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-01T13:06:18,382   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2025-06-01T13:06:18,383   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2025-06-01T13:06:18,386   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2025-06-01T13:06:18,388   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-01T13:06:18,390   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2025-06-01T13:06:18,391   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-06-01T13:06:18,395   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-06-01T13:06:18,397   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-01T13:06:18,400   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-01T13:06:18,401   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-01T13:06:18,405   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2025-06-01T13:06:18,406   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T13:06:18,408   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T13:06:18,411   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T13:06:18,414   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T13:06:18,416   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T13:06:18,418   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T13:06:18,421   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T13:06:18,423   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T13:06:18,426   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T13:06:18,428   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T13:06:18,431   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2025-06-01T13:06:18,433   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-01T13:06:18,435   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-01T13:06:18,437   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-01T13:06:18,440   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2025-06-01T13:06:18,441   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2025-06-01T13:06:18,443   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-01T13:06:18,446   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-01T13:06:18,448   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-01T13:06:18,450   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-01T13:06:18,453   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-01T13:06:18,456   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-01T13:06:18,459   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2025-06-01T13:06:18,461   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T13:06:18,463   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T13:06:18,465   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T13:06:18,467   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T13:06:18,469   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T13:06:18,472   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2025-06-01T13:06:18,474   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T13:06:18,475   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T13:06:18,478   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T13:06:18,480   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T13:06:18,483   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T13:06:18,486   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2025-06-01T13:06:18,487   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-01T13:06:18,490   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-01T13:06:18,492   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-01T13:06:18,495   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-01T13:06:18,498   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2025-06-01T13:06:18,499   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-01T13:06:18,502   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-01T13:06:18,504   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-01T13:06:18,507   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-01T13:06:18,509   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-01T13:06:18,512   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-01T13:06:18,515   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2025-06-01T13:06:18,517   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-01T13:06:18,519   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-01T13:06:18,521   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-01T13:06:18,524   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-01T13:06:18,526   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-01T13:06:18,529   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-01T13:06:18,532   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:18,534   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:18,536   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:18,538   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:18,541   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:18,543   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:18,545   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:18,547   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:18,549   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:18,551   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T13:06:18,554   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T13:06:18,555   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T13:06:18,557   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T13:06:18,559   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T13:06:18,562   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T13:06:18,565   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T13:06:18,566   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T13:06:18,568   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T13:06:18,570   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T13:06:18,573   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T13:06:18,575   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2025-06-01T13:06:18,577   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-01T13:06:18,579   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-01T13:06:18,581   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-01T13:06:18,584   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-01T13:06:18,587   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:18,588   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:18,590   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:18,593   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:18,596   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:18,598   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:18,600   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:18,602   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:18,604   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:18,606   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T13:06:18,608   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-01T13:06:18,612   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2025-06-01T13:06:18,613   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-01T13:06:18,615   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-01T13:06:18,618   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-01T13:06:18,620   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-01T13:06:18,623   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2025-06-01T13:06:18,624   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-01T13:06:18,626   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-01T13:06:18,628   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-01T13:06:18,631   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-01T13:06:18,633   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-01T13:06:18,636   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-01T13:06:18,639   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T13:06:18,641   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T13:06:18,643   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T13:06:18,645   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T13:06:18,648   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T13:06:18,650   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T13:06:18,653   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2025-06-01T13:06:18,654   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-01T13:06:18,658   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2025-06-01T13:06:18,659   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2025-06-01T13:06:18,661   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-01T13:06:18,663   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2025-06-01T13:06:18,664   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-06-01T13:06:18,667   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-06-01T13:06:18,668   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-01T13:06:18,671   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-01T13:06:18,674   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-01T13:06:18,676   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-01T13:06:18,678   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-01T13:06:18,682   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2025-06-01T13:06:18,683   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-01T13:06:18,686   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-01T13:06:18,688   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-01T13:06:18,690   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-01T13:06:18,692   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T13:06:18,695   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2025-06-01T13:06:18,697   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2025-06-01T13:06:18,699   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-01T13:06:18,701   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-01T13:06:18,704   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-01T13:06:18,706   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-01T13:06:18,708   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-01T13:06:18,710   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-01T13:06:18,713   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-01T13:06:18,715   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-01T13:06:18,717   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-01T13:06:18,720   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:18,721   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:18,724   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:18,726   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:18,728   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:18,730   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:18,733   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:18,735   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:18,737   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-01T13:06:18,740   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2025-06-01T13:06:18,742   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2025-06-01T13:06:18,745   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-06-01T13:06:18,748   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-06-01T13:06:18,751   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2025-06-01T13:06:18,752   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-06-01T13:06:18,754   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-06-01T13:06:18,758   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2025-06-01T13:06:18,759   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-06-01T13:06:18,761   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-06-01T13:06:18,764   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2025-06-01T13:06:18,767   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2025-06-01T13:06:18,769   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-01T13:06:18,771   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-01T13:06:18,773   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-01T13:06:18,776   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-01T13:06:18,777   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-06-01T13:06:18,780   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-06-01T13:06:18,783   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-01T13:06:18,784   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-01T13:06:18,786   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-01T13:06:18,789   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-01T13:06:18,792   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2025-06-01T13:06:18,793   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-06-01T13:06:18,796   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-06-01T13:06:18,798   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-01T13:06:18,800   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-01T13:06:18,802   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T13:06:18,805   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2025-06-01T13:06:18,807   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-06-01T13:06:18,810   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2025-06-01T13:06:18,811   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-01T13:06:18,813   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-01T13:06:18,816   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-01T13:06:18,819   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-01T13:06:18,821   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-01T13:06:18,825   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-01T13:06:18,827   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-06-01T13:06:18,830   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T13:06:18,832   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T13:06:18,835   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T13:06:18,837   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T13:06:18,840   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T13:06:18,842   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T13:06:18,844   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-06-01T13:06:18,847   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T13:06:18,848   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T13:06:18,851   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T13:06:18,854   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T13:06:18,857   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T13:06:18,859   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T13:06:18,861   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T13:06:18,864   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-01T13:06:18,865   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-01T13:06:18,868   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-06-01T13:06:18,871   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2025-06-01T13:06:18,873   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T13:06:18,874   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T13:06:18,877   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T13:06:18,880   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T13:06:18,881   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T13:06:18,884   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T13:06:18,886   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T13:06:18,888   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T13:06:18,891   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T13:06:18,892   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T13:06:18,895   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T13:06:18,897   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T13:06:18,899   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T13:06:18,901   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T13:06:18,904   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T13:06:18,906   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T13:06:18,909   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T13:06:18,911   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T13:06:18,913   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T13:06:18,917   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T13:06:18,918   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T13:06:18,921   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T13:06:18,924   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:18,926   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:18,928   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:18,931   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:18,933   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:18,936   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:18,938   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:18,941   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:18,943   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:18,945   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T13:06:18,948   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T13:06:18,950   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T13:06:18,953   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T13:06:18,956   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T13:06:18,958   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-06-01T13:06:18,960   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-06-01T13:06:18,963   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:18,965   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:18,967   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:18,970   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:18,972   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:18,974   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:18,976   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:18,978   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:18,980   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T13:06:18,985   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T13:06:18,986   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T13:06:18,989   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T13:06:18,991   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T13:06:18,993   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T13:06:18,995   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T13:06:18,998   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2025-06-01T13:06:19,000   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-06-01T13:06:19,003   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T13:06:19,004   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T13:06:19,007   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T13:06:19,009   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T13:06:19,012   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T13:06:19,014   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T13:06:19,016   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T13:06:19,019   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:19,020   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:19,023   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:19,025   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:19,027   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:19,030   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:19,033   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:19,035   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:19,037   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T13:06:19,040   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T13:06:19,041   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T13:06:19,044   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T13:06:19,046   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T13:06:19,048   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T13:06:19,051   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T13:06:19,053   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T13:06:19,056   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T13:06:19,057   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T13:06:19,059   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T13:06:19,062   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T13:06:19,064   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T13:06:19,066   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T13:06:19,068   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T13:06:19,071   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-01T13:06:19,072   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-01T13:06:19,074   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-06-01T13:06:19,077   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T13:06:19,078   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T13:06:19,080   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T13:06:19,082   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T13:06:19,084   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T13:06:19,087   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-01T13:06:19,088   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-01T13:06:19,090   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-01T13:06:19,092   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-01T13:06:19,095   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T13:06:19,096   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T13:06:19,099   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T13:06:19,101   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T13:06:19,103   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T13:06:19,106   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T13:06:19,108   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T13:06:19,111   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T13:06:19,112   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T13:06:19,114   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T13:06:19,117   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T13:06:19,119   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T13:06:19,121   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T13:06:19,123   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T13:06:19,126   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T13:06:19,127   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T13:06:19,129   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T13:06:19,131   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T13:06:19,134   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T13:06:19,136   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T13:06:19,138   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T13:06:19,140   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T13:06:19,143   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-01T13:06:19,146   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-01T13:06:19,150   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2025-06-01T13:06:19,151   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T13:06:19,154   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T13:06:19,156   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T13:06:19,159   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T13:06:19,161   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T13:06:19,163   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T13:06:19,166   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T13:06:19,169   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T13:06:19,173   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T13:06:19,176   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T13:06:19,179   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T13:06:19,182   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T13:06:19,185   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T13:06:19,188   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2025-06-01T13:06:19,189   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,192   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,194   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,197   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,199   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,202   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,204   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,207   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,209   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,212   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,214   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,216   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,219   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,222   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2025-06-01T13:06:19,223   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-01T13:06:19,226   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-01T13:06:19,229   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-01T13:06:19,231   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-01T13:06:19,233   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-01T13:06:19,236   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-01T13:06:19,239   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-01T13:06:19,242   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,245   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,247   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,250   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,252   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,254   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T13:06:19,257   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2025-06-01T13:06:19,259   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-01T13:06:19,261   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-01T13:06:19,264   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-01T13:06:19,266   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-01T13:06:19,269   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-01T13:06:19,272   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-01T13:06:19,274   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-01T13:06:19,277   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2025-06-01T13:06:19,278   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T13:06:19,281   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T13:06:19,284   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T13:06:19,287   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T13:06:19,289   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T13:06:19,292   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T13:06:19,294   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T13:06:19,296   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T13:06:19,299   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T13:06:19,302   creating build/bdist.linux-armv7l/wheel/deepspeed/compile
2025-06-01T13:06:19,303   copying build/lib/deepspeed/compile/patch_compiled_func.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T13:06:19,305   copying build/lib/deepspeed/compile/inductor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T13:06:19,308   copying build/lib/deepspeed/compile/graph_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T13:06:19,310   copying build/lib/deepspeed/compile/init_z3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T13:06:19,313   copying build/lib/deepspeed/compile/util.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T13:06:19,316   copying build/lib/deepspeed/compile/partitioner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T13:06:19,318   copying build/lib/deepspeed/compile/init_z1.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T13:06:19,321   copying build/lib/deepspeed/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T13:06:19,323   copying build/lib/deepspeed/compile/patch_fake_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T13:06:19,325   copying build/lib/deepspeed/compile/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T13:06:19,328   copying build/lib/deepspeed/compile/fx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T13:06:19,330   copying build/lib/deepspeed/compile/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T13:06:19,333   creating build/bdist.linux-armv7l/wheel/deepspeed/compile/passes
2025-06-01T13:06:19,335   copying build/lib/deepspeed/compile/passes/selective_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-01T13:06:19,338   copying build/lib/deepspeed/compile/passes/zero3_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-01T13:06:19,340   copying build/lib/deepspeed/compile/passes/zero1_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-01T13:06:19,342   copying build/lib/deepspeed/compile/passes/offload_adam_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-01T13:06:19,345   copying build/lib/deepspeed/compile/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-01T13:06:19,347   copying build/lib/deepspeed/compile/passes/prefetch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-01T13:06:19,350   copying build/lib/deepspeed/compile/passes/offload_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-01T13:06:19,352   copying build/lib/deepspeed/compile/passes/offload_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-01T13:06:19,355   creating build/bdist.linux-armv7l/wheel/deepspeed/compile/profilers
2025-06-01T13:06:19,356   copying build/lib/deepspeed/compile/profilers/graph_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-01T13:06:19,359   copying build/lib/deepspeed/compile/profilers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-01T13:06:19,361   copying build/lib/deepspeed/compile/profilers/comm_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-01T13:06:19,364   copying build/lib/deepspeed/compile/list_schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T13:06:19,367   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2025-06-01T13:06:19,369   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-01T13:06:19,372   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-01T13:06:19,374   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-01T13:06:19,376   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-01T13:06:19,379   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-01T13:06:19,382   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-01T13:06:19,386   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2025-06-01T13:06:19,387   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-01T13:06:19,390   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-01T13:06:19,392   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-01T13:06:19,394   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-01T13:06:19,396   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2025-06-01T13:06:19,397   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-01T13:06:19,400   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-01T13:06:19,402   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-01T13:06:19,404   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-01T13:06:19,406   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-01T13:06:19,408   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-01T13:06:19,411   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2025-06-01T13:06:19,413   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T13:06:19,416   copying build/lib/deepspeed/accelerator/sdaa_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T13:06:19,418   copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T13:06:19,421   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T13:06:19,424   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T13:06:19,426   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T13:06:19,428   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T13:06:19,431   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T13:06:19,433   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T13:06:19,436   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T13:06:19,439   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T13:06:19,442   creating build/bdist.linux-armv7l/wheel/deepspeed/nvme
2025-06-01T13:06:19,443   copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T13:06:19,447   copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T13:06:19,449   copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T13:06:19,452   copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T13:06:19,455   copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T13:06:19,457   copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T13:06:19,460   copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T13:06:19,464   copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T13:06:19,468   copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T13:06:19,471   copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T13:06:19,473   copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T13:06:19,477   copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T13:06:19,480   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2025-06-01T13:06:19,481   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,484   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,487   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,489   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,492   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,496   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,498   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,501   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,503   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,506   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,509   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,513   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,515   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,518   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,521   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,523   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,526   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,529   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T13:06:19,532   running install_egg_info
2025-06-01T13:06:19,570   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.16.6-py3.11.egg-info
2025-06-01T13:06:19,585   running install_scripts
2025-06-01T13:06:19,587   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts
2025-06-01T13:06:19,588   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts
2025-06-01T13:06:19,590   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts
2025-06-01T13:06:19,592   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts
2025-06-01T13:06:19,594   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts
2025-06-01T13:06:19,597   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts
2025-06-01T13:06:19,599   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts
2025-06-01T13:06:19,601   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts
2025-06-01T13:06:19,603   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts
2025-06-01T13:06:19,606   copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts
2025-06-01T13:06:19,608   copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts
2025-06-01T13:06:19,610   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts/deepspeed.pt to 755
2025-06-01T13:06:19,611   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts/deepspeed to 755
2025-06-01T13:06:19,612   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts/ds to 755
2025-06-01T13:06:19,612   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts/ds_ssh to 755
2025-06-01T13:06:19,613   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts/dsr to 755
2025-06-01T13:06:19,614   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts/ds_report to 755
2025-06-01T13:06:19,614   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts/ds_elastic to 755
2025-06-01T13:06:19,615   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts/ds_bench to 755
2025-06-01T13:06:19,615   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts/ds_nvme_tune to 755
2025-06-01T13:06:19,616   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.data/scripts/ds_io to 755
2025-06-01T13:06:19,632   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.6.dist-info/WHEEL
2025-06-01T13:06:19,635   creating '/tmp/pip-wheel-kjpqfp08/deepspeed-0.16.6-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2025-06-01T13:06:19,640   adding 'deepspeed/__init__.py'
2025-06-01T13:06:19,641   adding 'deepspeed/constants.py'
2025-06-01T13:06:19,644   adding 'deepspeed/env_report.py'
2025-06-01T13:06:19,645   adding 'deepspeed/git_version_info.py'
2025-06-01T13:06:19,647   adding 'deepspeed/git_version_info_installed.py'
2025-06-01T13:06:19,649   adding 'deepspeed/accelerator/__init__.py'
2025-06-01T13:06:19,651   adding 'deepspeed/accelerator/abstract_accelerator.py'
2025-06-01T13:06:19,653   adding 'deepspeed/accelerator/cpu_accelerator.py'
2025-06-01T13:06:19,655   adding 'deepspeed/accelerator/cuda_accelerator.py'
2025-06-01T13:06:19,657   adding 'deepspeed/accelerator/hpu_accelerator.py'
2025-06-01T13:06:19,659   adding 'deepspeed/accelerator/mlu_accelerator.py'
2025-06-01T13:06:19,661   adding 'deepspeed/accelerator/mps_accelerator.py'
2025-06-01T13:06:19,663   adding 'deepspeed/accelerator/npu_accelerator.py'
2025-06-01T13:06:19,665   adding 'deepspeed/accelerator/real_accelerator.py'
2025-06-01T13:06:19,667   adding 'deepspeed/accelerator/sdaa_accelerator.py'
2025-06-01T13:06:19,669   adding 'deepspeed/accelerator/xpu_accelerator.py'
2025-06-01T13:06:19,671   adding 'deepspeed/autotuning/__init__.py'
2025-06-01T13:06:19,677   adding 'deepspeed/autotuning/autotuner.py'
2025-06-01T13:06:19,679   adding 'deepspeed/autotuning/config.py'
2025-06-01T13:06:19,680   adding 'deepspeed/autotuning/constants.py'
2025-06-01T13:06:19,683   adding 'deepspeed/autotuning/scheduler.py'
2025-06-01T13:06:19,685   adding 'deepspeed/autotuning/utils.py'
2025-06-01T13:06:19,687   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2025-06-01T13:06:19,688   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2025-06-01T13:06:19,690   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2025-06-01T13:06:19,691   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2025-06-01T13:06:19,693   adding 'deepspeed/autotuning/tuner/__init__.py'
2025-06-01T13:06:19,695   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2025-06-01T13:06:19,696   adding 'deepspeed/autotuning/tuner/cost_model.py'
2025-06-01T13:06:19,698   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2025-06-01T13:06:19,700   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2025-06-01T13:06:19,701   adding 'deepspeed/autotuning/tuner/utils.py'
2025-06-01T13:06:19,703   adding 'deepspeed/checkpoint/__init__.py'
2025-06-01T13:06:19,705   adding 'deepspeed/checkpoint/constants.py'
2025-06-01T13:06:19,707   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2025-06-01T13:06:19,710   adding 'deepspeed/checkpoint/ds_to_universal.py'
2025-06-01T13:06:19,712   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2025-06-01T13:06:19,714   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2025-06-01T13:06:19,716   adding 'deepspeed/checkpoint/reshape_utils.py'
2025-06-01T13:06:19,717   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2025-06-01T13:06:19,719   adding 'deepspeed/checkpoint/utils.py'
2025-06-01T13:06:19,720   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2025-06-01T13:06:19,722   adding 'deepspeed/comm/__init__.py'
2025-06-01T13:06:19,724   adding 'deepspeed/comm/backend.py'
2025-06-01T13:06:19,725   adding 'deepspeed/comm/ccl.py'
2025-06-01T13:06:19,729   adding 'deepspeed/comm/comm.py'
2025-06-01T13:06:19,731   adding 'deepspeed/comm/config.py'
2025-06-01T13:06:19,732   adding 'deepspeed/comm/constants.py'
2025-06-01T13:06:19,733   adding 'deepspeed/comm/reduce_op.py'
2025-06-01T13:06:19,735   adding 'deepspeed/comm/torch.py'
2025-06-01T13:06:19,737   adding 'deepspeed/comm/utils.py'
2025-06-01T13:06:19,740   adding 'deepspeed/compile/__init__.py'
2025-06-01T13:06:19,742   adding 'deepspeed/compile/backend.py'
2025-06-01T13:06:19,743   adding 'deepspeed/compile/config.py'
2025-06-01T13:06:19,744   adding 'deepspeed/compile/fx.py'
2025-06-01T13:06:19,746   adding 'deepspeed/compile/graph_param.py'
2025-06-01T13:06:19,747   adding 'deepspeed/compile/inductor.py'
2025-06-01T13:06:19,749   adding 'deepspeed/compile/init_z1.py'
2025-06-01T13:06:19,750   adding 'deepspeed/compile/init_z3.py'
2025-06-01T13:06:19,752   adding 'deepspeed/compile/list_schedule.py'
2025-06-01T13:06:19,754   adding 'deepspeed/compile/partitioner.py'
2025-06-01T13:06:19,756   adding 'deepspeed/compile/patch_compiled_func.py'
2025-06-01T13:06:19,757   adding 'deepspeed/compile/patch_fake_tensor.py'
2025-06-01T13:06:19,759   adding 'deepspeed/compile/util.py'
2025-06-01T13:06:19,761   adding 'deepspeed/compile/passes/__init__.py'
2025-06-01T13:06:19,762   adding 'deepspeed/compile/passes/offload_activation.py'
2025-06-01T13:06:19,765   adding 'deepspeed/compile/passes/offload_adam_states.py'
2025-06-01T13:06:19,766   adding 'deepspeed/compile/passes/offload_parameters.py'
2025-06-01T13:06:19,768   adding 'deepspeed/compile/passes/prefetch.py'
2025-06-01T13:06:19,770   adding 'deepspeed/compile/passes/selective_gather.py'
2025-06-01T13:06:19,771   adding 'deepspeed/compile/passes/zero1_compile.py'
2025-06-01T13:06:19,773   adding 'deepspeed/compile/passes/zero3_compile.py'
2025-06-01T13:06:19,774   adding 'deepspeed/compile/profilers/__init__.py'
2025-06-01T13:06:19,776   adding 'deepspeed/compile/profilers/comm_profile.py'
2025-06-01T13:06:19,779   adding 'deepspeed/compile/profilers/graph_profile.py'
2025-06-01T13:06:19,780   adding 'deepspeed/compression/__init__.py'
2025-06-01T13:06:19,784   adding 'deepspeed/compression/basic_layer.py'
2025-06-01T13:06:19,786   adding 'deepspeed/compression/compress.py'
2025-06-01T13:06:19,789   adding 'deepspeed/compression/config.py'
2025-06-01T13:06:19,791   adding 'deepspeed/compression/constants.py'
2025-06-01T13:06:19,793   adding 'deepspeed/compression/helper.py'
2025-06-01T13:06:19,795   adding 'deepspeed/compression/scheduler.py'
2025-06-01T13:06:19,797   adding 'deepspeed/compression/utils.py'
2025-06-01T13:06:19,799   adding 'deepspeed/elasticity/__init__.py'
2025-06-01T13:06:19,800   adding 'deepspeed/elasticity/config.py'
2025-06-01T13:06:19,802   adding 'deepspeed/elasticity/constants.py'
2025-06-01T13:06:19,803   adding 'deepspeed/elasticity/elastic_agent.py'
2025-06-01T13:06:19,806   adding 'deepspeed/elasticity/elasticity.py'
2025-06-01T13:06:19,807   adding 'deepspeed/elasticity/utils.py'
2025-06-01T13:06:19,809   adding 'deepspeed/inference/__init__.py'
2025-06-01T13:06:19,811   adding 'deepspeed/inference/config.py'
2025-06-01T13:06:19,815   adding 'deepspeed/inference/engine.py'
2025-06-01T13:06:19,817   adding 'deepspeed/inference/quantization/__init__.py'
2025-06-01T13:06:19,819   adding 'deepspeed/inference/quantization/layers.py'
2025-06-01T13:06:19,820   adding 'deepspeed/inference/quantization/quantization.py'
2025-06-01T13:06:19,821   adding 'deepspeed/inference/quantization/quantization_context.py'
2025-06-01T13:06:19,823   adding 'deepspeed/inference/quantization/utils.py'
2025-06-01T13:06:19,826   adding 'deepspeed/inference/v2/__init__.py'
2025-06-01T13:06:19,827   adding 'deepspeed/inference/v2/allocator.py'
2025-06-01T13:06:19,828   adding 'deepspeed/inference/v2/config_v2.py'
2025-06-01T13:06:19,830   adding 'deepspeed/inference/v2/engine_factory.py'
2025-06-01T13:06:19,832   adding 'deepspeed/inference/v2/engine_v2.py'
2025-06-01T13:06:19,833   adding 'deepspeed/inference/v2/inference_parameter.py'
2025-06-01T13:06:19,835   adding 'deepspeed/inference/v2/inference_utils.py'
2025-06-01T13:06:19,836   adding 'deepspeed/inference/v2/logging.py'
2025-06-01T13:06:19,837   adding 'deepspeed/inference/v2/scheduling_utils.py'
2025-06-01T13:06:19,839   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2025-06-01T13:06:19,841   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2025-06-01T13:06:19,842   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2025-06-01T13:06:19,844   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2025-06-01T13:06:19,847   adding 'deepspeed/inference/v2/kernels/__init__.py'
2025-06-01T13:06:19,848   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2025-06-01T13:06:19,850   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2025-06-01T13:06:19,851   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2025-06-01T13:06:19,854   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2025-06-01T13:06:19,855   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2025-06-01T13:06:19,857   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2025-06-01T13:06:19,858   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2025-06-01T13:06:19,860   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2025-06-01T13:06:19,862   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2025-06-01T13:06:19,864   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2025-06-01T13:06:19,865   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2025-06-01T13:06:19,867   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2025-06-01T13:06:19,869   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2025-06-01T13:06:19,871   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2025-06-01T13:06:19,872   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2025-06-01T13:06:19,874   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2025-06-01T13:06:19,875   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2025-06-01T13:06:19,877   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2025-06-01T13:06:19,879   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2025-06-01T13:06:19,881   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2025-06-01T13:06:19,883   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2025-06-01T13:06:19,885   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2025-06-01T13:06:19,887   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2025-06-01T13:06:19,889   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2025-06-01T13:06:19,891   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2025-06-01T13:06:19,892   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2025-06-01T13:06:19,895   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2025-06-01T13:06:19,897   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2025-06-01T13:06:19,899   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2025-06-01T13:06:19,900   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2025-06-01T13:06:19,902   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2025-06-01T13:06:19,903   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2025-06-01T13:06:19,905   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2025-06-01T13:06:19,906   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2025-06-01T13:06:19,908   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2025-06-01T13:06:19,910   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2025-06-01T13:06:19,911   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2025-06-01T13:06:19,913   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2025-06-01T13:06:19,914   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2025-06-01T13:06:19,915   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2025-06-01T13:06:19,917   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2025-06-01T13:06:19,918   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2025-06-01T13:06:19,920   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2025-06-01T13:06:19,921   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2025-06-01T13:06:19,923   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2025-06-01T13:06:19,924   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2025-06-01T13:06:19,926   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2025-06-01T13:06:19,928   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2025-06-01T13:06:19,930   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2025-06-01T13:06:19,931   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2025-06-01T13:06:19,933   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2025-06-01T13:06:19,934   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2025-06-01T13:06:19,936   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2025-06-01T13:06:19,937   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2025-06-01T13:06:19,939   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2025-06-01T13:06:19,941   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2025-06-01T13:06:19,943   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2025-06-01T13:06:19,944   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2025-06-01T13:06:19,946   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2025-06-01T13:06:19,947   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2025-06-01T13:06:19,951   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2025-06-01T13:06:19,954   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2025-06-01T13:06:19,956   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2025-06-01T13:06:19,958   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2025-06-01T13:06:19,961   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2025-06-01T13:06:19,964   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2025-06-01T13:06:19,966   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2025-06-01T13:06:19,967   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2025-06-01T13:06:19,969   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2025-06-01T13:06:19,970   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2025-06-01T13:06:19,972   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2025-06-01T13:06:19,973   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2025-06-01T13:06:19,975   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2025-06-01T13:06:19,976   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2025-06-01T13:06:19,978   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2025-06-01T13:06:19,979   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2025-06-01T13:06:19,981   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2025-06-01T13:06:19,982   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2025-06-01T13:06:19,984   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2025-06-01T13:06:19,985   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2025-06-01T13:06:19,987   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2025-06-01T13:06:19,988   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2025-06-01T13:06:19,989   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2025-06-01T13:06:19,991   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2025-06-01T13:06:19,993   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2025-06-01T13:06:19,995   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2025-06-01T13:06:19,996   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2025-06-01T13:06:19,998   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2025-06-01T13:06:19,999   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2025-06-01T13:06:20,001   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2025-06-01T13:06:20,003   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2025-06-01T13:06:20,005   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2025-06-01T13:06:20,006   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2025-06-01T13:06:20,009   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2025-06-01T13:06:20,010   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2025-06-01T13:06:20,012   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2025-06-01T13:06:20,013   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2025-06-01T13:06:20,015   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2025-06-01T13:06:20,016   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2025-06-01T13:06:20,019   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2025-06-01T13:06:20,020   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2025-06-01T13:06:20,022   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2025-06-01T13:06:20,023   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2025-06-01T13:06:20,025   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2025-06-01T13:06:20,027   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2025-06-01T13:06:20,030   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2025-06-01T13:06:20,031   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2025-06-01T13:06:20,032   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2025-06-01T13:06:20,033   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2025-06-01T13:06:20,035   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2025-06-01T13:06:20,037   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2025-06-01T13:06:20,039   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2025-06-01T13:06:20,041   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2025-06-01T13:06:20,042   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2025-06-01T13:06:20,044   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2025-06-01T13:06:20,046   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2025-06-01T13:06:20,048   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2025-06-01T13:06:20,049   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2025-06-01T13:06:20,051   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2025-06-01T13:06:20,053   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2025-06-01T13:06:20,055   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2025-06-01T13:06:20,058   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2025-06-01T13:06:20,060   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2025-06-01T13:06:20,062   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2025-06-01T13:06:20,065   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2025-06-01T13:06:20,068   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2025-06-01T13:06:20,070   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2025-06-01T13:06:20,072   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2025-06-01T13:06:20,073   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2025-06-01T13:06:20,074   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2025-06-01T13:06:20,076   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2025-06-01T13:06:20,077   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2025-06-01T13:06:20,079   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2025-06-01T13:06:20,080   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2025-06-01T13:06:20,082   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2025-06-01T13:06:20,083   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2025-06-01T13:06:20,085   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2025-06-01T13:06:20,087   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2025-06-01T13:06:20,089   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2025-06-01T13:06:20,091   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2025-06-01T13:06:20,093   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2025-06-01T13:06:20,096   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2025-06-01T13:06:20,098   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2025-06-01T13:06:20,100   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2025-06-01T13:06:20,104   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2025-06-01T13:06:20,106   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2025-06-01T13:06:20,109   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2025-06-01T13:06:20,111   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2025-06-01T13:06:20,113   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2025-06-01T13:06:20,115   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2025-06-01T13:06:20,117   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2025-06-01T13:06:20,118   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2025-06-01T13:06:20,120   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2025-06-01T13:06:20,122   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2025-06-01T13:06:20,124   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2025-06-01T13:06:20,125   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2025-06-01T13:06:20,127   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2025-06-01T13:06:20,129   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2025-06-01T13:06:20,131   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2025-06-01T13:06:20,132   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2025-06-01T13:06:20,135   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2025-06-01T13:06:20,136   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2025-06-01T13:06:20,138   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2025-06-01T13:06:20,140   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2025-06-01T13:06:20,141   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2025-06-01T13:06:20,143   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2025-06-01T13:06:20,145   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2025-06-01T13:06:20,146   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2025-06-01T13:06:20,148   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2025-06-01T13:06:20,150   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2025-06-01T13:06:20,152   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2025-06-01T13:06:20,153   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2025-06-01T13:06:20,200   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2025-06-01T13:06:20,202   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2025-06-01T13:06:20,207   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2025-06-01T13:06:20,209   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2025-06-01T13:06:20,212   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2025-06-01T13:06:20,214   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2025-06-01T13:06:20,216   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2025-06-01T13:06:20,218   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2025-06-01T13:06:20,220   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2025-06-01T13:06:20,222   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2025-06-01T13:06:20,224   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2025-06-01T13:06:20,226   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2025-06-01T13:06:20,227   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2025-06-01T13:06:20,230   adding 'deepspeed/inference/v2/modules/__init__.py'
2025-06-01T13:06:20,231   adding 'deepspeed/inference/v2/modules/ds_module.py'
2025-06-01T13:06:20,232   adding 'deepspeed/inference/v2/modules/heuristics.py'
2025-06-01T13:06:20,234   adding 'deepspeed/inference/v2/modules/module_registry.py'
2025-06-01T13:06:20,235   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2025-06-01T13:06:20,237   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2025-06-01T13:06:20,238   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2025-06-01T13:06:20,240   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2025-06-01T13:06:20,241   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2025-06-01T13:06:20,242   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2025-06-01T13:06:20,244   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2025-06-01T13:06:20,245   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2025-06-01T13:06:20,248   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2025-06-01T13:06:20,249   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2025-06-01T13:06:20,251   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2025-06-01T13:06:20,253   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2025-06-01T13:06:20,254   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2025-06-01T13:06:20,256   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2025-06-01T13:06:20,258   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2025-06-01T13:06:20,260   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2025-06-01T13:06:20,262   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2025-06-01T13:06:20,264   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2025-06-01T13:06:20,265   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2025-06-01T13:06:20,267   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2025-06-01T13:06:20,269   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2025-06-01T13:06:20,270   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2025-06-01T13:06:20,272   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2025-06-01T13:06:20,274   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2025-06-01T13:06:20,276   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2025-06-01T13:06:20,278   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2025-06-01T13:06:20,279   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2025-06-01T13:06:20,280   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2025-06-01T13:06:20,282   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2025-06-01T13:06:20,283   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2025-06-01T13:06:20,285   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2025-06-01T13:06:20,286   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2025-06-01T13:06:20,288   adding 'deepspeed/inference/v2/ragged/__init__.py'
2025-06-01T13:06:20,290   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2025-06-01T13:06:20,291   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2025-06-01T13:06:20,293   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2025-06-01T13:06:20,295   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2025-06-01T13:06:20,298   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2025-06-01T13:06:20,300   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2025-06-01T13:06:20,302   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2025-06-01T13:06:20,303   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2025-06-01T13:06:20,305   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2025-06-01T13:06:20,307   adding 'deepspeed/launcher/__init__.py'
2025-06-01T13:06:20,308   adding 'deepspeed/launcher/constants.py'
2025-06-01T13:06:20,310   adding 'deepspeed/launcher/launch.py'
2025-06-01T13:06:20,312   adding 'deepspeed/launcher/launcher_helper.py'
2025-06-01T13:06:20,315   adding 'deepspeed/launcher/multinode_runner.py'
2025-06-01T13:06:20,318   adding 'deepspeed/launcher/runner.py'
2025-06-01T13:06:20,320   adding 'deepspeed/linear/__init__.py'
2025-06-01T13:06:20,322   adding 'deepspeed/linear/config.py'
2025-06-01T13:06:20,323   adding 'deepspeed/linear/context_manager.py'
2025-06-01T13:06:20,326   adding 'deepspeed/linear/optimized_linear.py'
2025-06-01T13:06:20,327   adding 'deepspeed/linear/quantization.py'
2025-06-01T13:06:20,330   adding 'deepspeed/model_implementations/__init__.py'
2025-06-01T13:06:20,331   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2025-06-01T13:06:20,333   adding 'deepspeed/model_implementations/diffusers/unet.py'
2025-06-01T13:06:20,334   adding 'deepspeed/model_implementations/diffusers/vae.py'
2025-06-01T13:06:20,336   adding 'deepspeed/model_implementations/features/__init__.py'
2025-06-01T13:06:20,338   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2025-06-01T13:06:20,340   adding 'deepspeed/model_implementations/transformers/__init__.py'
2025-06-01T13:06:20,341   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2025-06-01T13:06:20,342   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2025-06-01T13:06:20,344   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2025-06-01T13:06:20,345   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2025-06-01T13:06:20,346   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2025-06-01T13:06:20,348   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2025-06-01T13:06:20,350   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2025-06-01T13:06:20,351   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2025-06-01T13:06:20,354   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2025-06-01T13:06:20,357   adding 'deepspeed/module_inject/__init__.py'
2025-06-01T13:06:20,361   adding 'deepspeed/module_inject/auto_tp.py'
2025-06-01T13:06:20,363   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2025-06-01T13:06:20,365   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2025-06-01T13:06:20,366   adding 'deepspeed/module_inject/inject.py'
2025-06-01T13:06:20,371   adding 'deepspeed/module_inject/layers.py'
2025-06-01T13:06:20,373   adding 'deepspeed/module_inject/load_checkpoint.py'
2025-06-01T13:06:20,375   adding 'deepspeed/module_inject/module_quantize.py'
2025-06-01T13:06:20,376   adding 'deepspeed/module_inject/policy.py'
2025-06-01T13:06:20,381   adding 'deepspeed/module_inject/replace_module.py'
2025-06-01T13:06:20,382   adding 'deepspeed/module_inject/replace_policy.py'
2025-06-01T13:06:20,384   adding 'deepspeed/module_inject/tp_shard.py'
2025-06-01T13:06:20,385   adding 'deepspeed/module_inject/utils.py'
2025-06-01T13:06:20,387   adding 'deepspeed/module_inject/containers/__init__.py'
2025-06-01T13:06:20,390   adding 'deepspeed/module_inject/containers/base.py'
2025-06-01T13:06:20,392   adding 'deepspeed/module_inject/containers/base_moe.py'
2025-06-01T13:06:20,393   adding 'deepspeed/module_inject/containers/bert.py'
2025-06-01T13:06:20,395   adding 'deepspeed/module_inject/containers/bloom.py'
2025-06-01T13:06:20,397   adding 'deepspeed/module_inject/containers/clip.py'
2025-06-01T13:06:20,399   adding 'deepspeed/module_inject/containers/distil_bert.py'
2025-06-01T13:06:20,400   adding 'deepspeed/module_inject/containers/gpt2.py'
2025-06-01T13:06:20,402   adding 'deepspeed/module_inject/containers/gptj.py'
2025-06-01T13:06:20,404   adding 'deepspeed/module_inject/containers/gptneo.py'
2025-06-01T13:06:20,405   adding 'deepspeed/module_inject/containers/gptneox.py'
2025-06-01T13:06:20,407   adding 'deepspeed/module_inject/containers/internlm.py'
2025-06-01T13:06:20,409   adding 'deepspeed/module_inject/containers/llama.py'
2025-06-01T13:06:20,411   adding 'deepspeed/module_inject/containers/llama2.py'
2025-06-01T13:06:20,413   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2025-06-01T13:06:20,414   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2025-06-01T13:06:20,416   adding 'deepspeed/module_inject/containers/opt.py'
2025-06-01T13:06:20,417   adding 'deepspeed/module_inject/containers/unet.py'
2025-06-01T13:06:20,418   adding 'deepspeed/module_inject/containers/vae.py'
2025-06-01T13:06:20,420   adding 'deepspeed/module_inject/containers/features/__init__.py'
2025-06-01T13:06:20,421   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2025-06-01T13:06:20,423   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2025-06-01T13:06:20,425   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2025-06-01T13:06:20,426   adding 'deepspeed/module_inject/containers/features/megatron.py'
2025-06-01T13:06:20,427   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2025-06-01T13:06:20,429   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2025-06-01T13:06:20,431   adding 'deepspeed/moe/__init__.py'
2025-06-01T13:06:20,432   adding 'deepspeed/moe/experts.py'
2025-06-01T13:06:20,434   adding 'deepspeed/moe/layer.py'
2025-06-01T13:06:20,435   adding 'deepspeed/moe/mappings.py'
2025-06-01T13:06:20,439   adding 'deepspeed/moe/sharded_moe.py'
2025-06-01T13:06:20,441   adding 'deepspeed/moe/utils.py'
2025-06-01T13:06:20,443   adding 'deepspeed/monitor/__init__.py'
2025-06-01T13:06:20,444   adding 'deepspeed/monitor/comet.py'
2025-06-01T13:06:20,446   adding 'deepspeed/monitor/config.py'
2025-06-01T13:06:20,448   adding 'deepspeed/monitor/csv_monitor.py'
2025-06-01T13:06:20,449   adding 'deepspeed/monitor/monitor.py'
2025-06-01T13:06:20,450   adding 'deepspeed/monitor/tensorboard.py'
2025-06-01T13:06:20,452   adding 'deepspeed/monitor/utils.py'
2025-06-01T13:06:20,453   adding 'deepspeed/monitor/wandb.py'
2025-06-01T13:06:20,455   adding 'deepspeed/nebula/__init__.py'
2025-06-01T13:06:20,457   adding 'deepspeed/nebula/config.py'
2025-06-01T13:06:20,458   adding 'deepspeed/nebula/constants.py'
2025-06-01T13:06:20,460   adding 'deepspeed/nvme/__init__.py'
2025-06-01T13:06:20,462   adding 'deepspeed/nvme/ds_aio_args.py'
2025-06-01T13:06:20,463   adding 'deepspeed/nvme/ds_aio_basic.py'
2025-06-01T13:06:20,465   adding 'deepspeed/nvme/ds_aio_handle.py'
2025-06-01T13:06:20,466   adding 'deepspeed/nvme/ds_aio_job.py'
2025-06-01T13:06:20,468   adding 'deepspeed/nvme/parse_nvme_stats.py'
2025-06-01T13:06:20,470   adding 'deepspeed/nvme/perf_generate_param.py'
2025-06-01T13:06:20,472   adding 'deepspeed/nvme/perf_run_sweep.py'
2025-06-01T13:06:20,473   adding 'deepspeed/nvme/perf_sweep_utils.py'
2025-06-01T13:06:20,474   adding 'deepspeed/nvme/test_ds_aio.py'
2025-06-01T13:06:20,476   adding 'deepspeed/nvme/test_ds_aio_utils.py'
2025-06-01T13:06:20,477   adding 'deepspeed/nvme/validate_async_io.py'
2025-06-01T13:06:20,479   adding 'deepspeed/ops/__init__.py'
2025-06-01T13:06:20,481   adding 'deepspeed/ops/adagrad/__init__.py'
2025-06-01T13:06:20,483   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2025-06-01T13:06:20,485   adding 'deepspeed/ops/adam/__init__.py'
2025-06-01T13:06:20,487   adding 'deepspeed/ops/adam/cpu_adam.py'
2025-06-01T13:06:20,489   adding 'deepspeed/ops/adam/fused_adam.py'
2025-06-01T13:06:20,490   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2025-06-01T13:06:20,492   adding 'deepspeed/ops/aio/__init__.py'
2025-06-01T13:06:20,494   adding 'deepspeed/ops/compile/__init__.py'
2025-06-01T13:06:20,497   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2025-06-01T13:06:20,499   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2025-06-01T13:06:20,501   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2025-06-01T13:06:20,502   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2025-06-01T13:06:20,504   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2025-06-01T13:06:20,505   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2025-06-01T13:06:20,509   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2025-06-01T13:06:20,511   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2025-06-01T13:06:20,512   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2025-06-01T13:06:20,514   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2025-06-01T13:06:20,515   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2025-06-01T13:06:20,517   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2025-06-01T13:06:20,519   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2025-06-01T13:06:20,520   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2025-06-01T13:06:20,522   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2025-06-01T13:06:20,523   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2025-06-01T13:06:20,525   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2025-06-01T13:06:20,526   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2025-06-01T13:06:20,527   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2025-06-01T13:06:20,528   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2025-06-01T13:06:20,530   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2025-06-01T13:06:20,531   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2025-06-01T13:06:20,533   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2025-06-01T13:06:20,534   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2025-06-01T13:06:20,535   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2025-06-01T13:06:20,537   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2025-06-01T13:06:20,539   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2025-06-01T13:06:20,540   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2025-06-01T13:06:20,542   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2025-06-01T13:06:20,544   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2025-06-01T13:06:20,546   adding 'deepspeed/ops/csrc/compile/deepcompile.cpp'
2025-06-01T13:06:20,547   adding 'deepspeed/ops/csrc/compile/init.cpp'
2025-06-01T13:06:20,549   adding 'deepspeed/ops/csrc/compile/util.cpp'
2025-06-01T13:06:20,551   adding 'deepspeed/ops/csrc/compile/z1.cpp'
2025-06-01T13:06:20,552   adding 'deepspeed/ops/csrc/compile/z1.h'
2025-06-01T13:06:20,555   adding 'deepspeed/ops/csrc/compile/z3.cpp'
2025-06-01T13:06:20,557   adding 'deepspeed/ops/csrc/compile/z3.h'
2025-06-01T13:06:20,559   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2025-06-01T13:06:20,562   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2025-06-01T13:06:20,565   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2025-06-01T13:06:20,567   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2025-06-01T13:06:20,569   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2025-06-01T13:06:20,571   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2025-06-01T13:06:20,574   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2025-06-01T13:06:20,576   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2025-06-01T13:06:20,577   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2025-06-01T13:06:20,579   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2025-06-01T13:06:20,589   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2025-06-01T13:06:20,594   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2025-06-01T13:06:20,597   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2025-06-01T13:06:20,600   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2025-06-01T13:06:20,602   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2025-06-01T13:06:20,603   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2025-06-01T13:06:20,606   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2025-06-01T13:06:20,607   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2025-06-01T13:06:20,611   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2025-06-01T13:06:20,613   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2025-06-01T13:06:20,615   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2025-06-01T13:06:20,617   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2025-06-01T13:06:20,625   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2025-06-01T13:06:20,629   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2025-06-01T13:06:20,631   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2025-06-01T13:06:20,635   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2025-06-01T13:06:20,639   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2025-06-01T13:06:20,643   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2025-06-01T13:06:20,645   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2025-06-01T13:06:20,647   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2025-06-01T13:06:20,649   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2025-06-01T13:06:20,651   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2025-06-01T13:06:20,653   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2025-06-01T13:06:20,656   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2025-06-01T13:06:20,658   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2025-06-01T13:06:20,659   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2025-06-01T13:06:20,662   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2025-06-01T13:06:20,663   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2025-06-01T13:06:20,665   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2025-06-01T13:06:20,666   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2025-06-01T13:06:20,668   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2025-06-01T13:06:20,669   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2025-06-01T13:06:20,672   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2025-06-01T13:06:20,673   adding 'deepspeed/ops/csrc/includes/Timer.h'
2025-06-01T13:06:20,674   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2025-06-01T13:06:20,675   adding 'deepspeed/ops/csrc/includes/compat.h'
2025-06-01T13:06:20,677   adding 'deepspeed/ops/csrc/includes/context.h'
2025-06-01T13:06:20,679   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2025-06-01T13:06:20,680   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2025-06-01T13:06:20,682   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2025-06-01T13:06:20,684   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2025-06-01T13:06:20,685   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2025-06-01T13:06:20,687   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2025-06-01T13:06:20,690   adding 'deepspeed/ops/csrc/includes/deepcompile.h'
2025-06-01T13:06:20,692   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2025-06-01T13:06:20,693   adding 'deepspeed/ops/csrc/includes/dropout.h'
2025-06-01T13:06:20,695   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2025-06-01T13:06:20,696   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2025-06-01T13:06:20,698   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2025-06-01T13:06:20,699   adding 'deepspeed/ops/csrc/includes/gelu.h'
2025-06-01T13:06:20,701   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2025-06-01T13:06:20,702   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2025-06-01T13:06:20,705   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2025-06-01T13:06:20,707   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2025-06-01T13:06:20,708   adding 'deepspeed/ops/csrc/includes/quantization.h'
2025-06-01T13:06:20,710   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2025-06-01T13:06:20,712   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2025-06-01T13:06:20,715   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2025-06-01T13:06:20,717   adding 'deepspeed/ops/csrc/includes/simd.h'
2025-06-01T13:06:20,718   adding 'deepspeed/ops/csrc/includes/softmax.h'
2025-06-01T13:06:20,719   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2025-06-01T13:06:20,721   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2025-06-01T13:06:20,723   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2025-06-01T13:06:20,725   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2025-06-01T13:06:20,727   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2025-06-01T13:06:20,729   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2025-06-01T13:06:20,730   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2025-06-01T13:06:20,732   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2025-06-01T13:06:20,733   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2025-06-01T13:06:20,735   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2025-06-01T13:06:20,738   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2025-06-01T13:06:20,741   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2025-06-01T13:06:20,743   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2025-06-01T13:06:20,745   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2025-06-01T13:06:20,747   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2025-06-01T13:06:20,749   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2025-06-01T13:06:20,751   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2025-06-01T13:06:20,753   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2025-06-01T13:06:20,754   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2025-06-01T13:06:20,756   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2025-06-01T13:06:20,758   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2025-06-01T13:06:20,761   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2025-06-01T13:06:20,762   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2025-06-01T13:06:20,764   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2025-06-01T13:06:20,767   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2025-06-01T13:06:20,770   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2025-06-01T13:06:20,774   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2025-06-01T13:06:20,777   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2025-06-01T13:06:20,779   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2025-06-01T13:06:20,784   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2025-06-01T13:06:20,787   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2025-06-01T13:06:20,790   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2025-06-01T13:06:20,793   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2025-06-01T13:06:20,795   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2025-06-01T13:06:20,798   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2025-06-01T13:06:20,801   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2025-06-01T13:06:20,802   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2025-06-01T13:06:20,808   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2025-06-01T13:06:20,810   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2025-06-01T13:06:20,812   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2025-06-01T13:06:20,814   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2025-06-01T13:06:20,818   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2025-06-01T13:06:20,820   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2025-06-01T13:06:20,822   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2025-06-01T13:06:20,824   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2025-06-01T13:06:20,826   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2025-06-01T13:06:20,828   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2025-06-01T13:06:20,830   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2025-06-01T13:06:20,832   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2025-06-01T13:06:20,834   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2025-06-01T13:06:20,836   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2025-06-01T13:06:20,838   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2025-06-01T13:06:20,839   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2025-06-01T13:06:20,841   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2025-06-01T13:06:20,842   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2025-06-01T13:06:20,844   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2025-06-01T13:06:20,846   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2025-06-01T13:06:20,848   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2025-06-01T13:06:20,849   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2025-06-01T13:06:20,851   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2025-06-01T13:06:20,853   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2025-06-01T13:06:20,854   adding 'deepspeed/ops/fp_quantizer/fp8_gemm_triton.py'
2025-06-01T13:06:20,856   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2025-06-01T13:06:20,858   adding 'deepspeed/ops/gds/__init__.py'
2025-06-01T13:06:20,860   adding 'deepspeed/ops/lamb/__init__.py'
2025-06-01T13:06:20,862   adding 'deepspeed/ops/lamb/fused_lamb.py'
2025-06-01T13:06:20,864   adding 'deepspeed/ops/lion/__init__.py'
2025-06-01T13:06:20,865   adding 'deepspeed/ops/lion/cpu_lion.py'
2025-06-01T13:06:20,867   adding 'deepspeed/ops/lion/fused_lion.py'
2025-06-01T13:06:20,868   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2025-06-01T13:06:20,871   adding 'deepspeed/ops/op_builder/__init__.py'
2025-06-01T13:06:20,872   adding 'deepspeed/ops/op_builder/all_ops.py'
2025-06-01T13:06:20,874   adding 'deepspeed/ops/op_builder/async_io.py'
2025-06-01T13:06:20,878   adding 'deepspeed/ops/op_builder/builder.py'
2025-06-01T13:06:20,880   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2025-06-01T13:06:20,881   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2025-06-01T13:06:20,882   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2025-06-01T13:06:20,884   adding 'deepspeed/ops/op_builder/dc.py'
2025-06-01T13:06:20,885   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2025-06-01T13:06:20,887   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2025-06-01T13:06:20,888   adding 'deepspeed/ops/op_builder/fused_adam.py'
2025-06-01T13:06:20,890   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2025-06-01T13:06:20,891   adding 'deepspeed/ops/op_builder/fused_lion.py'
2025-06-01T13:06:20,892   adding 'deepspeed/ops/op_builder/gds.py'
2025-06-01T13:06:20,894   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2025-06-01T13:06:20,895   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2025-06-01T13:06:20,897   adding 'deepspeed/ops/op_builder/quantizer.py'
2025-06-01T13:06:20,898   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2025-06-01T13:06:20,899   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2025-06-01T13:06:20,901   adding 'deepspeed/ops/op_builder/random_ltd.py'
2025-06-01T13:06:20,902   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2025-06-01T13:06:20,903   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2025-06-01T13:06:20,905   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2025-06-01T13:06:20,906   adding 'deepspeed/ops/op_builder/transformer.py'
2025-06-01T13:06:20,907   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2025-06-01T13:06:20,910   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2025-06-01T13:06:20,911   adding 'deepspeed/ops/op_builder/cpu/async_io.py'
2025-06-01T13:06:20,912   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2025-06-01T13:06:20,914   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2025-06-01T13:06:20,915   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2025-06-01T13:06:20,916   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2025-06-01T13:06:20,917   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2025-06-01T13:06:20,919   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2025-06-01T13:06:20,921   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2025-06-01T13:06:20,922   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2025-06-01T13:06:20,923   adding 'deepspeed/ops/op_builder/hpu/fp_quantizer.py'
2025-06-01T13:06:20,925   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2025-06-01T13:06:20,926   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2025-06-01T13:06:20,928   adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py'
2025-06-01T13:06:20,930   adding 'deepspeed/ops/op_builder/mlu/__init__.py'
2025-06-01T13:06:20,931   adding 'deepspeed/ops/op_builder/mlu/builder.py'
2025-06-01T13:06:20,932   adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py'
2025-06-01T13:06:20,934   adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py'
2025-06-01T13:06:20,935   adding 'deepspeed/ops/op_builder/mlu/fused_adam.py'
2025-06-01T13:06:20,936   adding 'deepspeed/ops/op_builder/mlu/no_impl.py'
2025-06-01T13:06:20,938   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2025-06-01T13:06:20,940   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2025-06-01T13:06:20,941   adding 'deepspeed/ops/op_builder/npu/builder.py'
2025-06-01T13:06:20,943   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2025-06-01T13:06:20,944   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2025-06-01T13:06:20,946   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2025-06-01T13:06:20,947   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2025-06-01T13:06:20,949   adding 'deepspeed/ops/op_builder/npu/inference.py'
2025-06-01T13:06:20,950   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2025-06-01T13:06:20,953   adding 'deepspeed/ops/op_builder/sdaa/__init__.py'
2025-06-01T13:06:20,954   adding 'deepspeed/ops/op_builder/sdaa/builder.py'
2025-06-01T13:06:20,956   adding 'deepspeed/ops/op_builder/sdaa/cpu_adam.py'
2025-06-01T13:06:20,957   adding 'deepspeed/ops/op_builder/sdaa/fused_adam.py'
2025-06-01T13:06:20,959   adding 'deepspeed/ops/op_builder/sdaa/no_impl.py'
2025-06-01T13:06:20,961   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2025-06-01T13:06:20,962   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2025-06-01T13:06:20,964   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2025-06-01T13:06:20,965   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2025-06-01T13:06:20,967   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2025-06-01T13:06:20,968   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2025-06-01T13:06:20,969   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2025-06-01T13:06:20,970   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2025-06-01T13:06:20,972   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2025-06-01T13:06:20,973   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2025-06-01T13:06:20,974   adding 'deepspeed/ops/quantizer/__init__.py'
2025-06-01T13:06:20,976   adding 'deepspeed/ops/quantizer/quantizer.py'
2025-06-01T13:06:20,978   adding 'deepspeed/ops/random_ltd/__init__.py'
2025-06-01T13:06:20,979   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2025-06-01T13:06:20,981   adding 'deepspeed/ops/sparse_attention/__init__.py'
2025-06-01T13:06:20,982   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2025-06-01T13:06:20,987   adding 'deepspeed/ops/sparse_attention/matmul.py'
2025-06-01T13:06:20,989   adding 'deepspeed/ops/sparse_attention/softmax.py'
2025-06-01T13:06:20,991   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2025-06-01T13:06:20,993   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2025-06-01T13:06:20,996   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2025-06-01T13:06:20,999   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2025-06-01T13:06:21,000   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2025-06-01T13:06:21,002   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2025-06-01T13:06:21,003   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2025-06-01T13:06:21,005   adding 'deepspeed/ops/transformer/__init__.py'
2025-06-01T13:06:21,007   adding 'deepspeed/ops/transformer/transformer.py'
2025-06-01T13:06:21,009   adding 'deepspeed/ops/transformer/inference/__init__.py'
2025-06-01T13:06:21,011   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2025-06-01T13:06:21,012   adding 'deepspeed/ops/transformer/inference/config.py'
2025-06-01T13:06:21,013   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2025-06-01T13:06:21,015   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2025-06-01T13:06:21,017   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2025-06-01T13:06:21,019   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2025-06-01T13:06:21,020   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2025-06-01T13:06:21,023   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2025-06-01T13:06:21,024   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2025-06-01T13:06:21,027   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2025-06-01T13:06:21,028   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2025-06-01T13:06:21,029   adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py'
2025-06-01T13:06:21,031   adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py'
2025-06-01T13:06:21,032   adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py'
2025-06-01T13:06:21,033   adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py'
2025-06-01T13:06:21,035   adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py'
2025-06-01T13:06:21,036   adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py'
2025-06-01T13:06:21,037   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2025-06-01T13:06:21,039   adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py'
2025-06-01T13:06:21,040   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2025-06-01T13:06:21,042   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2025-06-01T13:06:21,043   adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py'
2025-06-01T13:06:21,044   adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py'
2025-06-01T13:06:21,046   adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py'
2025-06-01T13:06:21,047   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2025-06-01T13:06:21,049   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2025-06-01T13:06:21,050   adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py'
2025-06-01T13:06:21,052   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2025-06-01T13:06:21,053   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2025-06-01T13:06:21,055   adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py'
2025-06-01T13:06:21,056   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2025-06-01T13:06:21,058   adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py'
2025-06-01T13:06:21,059   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2025-06-01T13:06:21,062   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2025-06-01T13:06:21,063   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2025-06-01T13:06:21,065   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2025-06-01T13:06:21,067   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2025-06-01T13:06:21,069   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2025-06-01T13:06:21,070   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2025-06-01T13:06:21,072   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2025-06-01T13:06:21,073   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2025-06-01T13:06:21,075   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2025-06-01T13:06:21,077   adding 'deepspeed/pipe/__init__.py'
2025-06-01T13:06:21,079   adding 'deepspeed/profiling/__init__.py'
2025-06-01T13:06:21,080   adding 'deepspeed/profiling/config.py'
2025-06-01T13:06:21,081   adding 'deepspeed/profiling/constants.py'
2025-06-01T13:06:21,083   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2025-06-01T13:06:21,089   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2025-06-01T13:06:21,092   adding 'deepspeed/runtime/__init__.py'
2025-06-01T13:06:21,093   adding 'deepspeed/runtime/base_optimizer.py'
2025-06-01T13:06:21,097   adding 'deepspeed/runtime/bf16_optimizer.py'
2025-06-01T13:06:21,098   adding 'deepspeed/runtime/compiler.py'
2025-06-01T13:06:21,103   adding 'deepspeed/runtime/config.py'
2025-06-01T13:06:21,105   adding 'deepspeed/runtime/config_utils.py'
2025-06-01T13:06:21,107   adding 'deepspeed/runtime/constants.py'
2025-06-01T13:06:21,109   adding 'deepspeed/runtime/dataloader.py'
2025-06-01T13:06:21,110   adding 'deepspeed/runtime/eigenvalue.py'
2025-06-01T13:06:21,131   adding 'deepspeed/runtime/engine.py'
2025-06-01T13:06:21,135   adding 'deepspeed/runtime/hybrid_engine.py'
2025-06-01T13:06:21,139   adding 'deepspeed/runtime/lr_schedules.py'
2025-06-01T13:06:21,141   adding 'deepspeed/runtime/progressive_layer_drop.py'
2025-06-01T13:06:21,142   adding 'deepspeed/runtime/quantize.py'
2025-06-01T13:06:21,144   adding 'deepspeed/runtime/sparse_tensor.py'
2025-06-01T13:06:21,146   adding 'deepspeed/runtime/state_dict_factory.py'
2025-06-01T13:06:21,152   adding 'deepspeed/runtime/utils.py'
2025-06-01T13:06:21,153   adding 'deepspeed/runtime/weight_quantizer.py'
2025-06-01T13:06:21,155   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2025-06-01T13:06:21,160   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2025-06-01T13:06:21,162   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2025-06-01T13:06:21,164   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2025-06-01T13:06:21,165   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2025-06-01T13:06:21,167   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2025-06-01T13:06:21,168   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2025-06-01T13:06:21,170   adding 'deepspeed/runtime/comm/__init__.py'
2025-06-01T13:06:21,172   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2025-06-01T13:06:21,173   adding 'deepspeed/runtime/comm/compressed.py'
2025-06-01T13:06:21,175   adding 'deepspeed/runtime/comm/hccl.py'
2025-06-01T13:06:21,176   adding 'deepspeed/runtime/comm/mpi.py'
2025-06-01T13:06:21,178   adding 'deepspeed/runtime/comm/nccl.py'
2025-06-01T13:06:21,180   adding 'deepspeed/runtime/compression/__init__.py'
2025-06-01T13:06:21,181   adding 'deepspeed/runtime/compression/cupy.py'
2025-06-01T13:06:21,182   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2025-06-01T13:06:21,184   adding 'deepspeed/runtime/data_pipeline/config.py'
2025-06-01T13:06:21,185   adding 'deepspeed/runtime/data_pipeline/constants.py'
2025-06-01T13:06:21,187   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2025-06-01T13:06:21,189   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2025-06-01T13:06:21,190   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2025-06-01T13:06:21,191   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2025-06-01T13:06:21,193   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2025-06-01T13:06:21,194   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2025-06-01T13:06:21,196   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2025-06-01T13:06:21,202   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2025-06-01T13:06:21,205   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2025-06-01T13:06:21,208   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2025-06-01T13:06:21,209   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2025-06-01T13:06:21,212   adding 'deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py'
2025-06-01T13:06:21,214   adding 'deepspeed/runtime/domino/__init__.py'
2025-06-01T13:06:21,215   adding 'deepspeed/runtime/domino/async_linear.py'
2025-06-01T13:06:21,218   adding 'deepspeed/runtime/domino/transformer.py'
2025-06-01T13:06:21,220   adding 'deepspeed/runtime/fp16/__init__.py'
2025-06-01T13:06:21,223   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2025-06-01T13:06:21,225   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2025-06-01T13:06:21,228   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2025-06-01T13:06:21,229   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2025-06-01T13:06:21,232   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2025-06-01T13:06:21,235   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2025-06-01T13:06:21,237   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2025-06-01T13:06:21,239   adding 'deepspeed/runtime/pipe/__init__.py'
2025-06-01T13:06:21,247   adding 'deepspeed/runtime/pipe/engine.py'
2025-06-01T13:06:21,251   adding 'deepspeed/runtime/pipe/module.py'
2025-06-01T13:06:21,253   adding 'deepspeed/runtime/pipe/p2p.py'
2025-06-01T13:06:21,255   adding 'deepspeed/runtime/pipe/schedule.py'
2025-06-01T13:06:21,258   adding 'deepspeed/runtime/pipe/topology.py'
2025-06-01T13:06:21,260   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2025-06-01T13:06:21,261   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2025-06-01T13:06:21,262   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2025-06-01T13:06:21,264   adding 'deepspeed/runtime/swap_tensor/constants.py'
2025-06-01T13:06:21,266   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2025-06-01T13:06:21,268   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2025-06-01T13:06:21,271   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2025-06-01T13:06:21,273   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2025-06-01T13:06:21,275   adding 'deepspeed/runtime/swap_tensor/utils.py'
2025-06-01T13:06:21,277   adding 'deepspeed/runtime/tensor_parallel/__init__.py'
2025-06-01T13:06:21,278   adding 'deepspeed/runtime/tensor_parallel/config.py'
2025-06-01T13:06:21,280   adding 'deepspeed/runtime/tensor_parallel/tp_manager.py'
2025-06-01T13:06:21,282   adding 'deepspeed/runtime/zero/__init__.py'
2025-06-01T13:06:21,284   adding 'deepspeed/runtime/zero/config.py'
2025-06-01T13:06:21,286   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2025-06-01T13:06:21,288   adding 'deepspeed/runtime/zero/linear.py'
2025-06-01T13:06:21,291   adding 'deepspeed/runtime/zero/mics.py'
2025-06-01T13:06:21,293   adding 'deepspeed/runtime/zero/mics_utils.py'
2025-06-01T13:06:21,294   adding 'deepspeed/runtime/zero/offload_config.py'
2025-06-01T13:06:21,296   adding 'deepspeed/runtime/zero/offload_states.py'
2025-06-01T13:06:21,299   adding 'deepspeed/runtime/zero/parameter_offload.py'
2025-06-01T13:06:21,312   adding 'deepspeed/runtime/zero/partition_parameters.py'
2025-06-01T13:06:21,316   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2025-06-01T13:06:21,317   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2025-06-01T13:06:21,333   adding 'deepspeed/runtime/zero/stage3.py'
2025-06-01T13:06:21,347   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2025-06-01T13:06:21,349   adding 'deepspeed/runtime/zero/test.py'
2025-06-01T13:06:21,351   adding 'deepspeed/runtime/zero/tiling.py'
2025-06-01T13:06:21,353   adding 'deepspeed/runtime/zero/utils.py'
2025-06-01T13:06:21,354   adding 'deepspeed/sequence/__init__.py'
2025-06-01T13:06:21,356   adding 'deepspeed/sequence/cross_entropy.py'
2025-06-01T13:06:21,360   adding 'deepspeed/sequence/fpdt_layer.py'
2025-06-01T13:06:21,363   adding 'deepspeed/sequence/layer.py'
2025-06-01T13:06:21,365   adding 'deepspeed/utils/__init__.py'
2025-06-01T13:06:21,366   adding 'deepspeed/utils/bwc.py'
2025-06-01T13:06:21,368   adding 'deepspeed/utils/comms_logging.py'
2025-06-01T13:06:21,369   adding 'deepspeed/utils/config.py'
2025-06-01T13:06:21,371   adding 'deepspeed/utils/debug.py'
2025-06-01T13:06:21,372   adding 'deepspeed/utils/exceptions.py'
2025-06-01T13:06:21,376   adding 'deepspeed/utils/groups.py'
2025-06-01T13:06:21,378   adding 'deepspeed/utils/init_on_device.py'
2025-06-01T13:06:21,380   adding 'deepspeed/utils/logging.py'
2025-06-01T13:06:21,381   adding 'deepspeed/utils/mixed_precision_linkage.py'
2025-06-01T13:06:21,383   adding 'deepspeed/utils/numa.py'
2025-06-01T13:06:21,384   adding 'deepspeed/utils/nvtx.py'
2025-06-01T13:06:21,387   adding 'deepspeed/utils/tensor_fragment.py'
2025-06-01T13:06:21,389   adding 'deepspeed/utils/timer.py'
2025-06-01T13:06:21,390   adding 'deepspeed/utils/torch.py'
2025-06-01T13:06:21,392   adding 'deepspeed/utils/types.py'
2025-06-01T13:06:21,393   adding 'deepspeed/utils/z3_leaf_module.py'
2025-06-01T13:06:21,397   adding 'deepspeed/utils/zero_to_fp32.py'
2025-06-01T13:06:21,400   adding 'deepspeed-0.16.6.data/scripts/deepspeed'
2025-06-01T13:06:21,401   adding 'deepspeed-0.16.6.data/scripts/deepspeed.pt'
2025-06-01T13:06:21,403   adding 'deepspeed-0.16.6.data/scripts/ds'
2025-06-01T13:06:21,404   adding 'deepspeed-0.16.6.data/scripts/ds_bench'
2025-06-01T13:06:21,405   adding 'deepspeed-0.16.6.data/scripts/ds_elastic'
2025-06-01T13:06:21,406   adding 'deepspeed-0.16.6.data/scripts/ds_io'
2025-06-01T13:06:21,407   adding 'deepspeed-0.16.6.data/scripts/ds_nvme_tune'
2025-06-01T13:06:21,409   adding 'deepspeed-0.16.6.data/scripts/ds_report'
2025-06-01T13:06:21,410   adding 'deepspeed-0.16.6.data/scripts/ds_ssh'
2025-06-01T13:06:21,411   adding 'deepspeed-0.16.6.data/scripts/dsr'
2025-06-01T13:06:21,415   adding 'deepspeed-0.16.6.dist-info/licenses/LICENSE'
2025-06-01T13:06:21,421   adding 'deepspeed-0.16.6.dist-info/METADATA'
2025-06-01T13:06:21,422   adding 'deepspeed-0.16.6.dist-info/WHEEL'
2025-06-01T13:06:21,423   adding 'deepspeed-0.16.6.dist-info/entry_points.txt'
2025-06-01T13:06:21,424   adding 'deepspeed-0.16.6.dist-info/top_level.txt'
2025-06-01T13:06:21,441   adding 'deepspeed-0.16.6.dist-info/RECORD'
2025-06-01T13:06:21,474   removing build/bdist.linux-armv7l/wheel
2025-06-01T13:06:21,743   deepspeed build time = 13.54329776763916 secs
2025-06-01T13:06:21,871   Building wheel for deepspeed (setup.py): finished with status 'done'
2025-06-01T13:06:21,893   Created wheel for deepspeed: filename=deepspeed-0.16.6-py3-none-any.whl size=1643410 sha256=af190f747f3e6a5537f0bbfb35b97d076f3d15e240e1800404dd193133843e1d
2025-06-01T13:06:21,894   Stored in directory: /tmp/pip-ephem-wheel-cache-qpvpedgd/wheels/73/95/9c/8445820a7d7ef64c6083bef3a6c84d8baf4de6a864d6cd9737
2025-06-01T13:06:21,940 Successfully built deepspeed
2025-06-01T13:06:22,014 Removed build tracker: '/tmp/pip-build-tracker-m0l3c9sw'