2025-06-11T10:03:22,559 Created temporary directory: /tmp/pip-build-tracker-skad60r7
2025-06-11T10:03:22,560 Initialized build tracking at /tmp/pip-build-tracker-skad60r7
2025-06-11T10:03:22,561 Created build tracker: /tmp/pip-build-tracker-skad60r7
2025-06-11T10:03:22,562 Entered build tracker: /tmp/pip-build-tracker-skad60r7
2025-06-11T10:03:22,563 Created temporary directory: /tmp/pip-wheel-6buou3xp
2025-06-11T10:03:22,567 Created temporary directory: /tmp/pip-ephem-wheel-cache-19o84i2k
2025-06-11T10:03:22,620 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2025-06-11T10:03:22,622 2 location(s) to search for versions of deepspeed:
2025-06-11T10:03:22,622 * https://pypi.org/simple/deepspeed/
2025-06-11T10:03:22,622 * https://www.piwheels.org/simple/deepspeed/
2025-06-11T10:03:22,623 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2025-06-11T10:03:22,624 Getting page https://pypi.org/simple/deepspeed/
2025-06-11T10:03:22,626 Found index url https://pypi.org/simple/
2025-06-11T10:03:22,779 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2025-06-11T10:03:22,793   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-11T10:03:22,793   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2025-06-11T10:03:22,794   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-11T10:03:22,795   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2025-06-11T10:03:22,795   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-11T10:03:22,796   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2025-06-11T10:03:22,797   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-11T10:03:22,798   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2025-06-11T10:03:22,798   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-11T10:03:22,799   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2025-06-11T10:03:22,800   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2025-06-11T10:03:22,800   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2025-06-11T10:03:22,801   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2025-06-11T10:03:22,802   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2025-06-11T10:03:22,803   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2025-06-11T10:03:22,804   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2025-06-11T10:03:22,804   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2025-06-11T10:03:22,805   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2025-06-11T10:03:22,806   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2025-06-11T10:03:22,806   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2025-06-11T10:03:22,807   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2025-06-11T10:03:22,808   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2025-06-11T10:03:22,808   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2025-06-11T10:03:22,809   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2025-06-11T10:03:22,810   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2025-06-11T10:03:22,810   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2025-06-11T10:03:22,811   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2025-06-11T10:03:22,812   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2025-06-11T10:03:22,813   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2025-06-11T10:03:22,814   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2025-06-11T10:03:22,815   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2025-06-11T10:03:22,816   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2025-06-11T10:03:22,816   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2025-06-11T10:03:22,817   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2025-06-11T10:03:22,818   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2025-06-11T10:03:22,818   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2025-06-11T10:03:22,819   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2025-06-11T10:03:22,819   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2025-06-11T10:03:22,820   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2025-06-11T10:03:22,821   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2025-06-11T10:03:22,821   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2025-06-11T10:03:22,822   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2025-06-11T10:03:22,823   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2025-06-11T10:03:22,824   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2025-06-11T10:03:22,824   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2025-06-11T10:03:22,825   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2025-06-11T10:03:22,826   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2025-06-11T10:03:22,826   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2025-06-11T10:03:22,827   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2025-06-11T10:03:22,828   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2025-06-11T10:03:22,829   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2025-06-11T10:03:22,829   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2025-06-11T10:03:22,830   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2025-06-11T10:03:22,831   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2025-06-11T10:03:22,831   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2025-06-11T10:03:22,832   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2025-06-11T10:03:22,833   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2025-06-11T10:03:22,833   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2025-06-11T10:03:22,834   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2025-06-11T10:03:22,835   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2025-06-11T10:03:22,835   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2025-06-11T10:03:22,836   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2025-06-11T10:03:22,837   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2025-06-11T10:03:22,837   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2025-06-11T10:03:22,838   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2025-06-11T10:03:22,839   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2025-06-11T10:03:22,840   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2025-06-11T10:03:22,841   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2025-06-11T10:03:22,842   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2025-06-11T10:03:22,842   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2025-06-11T10:03:22,843   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2025-06-11T10:03:22,844   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2025-06-11T10:03:22,844   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2025-06-11T10:03:22,845   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2025-06-11T10:03:22,845   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2025-06-11T10:03:22,846   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2025-06-11T10:03:22,847   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2025-06-11T10:03:22,848   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2025-06-11T10:03:22,848   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2025-06-11T10:03:22,849   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2025-06-11T10:03:22,850   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2025-06-11T10:03:22,850   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2025-06-11T10:03:22,851   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2025-06-11T10:03:22,852   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2025-06-11T10:03:22,853   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2025-06-11T10:03:22,853   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2025-06-11T10:03:22,854   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2025-06-11T10:03:22,855   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2025-06-11T10:03:22,855   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2025-06-11T10:03:22,856   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2025-06-11T10:03:22,857   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2025-06-11T10:03:22,857   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2025-06-11T10:03:22,858   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2025-06-11T10:03:22,858   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2025-06-11T10:03:22,859   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2025-06-11T10:03:22,860   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2025-06-11T10:03:22,861   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-11T10:03:22,861   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2025-06-11T10:03:22,862   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-11T10:03:22,863   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2025-06-11T10:03:22,863   Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1
2025-06-11T10:03:22,864   Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2
2025-06-11T10:03:22,865   Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3
2025-06-11T10:03:22,866   Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4
2025-06-11T10:03:22,867   Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0
2025-06-11T10:03:22,867   Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1
2025-06-11T10:03:22,868   Found link https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.2
2025-06-11T10:03:22,868   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/52/23/cfe2166f06f1817b73b8695addd2fded55f4189322bcf181cfb7feaba550/deepspeed-0.16.3-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-11T10:03:22,869   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/ce/92/853de2a32b3f9c0945e0c9e145eddac98e570c1faebcd58aa85e6dcd89ba/deepspeed-0.16.3-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-11T10:03:22,870   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/55/8f/57ee424e114478a667c604b2f3f05bbc1addc0afc089b9ab6a64b233063d/deepspeed-0.16.3-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-11T10:03:22,870   Found link https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.3
2025-06-11T10:03:22,871   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/3d/65/1a6394f5d6dee851e9ea59e385f6d6428e3bfe36f83c06e0336e14dcfd11/deepspeed-0.16.4-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-11T10:03:22,871   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a3/aa/bb67b63cc25c5e29e4ca3f8b155e0faf74d5a33acf2ec67e249206a36b0f/deepspeed-0.16.4-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-11T10:03:22,872   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d4/59/fd251661b78b049eed7ee46f0d8d51c69ae7fbb710716a1ebcc796a6b0fd/deepspeed-0.16.4-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-11T10:03:22,873   Found link https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.4
2025-06-11T10:03:22,874   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/15/b0/be6cc74fd1e23da20d6c34db923858a8ae5017d39a13dedc188a935c646a/deepspeed-0.16.5-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-11T10:03:22,874   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/0b/78/9a87d137f83f53dd57f425ac174723c746c53029bf6cdce22eb9e805e3f0/deepspeed-0.16.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-11T10:03:22,875   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/80/f8/a9b1fca237fe8ea25f866956778280d0b735350f29fb6f4e0b548aa02a5f/deepspeed-0.16.5-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-11T10:03:22,875   Found link https://files.pythonhosted.org/packages/0d/88/96569b2acb3219c9c72068f9b952c59beffe366e7d1edd9e922e5c68f08b/deepspeed-0.16.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.5
2025-06-11T10:03:22,876   Found link https://files.pythonhosted.org/packages/cb/a3/1d758fcbcdb3f5ecf4e71907e293f17bae8a9f448b112e65c6195e90c2d3/deepspeed-0.16.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.6
2025-06-11T10:03:22,877   Found link https://files.pythonhosted.org/packages/06/b3/a3903de5c5b707170c5c27e1a40f4ef613f14d241bd84d8b151a2a8786f6/deepspeed-0.16.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.7
2025-06-11T10:03:22,878   Found link https://files.pythonhosted.org/packages/e1/27/f857569546dc97f64169df1cc35d1ec5161766c4a0ec32f2af5d39614a51/deepspeed-0.16.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.8
2025-06-11T10:03:22,878   Found link https://files.pythonhosted.org/packages/4f/5c/7542904cddfaa50a9a7ae6770349d468773359f5af1718865452cea8729d/deepspeed-0.16.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.9
2025-06-11T10:03:22,879   Found link https://files.pythonhosted.org/packages/1e/35/eef570f4da4a39d0e7f2e72757295fdba3718a8eca60d8d6dcfeb9e6f26d/deepspeed-0.17.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.0
2025-06-11T10:03:22,880   Found link https://files.pythonhosted.org/packages/38/10/a7f63e086c1e1c12e290c98363c748ef5ddd6313fde739d2aeccd5ed0cd4/deepspeed-0.17.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.1
2025-06-11T10:03:22,880   Found link https://files.pythonhosted.org/packages/8c/45/1ddcf8f8500d90fad9f3396bfb1295462d46a747ddcbfafcd7714d46827e/deepspeed-0.17.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.2
2025-06-11T10:03:22,881   Found link https://files.pythonhosted.org/packages/9e/6b/89faa30a38405cd2d7a81790b262673ca4c8e8ec97c2f8c433da04d7a002/deepspeed-0.17.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.3
2025-06-11T10:03:22,882   Found link https://files.pythonhosted.org/packages/84/b3/02d000bfd0d6f0ba3f5dac487e4151b3e9b4b3ee71336882102dc9ad79ad/deepspeed-0.17.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.4
2025-06-11T10:03:22,882   Found link https://files.pythonhosted.org/packages/46/e7/bc1e5868d85cb8e21c43915023e462b9a147f739f26d8584e3c46771ec67/deepspeed-0.17.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.5
2025-06-11T10:03:22,883 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2025-06-11T10:03:22,884 Getting page https://www.piwheels.org/simple/deepspeed/
2025-06-11T10:03:22,885 Found index url https://www.piwheels.org/simple/
2025-06-11T10:03:23,043 WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-11T10:03:23,704 WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-11T10:03:24,863 WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-11T10:03:27,023 WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-11T10:03:31,189 WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-11T10:03:31,346 Could not fetch URL https://www.piwheels.org/simple/deepspeed/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='www.piwheels.org', port=443): Max retries exceeded with url: /simple/deepspeed/ (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))) - skipping
2025-06-11T10:03:31,348 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2025-06-11T10:03:31,349 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2025-06-11T10:03:31,378 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2025-06-11T10:03:31,381 Collecting deepspeed==0.17.1
2025-06-11T10:03:31,383   Created temporary directory: /tmp/pip-unpack-71tb7c4z
2025-06-11T10:03:31,610   Downloading deepspeed-0.17.1.tar.gz (1.5 MB)
2025-06-11T10:03:34,480   Added deepspeed==0.17.1 from https://files.pythonhosted.org/packages/38/10/a7f63e086c1e1c12e290c98363c748ef5ddd6313fde739d2aeccd5ed0cd4/deepspeed-0.17.1.tar.gz to build tracker '/tmp/pip-build-tracker-skad60r7'
2025-06-11T10:03:34,482   Running setup.py (path:/tmp/pip-wheel-6buou3xp/deepspeed_a73d2571591944c59f925d6170c4f27b/setup.py) egg_info for package deepspeed
2025-06-11T10:03:34,483   Created temporary directory: /tmp/pip-pip-egg-info-1rs91doj
2025-06-11T10:03:34,484   Preparing metadata (setup.py): started
2025-06-11T10:03:34,485   Running command python setup.py egg_info
2025-06-11T10:03:35,534   fatal: not a git repository (or any of the parent directories): .git
2025-06-11T10:03:36,024   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-06-11T10:03:36,025    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-06-11T10:03:36,025   DS_BUILD_OPS=0
2025-06-11T10:03:36,026   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-06-11T10:03:36,026   version=0.17.1, git_hash=unknown, git_branch=unknown
2025-06-11T10:03:36,027   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-06-11T10:03:36,028   ext_modules=[]
2025-06-11T10:03:36,029   running egg_info
2025-06-11T10:03:36,054   creating /tmp/pip-pip-egg-info-1rs91doj/deepspeed.egg-info
2025-06-11T10:03:36,055   writing /tmp/pip-pip-egg-info-1rs91doj/deepspeed.egg-info/PKG-INFO
2025-06-11T10:03:36,092   writing dependency_links to /tmp/pip-pip-egg-info-1rs91doj/deepspeed.egg-info/dependency_links.txt
2025-06-11T10:03:36,093   writing entry points to /tmp/pip-pip-egg-info-1rs91doj/deepspeed.egg-info/entry_points.txt
2025-06-11T10:03:36,112   writing requirements to /tmp/pip-pip-egg-info-1rs91doj/deepspeed.egg-info/requires.txt
2025-06-11T10:03:36,114   writing top-level names to /tmp/pip-pip-egg-info-1rs91doj/deepspeed.egg-info/top_level.txt
2025-06-11T10:03:36,115   writing manifest file '/tmp/pip-pip-egg-info-1rs91doj/deepspeed.egg-info/SOURCES.txt'
2025-06-11T10:03:36,385   reading manifest file '/tmp/pip-pip-egg-info-1rs91doj/deepspeed.egg-info/SOURCES.txt'
2025-06-11T10:03:36,387   reading manifest template 'MANIFEST.in'
2025-06-11T10:03:36,389   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-06-11T10:03:36,390   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-06-11T10:03:38,248   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-06-11T10:03:39,408   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-06-11T10:03:40,159   warning: no files found matching '*.tr' under directory 'csrc'
2025-06-11T10:03:40,292   warning: no files found matching '*.cc' under directory 'csrc'
2025-06-11T10:03:40,346   warning: no files found matching '*.py' under directory 'benchmarks'
2025-06-11T10:03:40,353   adding license file 'LICENSE'
2025-06-11T10:03:40,395   writing manifest file '/tmp/pip-pip-egg-info-1rs91doj/deepspeed.egg-info/SOURCES.txt'
2025-06-11T10:03:40,397   deepspeed build time = 4.859684705734253 secs
2025-06-11T10:03:40,523   Preparing metadata (setup.py): finished with status 'done'
2025-06-11T10:03:40,529   Source in /tmp/pip-wheel-6buou3xp/deepspeed_a73d2571591944c59f925d6170c4f27b has version 0.17.1, which satisfies requirement deepspeed==0.17.1 from https://files.pythonhosted.org/packages/38/10/a7f63e086c1e1c12e290c98363c748ef5ddd6313fde739d2aeccd5ed0cd4/deepspeed-0.17.1.tar.gz
2025-06-11T10:03:40,530   Removed deepspeed==0.17.1 from https://files.pythonhosted.org/packages/38/10/a7f63e086c1e1c12e290c98363c748ef5ddd6313fde739d2aeccd5ed0cd4/deepspeed-0.17.1.tar.gz from build tracker '/tmp/pip-build-tracker-skad60r7'
2025-06-11T10:03:40,608 Created temporary directory: /tmp/pip-unpack-4t180mmh
2025-06-11T10:03:40,609 Created temporary directory: /tmp/pip-unpack-sb1vlu1z
2025-06-11T10:03:40,610 Building wheels for collected packages: deepspeed
2025-06-11T10:03:40,614   Created temporary directory: /tmp/pip-wheel-99jmc_rp
2025-06-11T10:03:40,615   DEPRECATION: Building 'deepspeed' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'deepspeed'. Discussion can be found at https://github.com/pypa/pip/issues/6334
2025-06-11T10:03:40,616   Building wheel for deepspeed (setup.py): started
2025-06-11T10:03:40,617   Destination directory: /tmp/pip-wheel-99jmc_rp
2025-06-11T10:03:40,618   Running command python setup.py bdist_wheel
2025-06-11T10:03:41,121   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-06-11T10:03:41,125    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-06-11T10:03:41,258   DS_BUILD_OPS=0
2025-06-11T10:03:41,379   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-06-11T10:03:41,400   fatal: not a git repository (or any of the parent directories): .git
2025-06-11T10:03:41,401   version=0.17.1, git_hash=unknown, git_branch=unknown
2025-06-11T10:03:41,402   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-06-11T10:03:41,403   ext_modules=[]
2025-06-11T10:03:41,812   running bdist_wheel
2025-06-11T10:03:41,949   running build
2025-06-11T10:03:41,950   running build_py
2025-06-11T10:03:41,981   creating build/lib/deepspeed
2025-06-11T10:03:41,983   copying deepspeed/constants.py -> build/lib/deepspeed
2025-06-11T10:03:41,985   copying deepspeed/__init__.py -> build/lib/deepspeed
2025-06-11T10:03:41,988   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2025-06-11T10:03:41,990   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2025-06-11T10:03:41,992   copying deepspeed/env_report.py -> build/lib/deepspeed
2025-06-11T10:03:41,995   creating build/lib/deepspeed/sequence
2025-06-11T10:03:41,996   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2025-06-11T10:03:41,998   copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence
2025-06-11T10:03:42,002   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2025-06-11T10:03:42,004   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2025-06-11T10:03:42,007   creating build/lib/deepspeed/utils
2025-06-11T10:03:42,008   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,011   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,014   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,015   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,017   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,019   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,021   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,023   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,025   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,028   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,030   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,032   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,035   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,038   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,040   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,042   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,044   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,047   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2025-06-11T10:03:42,049   creating build/lib/deepspeed/module_inject
2025-06-11T10:03:42,050   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2025-06-11T10:03:42,053   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2025-06-11T10:03:42,055   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2025-06-11T10:03:42,058   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2025-06-11T10:03:42,060   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2025-06-11T10:03:42,062   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2025-06-11T10:03:42,064   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2025-06-11T10:03:42,067   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2025-06-11T10:03:42,070   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2025-06-11T10:03:42,072   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2025-06-11T10:03:42,074   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2025-06-11T10:03:42,077   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2025-06-11T10:03:42,079   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2025-06-11T10:03:42,082   creating build/lib/deepspeed/runtime
2025-06-11T10:03:42,083   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,086   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,088   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,090   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,093   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,096   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,099   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,102   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,104   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,107   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,113   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,116   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,118   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,121   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,123   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,125   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,127   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,129   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,131   copying deepspeed/runtime/precision_config.py -> build/lib/deepspeed/runtime
2025-06-11T10:03:42,134   creating build/lib/deepspeed/linear
2025-06-11T10:03:42,135   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2025-06-11T10:03:42,137   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2025-06-11T10:03:42,139   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2025-06-11T10:03:42,141   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2025-06-11T10:03:42,143   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2025-06-11T10:03:42,146   creating build/lib/deepspeed/moe
2025-06-11T10:03:42,147   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2025-06-11T10:03:42,150   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2025-06-11T10:03:42,152   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2025-06-11T10:03:42,154   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2025-06-11T10:03:42,156   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2025-06-11T10:03:42,158   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2025-06-11T10:03:42,161   creating build/lib/deepspeed/profiling
2025-06-11T10:03:42,162   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2025-06-11T10:03:42,164   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2025-06-11T10:03:42,166   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2025-06-11T10:03:42,169   creating build/lib/deepspeed/pipe
2025-06-11T10:03:42,170   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2025-06-11T10:03:42,172   creating build/lib/deepspeed/model_implementations
2025-06-11T10:03:42,173   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2025-06-11T10:03:42,175   creating build/lib/deepspeed/inference
2025-06-11T10:03:42,176   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2025-06-11T10:03:42,179   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2025-06-11T10:03:42,182   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2025-06-11T10:03:42,185   creating build/lib/deepspeed/nvme
2025-06-11T10:03:42,186   copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme
2025-06-11T10:03:42,188   copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme
2025-06-11T10:03:42,190   copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme
2025-06-11T10:03:42,192   copying deepspeed/nvme/io_engine.py -> build/lib/deepspeed/nvme
2025-06-11T10:03:42,194   copying deepspeed/nvme/torch_io.py -> build/lib/deepspeed/nvme
2025-06-11T10:03:42,196   copying deepspeed/nvme/ds_aio_constants.py -> build/lib/deepspeed/nvme
2025-06-11T10:03:42,198   copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme
2025-06-11T10:03:42,200   copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme
2025-06-11T10:03:42,203   copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme
2025-06-11T10:03:42,205   copying deepspeed/nvme/torch_fastio_engine.py -> build/lib/deepspeed/nvme
2025-06-11T10:03:42,207   copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme
2025-06-11T10:03:42,209   copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme
2025-06-11T10:03:42,211   copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme
2025-06-11T10:03:42,213   copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme
2025-06-11T10:03:42,215   copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme
2025-06-11T10:03:42,217   copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme
2025-06-11T10:03:42,220   creating build/lib/deepspeed/io
2025-06-11T10:03:42,221   copying deepspeed/io/base_file_writer.py -> build/lib/deepspeed/io
2025-06-11T10:03:42,223   copying deepspeed/io/py_file_writer.py -> build/lib/deepspeed/io
2025-06-11T10:03:42,225   copying deepspeed/io/single_io_buffer.py -> build/lib/deepspeed/io
2025-06-11T10:03:42,226   copying deepspeed/io/base_io_buffer.py -> build/lib/deepspeed/io
2025-06-11T10:03:42,228   copying deepspeed/io/double_io_buffer.py -> build/lib/deepspeed/io
2025-06-11T10:03:42,231   copying deepspeed/io/utils.py -> build/lib/deepspeed/io
2025-06-11T10:03:42,232   copying deepspeed/io/mock_file_writer.py -> build/lib/deepspeed/io
2025-06-11T10:03:42,234   copying deepspeed/io/constants.py -> build/lib/deepspeed/io
2025-06-11T10:03:42,236   copying deepspeed/io/fast_file_writer.py -> build/lib/deepspeed/io
2025-06-11T10:03:42,239   copying deepspeed/io/__init__.py -> build/lib/deepspeed/io
2025-06-11T10:03:42,241   creating build/lib/deepspeed/monitor
2025-06-11T10:03:42,242   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2025-06-11T10:03:42,244   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2025-06-11T10:03:42,247   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2025-06-11T10:03:42,249   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2025-06-11T10:03:42,251   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2025-06-11T10:03:42,253   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2025-06-11T10:03:42,255   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2025-06-11T10:03:42,256   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2025-06-11T10:03:42,259   creating build/lib/deepspeed/checkpoint
2025-06-11T10:03:42,260   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2025-06-11T10:03:42,262   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-11T10:03:42,265   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2025-06-11T10:03:42,267   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2025-06-11T10:03:42,269   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-11T10:03:42,272   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-11T10:03:42,274   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2025-06-11T10:03:42,277   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2025-06-11T10:03:42,279   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2025-06-11T10:03:42,282   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2025-06-11T10:03:42,284   creating build/lib/deepspeed/accelerator
2025-06-11T10:03:42,285   copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-11T10:03:42,288   copying deepspeed/accelerator/sdaa_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-11T10:03:42,291   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-11T10:03:42,293   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-11T10:03:42,296   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-11T10:03:42,299   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-11T10:03:42,302   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-11T10:03:42,304   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-11T10:03:42,307   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2025-06-11T10:03:42,309   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-11T10:03:42,311   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-11T10:03:42,314   creating build/lib/deepspeed/autotuning
2025-06-11T10:03:42,315   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2025-06-11T10:03:42,319   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2025-06-11T10:03:42,321   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2025-06-11T10:03:42,324   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2025-06-11T10:03:42,326   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2025-06-11T10:03:42,328   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2025-06-11T10:03:42,331   creating build/lib/deepspeed/comm
2025-06-11T10:03:42,332   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2025-06-11T10:03:42,335   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2025-06-11T10:03:42,337   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2025-06-11T10:03:42,339   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2025-06-11T10:03:42,340   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2025-06-11T10:03:42,343   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2025-06-11T10:03:42,345   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2025-06-11T10:03:42,347   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2025-06-11T10:03:42,349   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2025-06-11T10:03:42,353   creating build/lib/deepspeed/compile
2025-06-11T10:03:42,354   copying deepspeed/compile/inductor.py -> build/lib/deepspeed/compile
2025-06-11T10:03:42,356   copying deepspeed/compile/fx.py -> build/lib/deepspeed/compile
2025-06-11T10:03:42,359   copying deepspeed/compile/config.py -> build/lib/deepspeed/compile
2025-06-11T10:03:42,361   copying deepspeed/compile/list_schedule.py -> build/lib/deepspeed/compile
2025-06-11T10:03:42,363   copying deepspeed/compile/patch_fake_tensor.py -> build/lib/deepspeed/compile
2025-06-11T10:03:42,365   copying deepspeed/compile/backend.py -> build/lib/deepspeed/compile
2025-06-11T10:03:42,368   copying deepspeed/compile/graph_param.py -> build/lib/deepspeed/compile
2025-06-11T10:03:42,370   copying deepspeed/compile/__init__.py -> build/lib/deepspeed/compile
2025-06-11T10:03:42,372   copying deepspeed/compile/init_z1.py -> build/lib/deepspeed/compile
2025-06-11T10:03:42,374   copying deepspeed/compile/partitioner.py -> build/lib/deepspeed/compile
2025-06-11T10:03:42,376   copying deepspeed/compile/init_z3.py -> build/lib/deepspeed/compile
2025-06-11T10:03:42,378   copying deepspeed/compile/patch_compiled_func.py -> build/lib/deepspeed/compile
2025-06-11T10:03:42,381   copying deepspeed/compile/util.py -> build/lib/deepspeed/compile
2025-06-11T10:03:42,384   creating build/lib/deepspeed/launcher
2025-06-11T10:03:42,385   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2025-06-11T10:03:42,388   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2025-06-11T10:03:42,391   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2025-06-11T10:03:42,393   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2025-06-11T10:03:42,395   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2025-06-11T10:03:42,397   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2025-06-11T10:03:42,401   creating build/lib/deepspeed/elasticity
2025-06-11T10:03:42,402   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2025-06-11T10:03:42,404   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2025-06-11T10:03:42,407   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2025-06-11T10:03:42,408   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2025-06-11T10:03:42,410   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2025-06-11T10:03:42,412   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2025-06-11T10:03:42,415   creating build/lib/deepspeed/nebula
2025-06-11T10:03:42,416   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2025-06-11T10:03:42,418   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2025-06-11T10:03:42,420   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2025-06-11T10:03:42,422   creating build/lib/deepspeed/ops
2025-06-11T10:03:42,423   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2025-06-11T10:03:42,426   creating build/lib/deepspeed/compression
2025-06-11T10:03:42,427   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2025-06-11T10:03:42,430   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2025-06-11T10:03:42,432   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2025-06-11T10:03:42,435   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2025-06-11T10:03:42,438   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2025-06-11T10:03:42,440   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2025-06-11T10:03:42,442   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2025-06-11T10:03:42,445   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2025-06-11T10:03:42,447   creating build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,448   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,451   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,453   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,456   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,459   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,461   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,464   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,466   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,468   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,470   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,473   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,475   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,478   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,480   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,482   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,484   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,486   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,489   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,491   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2025-06-11T10:03:42,494   creating build/lib/deepspeed/module_inject/containers/features
2025-06-11T10:03:42,495   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-11T10:03:42,498   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-11T10:03:42,500   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-11T10:03:42,502   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-11T10:03:42,504   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-11T10:03:42,507   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-11T10:03:42,509   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-11T10:03:42,512   creating build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,513   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,518   copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,520   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,522   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,524   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,527   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,530   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,532   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,535   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,537   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,540   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,542   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,545   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,547   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,552   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,555   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,558   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2025-06-11T10:03:42,563   creating build/lib/deepspeed/runtime/model_checkpointing
2025-06-11T10:03:42,564   copying deepspeed/runtime/model_checkpointing/config.py -> build/lib/deepspeed/runtime/model_checkpointing
2025-06-11T10:03:42,566   copying deepspeed/runtime/model_checkpointing/utils.py -> build/lib/deepspeed/runtime/model_checkpointing
2025-06-11T10:03:42,568   copying deepspeed/runtime/model_checkpointing/writer_factory.py -> build/lib/deepspeed/runtime/model_checkpointing
2025-06-11T10:03:42,571   copying deepspeed/runtime/model_checkpointing/constants.py -> build/lib/deepspeed/runtime/model_checkpointing
2025-06-11T10:03:42,573   copying deepspeed/runtime/model_checkpointing/__init__.py -> build/lib/deepspeed/runtime/model_checkpointing
2025-06-11T10:03:42,575   copying deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py -> build/lib/deepspeed/runtime/model_checkpointing
2025-06-11T10:03:42,578   creating build/lib/deepspeed/runtime/swap_tensor
2025-06-11T10:03:42,579   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-11T10:03:42,582   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-11T10:03:42,585   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-11T10:03:42,587   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-11T10:03:42,589   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-11T10:03:42,592   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-11T10:03:42,593   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-11T10:03:42,596   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-11T10:03:42,598   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-11T10:03:42,601   creating build/lib/deepspeed/runtime/pipe
2025-06-11T10:03:42,602   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2025-06-11T10:03:42,606   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2025-06-11T10:03:42,608   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2025-06-11T10:03:42,611   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2025-06-11T10:03:42,614   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2025-06-11T10:03:42,616   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2025-06-11T10:03:42,619   creating build/lib/deepspeed/runtime/sequence_parallel
2025-06-11T10:03:42,621   copying deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/lib/deepspeed/runtime/sequence_parallel
2025-06-11T10:03:42,624   copying deepspeed/runtime/sequence_parallel/__init__.py -> build/lib/deepspeed/runtime/sequence_parallel
2025-06-11T10:03:42,626   copying deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/lib/deepspeed/runtime/sequence_parallel
2025-06-11T10:03:42,628   creating build/lib/deepspeed/runtime/domino
2025-06-11T10:03:42,630   copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino
2025-06-11T10:03:42,632   copying deepspeed/runtime/domino/async_linear.py -> build/lib/deepspeed/runtime/domino
2025-06-11T10:03:42,635   copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino
2025-06-11T10:03:42,637   creating build/lib/deepspeed/runtime/data_pipeline
2025-06-11T10:03:42,638   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-11T10:03:42,641   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-11T10:03:42,644   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-11T10:03:42,646   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-11T10:03:42,648   creating build/lib/deepspeed/runtime/fp16
2025-06-11T10:03:42,650   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2025-06-11T10:03:42,653   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-06-11T10:03:42,655   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2025-06-11T10:03:42,657   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-06-11T10:03:42,661   creating build/lib/deepspeed/runtime/comm
2025-06-11T10:03:42,662   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2025-06-11T10:03:42,664   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2025-06-11T10:03:42,667   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2025-06-11T10:03:42,669   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2025-06-11T10:03:42,671   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2025-06-11T10:03:42,673   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2025-06-11T10:03:42,676   creating build/lib/deepspeed/runtime/tensor_parallel
2025-06-11T10:03:42,677   copying deepspeed/runtime/tensor_parallel/config.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-11T10:03:42,680   copying deepspeed/runtime/tensor_parallel/__init__.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-11T10:03:42,682   copying deepspeed/runtime/tensor_parallel/tp_manager.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-11T10:03:42,684   creating build/lib/deepspeed/runtime/checkpoint_engine
2025-06-11T10:03:42,685   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-11T10:03:42,688   copying deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-11T10:03:42,690   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-11T10:03:42,692   copying deepspeed/runtime/checkpoint_engine/utils.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-11T10:03:42,695   copying deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-11T10:03:42,697   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-11T10:03:42,700   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-11T10:03:42,702   creating build/lib/deepspeed/runtime/compression
2025-06-11T10:03:42,703   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2025-06-11T10:03:42,706   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2025-06-11T10:03:42,708   creating build/lib/deepspeed/runtime/activation_checkpointing
2025-06-11T10:03:42,710   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-11T10:03:42,713   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-11T10:03:42,715   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-11T10:03:42,718   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-11T10:03:42,719   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-11T10:03:42,722   copying deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-11T10:03:42,725   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-11T10:03:42,728   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-11T10:03:42,730   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-11T10:03:42,732   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-11T10:03:42,736   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-11T10:03:42,737   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-11T10:03:42,739   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-11T10:03:42,742   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-11T10:03:42,744   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-11T10:03:42,746   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-11T10:03:42,749   creating build/lib/deepspeed/runtime/fp16/onebit
2025-06-11T10:03:42,750   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-11T10:03:42,753   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-11T10:03:42,755   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-11T10:03:42,758   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-11T10:03:42,760   creating build/lib/deepspeed/profiling/flops_profiler
2025-06-11T10:03:42,761   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2025-06-11T10:03:42,764   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2025-06-11T10:03:42,767   creating build/lib/deepspeed/model_implementations/diffusers
2025-06-11T10:03:42,768   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-11T10:03:42,771   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-11T10:03:42,773   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-11T10:03:42,776   creating build/lib/deepspeed/model_implementations/transformers
2025-06-11T10:03:42,777   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-11T10:03:42,779   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-11T10:03:42,782   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-11T10:03:42,784   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-11T10:03:42,786   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-11T10:03:42,788   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-11T10:03:42,790   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-11T10:03:42,792   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-11T10:03:42,794   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-11T10:03:42,796   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-11T10:03:42,799   creating build/lib/deepspeed/model_implementations/features
2025-06-11T10:03:42,800   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2025-06-11T10:03:42,802   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2025-06-11T10:03:42,805   creating build/lib/deepspeed/inference/quantization
2025-06-11T10:03:42,806   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2025-06-11T10:03:42,808   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2025-06-11T10:03:42,811   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2025-06-11T10:03:42,813   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2025-06-11T10:03:42,815   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2025-06-11T10:03:42,818   creating build/lib/deepspeed/inference/v2
2025-06-11T10:03:42,819   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2025-06-11T10:03:42,822   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2025-06-11T10:03:42,824   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2025-06-11T10:03:42,826   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2025-06-11T10:03:42,828   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2025-06-11T10:03:42,830   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2025-06-11T10:03:42,833   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2025-06-11T10:03:42,835   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2025-06-11T10:03:42,837   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2025-06-11T10:03:42,840   creating build/lib/deepspeed/inference/v2/ragged
2025-06-11T10:03:42,841   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-11T10:03:42,844   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-11T10:03:42,846   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-11T10:03:42,849   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-11T10:03:42,852   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-11T10:03:42,854   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-11T10:03:42,856   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-11T10:03:42,860   creating build/lib/deepspeed/inference/v2/modules
2025-06-11T10:03:42,861   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2025-06-11T10:03:42,864   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2025-06-11T10:03:42,866   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2025-06-11T10:03:42,868   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2025-06-11T10:03:42,871   creating build/lib/deepspeed/inference/v2/model_implementations
2025-06-11T10:03:42,872   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-11T10:03:42,875   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-11T10:03:42,878   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-11T10:03:42,880   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-11T10:03:42,883   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-11T10:03:42,885   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-11T10:03:42,887   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-11T10:03:42,890   creating build/lib/deepspeed/inference/v2/kernels
2025-06-11T10:03:42,891   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2025-06-11T10:03:42,894   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2025-06-11T10:03:42,896   creating build/lib/deepspeed/inference/v2/checkpoint
2025-06-11T10:03:42,898   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-11T10:03:42,900   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-11T10:03:42,902   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-11T10:03:42,905   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-11T10:03:42,908   creating build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:42,910   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:42,912   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:42,914   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:42,917   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:42,919   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:42,922   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:42,924   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:42,926   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:42,928   creating build/lib/deepspeed/inference/v2/modules/configs
2025-06-11T10:03:42,930   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-11T10:03:42,932   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-11T10:03:42,934   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-11T10:03:42,936   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-11T10:03:42,938   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-11T10:03:42,940   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-11T10:03:42,942   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-11T10:03:42,945   creating build/lib/deepspeed/inference/v2/modules/implementations
2025-06-11T10:03:42,946   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2025-06-11T10:03:42,949   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-11T10:03:42,950   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-11T10:03:42,953   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-11T10:03:42,955   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-11T10:03:42,957   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-11T10:03:42,959   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-11T10:03:42,961   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-11T10:03:42,964   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-11T10:03:42,965   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-11T10:03:42,967   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-11T10:03:42,969   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-11T10:03:42,971   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-11T10:03:42,972   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-11T10:03:42,975   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-11T10:03:42,978   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-11T10:03:42,979   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-11T10:03:42,981   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-11T10:03:42,984   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-11T10:03:42,985   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-11T10:03:42,987   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-11T10:03:42,990   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-11T10:03:42,991   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-11T10:03:42,993   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-11T10:03:42,996   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-11T10:03:42,997   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-11T10:03:42,999   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-11T10:03:43,001   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-11T10:03:43,003   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-11T10:03:43,006   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:43,007   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:43,010   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:43,012   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:43,014   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:43,016   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:43,018   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:43,020   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:43,023   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:43,025   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:43,027   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-11T10:03:43,029   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-11T10:03:43,031   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-11T10:03:43,033   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-11T10:03:43,035   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-11T10:03:43,038   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:43,040   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:43,042   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:43,044   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:43,046   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:43,049   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:43,051   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:43,053   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:43,055   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:43,057   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:43,060   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-11T10:03:43,061   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-11T10:03:43,063   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-11T10:03:43,065   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-11T10:03:43,067   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-11T10:03:43,070   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-11T10:03:43,071   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-11T10:03:43,074   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-11T10:03:43,076   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-11T10:03:43,078   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-11T10:03:43,080   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-11T10:03:43,082   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-11T10:03:43,084   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-11T10:03:43,086   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-11T10:03:43,088   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-11T10:03:43,091   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-11T10:03:43,092   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-11T10:03:43,095   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-11T10:03:43,097   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-11T10:03:43,099   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-11T10:03:43,101   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-11T10:03:43,102   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-11T10:03:43,105   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-11T10:03:43,107   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-11T10:03:43,109   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-11T10:03:43,112   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-11T10:03:43,113   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-11T10:03:43,116   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-11T10:03:43,118   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-11T10:03:43,120   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-11T10:03:43,123   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-11T10:03:43,124   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-11T10:03:43,126   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-11T10:03:43,128   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-11T10:03:43,130   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-11T10:03:43,133   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-11T10:03:43,134   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-11T10:03:43,136   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-11T10:03:43,138   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-11T10:03:43,140   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-11T10:03:43,143   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-11T10:03:43,144   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-11T10:03:43,146   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-11T10:03:43,147   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-11T10:03:43,150   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-11T10:03:43,151   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-11T10:03:43,154   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-11T10:03:43,155   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-11T10:03:43,157   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-11T10:03:43,159   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-11T10:03:43,162   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-11T10:03:43,163   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-11T10:03:43,165   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-11T10:03:43,168   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-11T10:03:43,169   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-11T10:03:43,171   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-11T10:03:43,174   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-11T10:03:43,176   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-11T10:03:43,178   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-11T10:03:43,180   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-11T10:03:43,181   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-11T10:03:43,183   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-11T10:03:43,186   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-11T10:03:43,187   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-11T10:03:43,189   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-11T10:03:43,192   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-11T10:03:43,193   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-11T10:03:43,195   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-11T10:03:43,197   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-11T10:03:43,198   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-11T10:03:43,201   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-11T10:03:43,203   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:43,204   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:43,207   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:43,209   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:43,211   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:43,214   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-11T10:03:43,215   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-11T10:03:43,217   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-11T10:03:43,220   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:43,221   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:43,223   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:43,226   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:43,227   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:43,229   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:43,232   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-11T10:03:43,233   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-11T10:03:43,235   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-11T10:03:43,237   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-11T10:03:43,238   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-11T10:03:43,241   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-11T10:03:43,243   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-11T10:03:43,244   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-11T10:03:43,246   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-11T10:03:43,249   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-11T10:03:43,250   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-11T10:03:43,252   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-11T10:03:43,254   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-11T10:03:43,256   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-11T10:03:43,259   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-11T10:03:43,260   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-11T10:03:43,263   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-11T10:03:43,265   creating build/lib/deepspeed/autotuning/tuner
2025-06-11T10:03:43,266   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2025-06-11T10:03:43,269   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2025-06-11T10:03:43,271   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-11T10:03:43,273   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-11T10:03:43,275   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-11T10:03:43,277   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2025-06-11T10:03:43,280   creating build/lib/deepspeed/compile/profilers
2025-06-11T10:03:43,281   copying deepspeed/compile/profilers/graph_profile.py -> build/lib/deepspeed/compile/profilers
2025-06-11T10:03:43,283   copying deepspeed/compile/profilers/__init__.py -> build/lib/deepspeed/compile/profilers
2025-06-11T10:03:43,285   copying deepspeed/compile/profilers/comm_profile.py -> build/lib/deepspeed/compile/profilers
2025-06-11T10:03:43,288   creating build/lib/deepspeed/compile/passes
2025-06-11T10:03:43,289   copying deepspeed/compile/passes/offload_activation.py -> build/lib/deepspeed/compile/passes
2025-06-11T10:03:43,292   copying deepspeed/compile/passes/offload_adam_states.py -> build/lib/deepspeed/compile/passes
2025-06-11T10:03:43,294   copying deepspeed/compile/passes/selective_gather.py -> build/lib/deepspeed/compile/passes
2025-06-11T10:03:43,297   copying deepspeed/compile/passes/zero1_compile.py -> build/lib/deepspeed/compile/passes
2025-06-11T10:03:43,299   copying deepspeed/compile/passes/zero3_compile.py -> build/lib/deepspeed/compile/passes
2025-06-11T10:03:43,301   copying deepspeed/compile/passes/__init__.py -> build/lib/deepspeed/compile/passes
2025-06-11T10:03:43,303   copying deepspeed/compile/passes/offload_parameters.py -> build/lib/deepspeed/compile/passes
2025-06-11T10:03:43,305   copying deepspeed/compile/passes/prefetch.py -> build/lib/deepspeed/compile/passes
2025-06-11T10:03:43,308   creating build/lib/deepspeed/ops/lion
2025-06-11T10:03:43,309   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2025-06-11T10:03:43,311   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2025-06-11T10:03:43,314   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2025-06-11T10:03:43,315   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2025-06-11T10:03:43,318   creating build/lib/deepspeed/ops/fp_quantizer
2025-06-11T10:03:43,319   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-11T10:03:43,322   copying deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-11T10:03:43,324   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-11T10:03:43,326   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-11T10:03:43,328   creating build/lib/deepspeed/ops/adam
2025-06-11T10:03:43,329   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2025-06-11T10:03:43,332   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2025-06-11T10:03:43,334   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2025-06-11T10:03:43,336   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2025-06-11T10:03:43,339   creating build/lib/deepspeed/ops/adagrad
2025-06-11T10:03:43,340   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2025-06-11T10:03:43,342   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2025-06-11T10:03:43,345   creating build/lib/deepspeed/ops/random_ltd
2025-06-11T10:03:43,346   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2025-06-11T10:03:43,348   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2025-06-11T10:03:43,351   creating build/lib/deepspeed/ops/deepspeed4science
2025-06-11T10:03:43,352   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2025-06-11T10:03:43,354   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2025-06-11T10:03:43,357   creating build/lib/deepspeed/ops/gds
2025-06-11T10:03:43,358   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2025-06-11T10:03:43,360   creating build/lib/deepspeed/ops/quantizer
2025-06-11T10:03:43,361   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2025-06-11T10:03:43,364   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2025-06-11T10:03:43,366   creating build/lib/deepspeed/ops/aio
2025-06-11T10:03:43,367   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2025-06-11T10:03:43,370   creating build/lib/deepspeed/ops/transformer
2025-06-11T10:03:43,371   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2025-06-11T10:03:43,374   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2025-06-11T10:03:43,376   creating build/lib/deepspeed/ops/sparse_attention
2025-06-11T10:03:43,377   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-11T10:03:43,380   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-11T10:03:43,383   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-11T10:03:43,385   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-11T10:03:43,387   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-11T10:03:43,389   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-11T10:03:43,392   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-11T10:03:43,395   creating build/lib/deepspeed/ops/compile
2025-06-11T10:03:43,396   copying deepspeed/ops/compile/__init__.py -> build/lib/deepspeed/ops/compile
2025-06-11T10:03:43,399   creating build/lib/deepspeed/ops/lamb
2025-06-11T10:03:43,400   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2025-06-11T10:03:43,402   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2025-06-11T10:03:43,406   creating build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,407   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,409   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,411   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,413   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,415   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,418   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,420   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,422   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,424   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,426   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,428   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,430   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,433   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,435   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,437   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,439   copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,441   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,443   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,446   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,447   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,450   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,452   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,454   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,456   copying deepspeed/ops/op_builder/dc.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,458   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,460   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2025-06-11T10:03:43,464   creating build/lib/deepspeed/ops/transformer/inference
2025-06-11T10:03:43,465   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-11T10:03:43,467   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-11T10:03:43,470   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-11T10:03:43,472   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-11T10:03:43,474   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-11T10:03:43,476   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-11T10:03:43,479   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-11T10:03:43,482   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-11T10:03:43,484   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-11T10:03:43,487   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-11T10:03:43,490   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,491   copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,493   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,496   copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,498   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,501   copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,503   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,505   copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,507   copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,509   copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,511   copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,514   copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,516   copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,518   copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,520   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,523   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,525   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,527   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,529   copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,531   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,533   copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,535   copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,537   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,540   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:43,542   creating build/lib/deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:43,543   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:43,546   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:43,549   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:43,551   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:43,554   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:43,556   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:43,558   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:43,561   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:43,563   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:43,566   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:43,568   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-11T10:03:43,569   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-11T10:03:43,572   creating build/lib/deepspeed/ops/op_builder/xpu
2025-06-11T10:03:43,574   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-11T10:03:43,576   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-11T10:03:43,578   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-11T10:03:43,580   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-11T10:03:43,582   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-11T10:03:43,584   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-11T10:03:43,586   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-11T10:03:43,588   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-11T10:03:43,590   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-11T10:03:43,592   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-11T10:03:43,595   creating build/lib/deepspeed/ops/op_builder/cpu
2025-06-11T10:03:43,596   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-11T10:03:43,598   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-11T10:03:43,600   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-11T10:03:43,602   copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-11T10:03:43,604   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-11T10:03:43,606   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-11T10:03:43,608   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-11T10:03:43,611   creating build/lib/deepspeed/ops/op_builder/sdaa
2025-06-11T10:03:43,612   copying deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-11T10:03:43,614   copying deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-11T10:03:43,617   copying deepspeed/ops/op_builder/sdaa/no_impl.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-11T10:03:43,619   copying deepspeed/ops/op_builder/sdaa/__init__.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-11T10:03:43,621   copying deepspeed/ops/op_builder/sdaa/builder.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-11T10:03:43,623   creating build/lib/deepspeed/ops/op_builder/mlu
2025-06-11T10:03:43,625   copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-11T10:03:43,627   copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-11T10:03:43,629   copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-11T10:03:43,631   copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-11T10:03:43,633   copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-11T10:03:43,635   copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-11T10:03:43,638   creating build/lib/deepspeed/ops/op_builder/hpu
2025-06-11T10:03:43,639   copying deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-11T10:03:43,641   copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-11T10:03:43,644   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-11T10:03:43,646   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-11T10:03:43,648   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-11T10:03:43,650   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-11T10:03:43,652   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-11T10:03:43,655   creating build/lib/deepspeed/ops/op_builder/npu
2025-06-11T10:03:43,656   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-11T10:03:43,658   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-11T10:03:43,661   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-11T10:03:43,663   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-11T10:03:43,665   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-11T10:03:43,667   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-11T10:03:43,669   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-11T10:03:43,671   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-11T10:03:43,673   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-11T10:03:43,676   running egg_info
2025-06-11T10:03:43,704   writing deepspeed.egg-info/PKG-INFO
2025-06-11T10:03:43,739   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2025-06-11T10:03:43,741   writing entry points to deepspeed.egg-info/entry_points.txt
2025-06-11T10:03:43,760   writing requirements to deepspeed.egg-info/requires.txt
2025-06-11T10:03:43,762   writing top-level names to deepspeed.egg-info/top_level.txt
2025-06-11T10:03:43,912   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-06-11T10:03:43,987   reading manifest template 'MANIFEST.in'
2025-06-11T10:03:43,989   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-06-11T10:03:43,989   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-06-11T10:03:45,895   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-06-11T10:03:47,082   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-06-11T10:03:47,883   warning: no files found matching '*.tr' under directory 'csrc'
2025-06-11T10:03:48,034   warning: no files found matching '*.cc' under directory 'csrc'
2025-06-11T10:03:48,090   warning: no files found matching '*.py' under directory 'benchmarks'
2025-06-11T10:03:48,097   adding license file 'LICENSE'
2025-06-11T10:03:48,152   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-06-11T10:03:48,161   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2025-06-11T10:03:48,162   !!

2025-06-11T10:03:48,163           ********************************************************************************
2025-06-11T10:03:48,164           ############################
2025-06-11T10:03:48,165           # Package would be ignored #
2025-06-11T10:03:48,165           ############################
2025-06-11T10:03:48,166           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2025-06-11T10:03:48,167           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,168           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,168           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2025-06-11T10:03:48,169           to the `packages` configuration field.

2025-06-11T10:03:48,170           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,171           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,172           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,173           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,174           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,176           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2025-06-11T10:03:48,176           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2025-06-11T10:03:48,177           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,178           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,178           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,179           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,180           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,181           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,182                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,182                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,182                 directory, all directories are treated like packages.
2025-06-11T10:03:48,183           ********************************************************************************

2025-06-11T10:03:48,184   !!
2025-06-11T10:03:48,184     check.warn(importable)
2025-06-11T10:03:48,185   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2025-06-11T10:03:48,185   !!

2025-06-11T10:03:48,186           ********************************************************************************
2025-06-11T10:03:48,187           ############################
2025-06-11T10:03:48,187           # Package would be ignored #
2025-06-11T10:03:48,188           ############################
2025-06-11T10:03:48,188           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2025-06-11T10:03:48,189           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,190           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,190           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2025-06-11T10:03:48,191           to the `packages` configuration field.

2025-06-11T10:03:48,192           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,193           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,193           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,194           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,195           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,197           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2025-06-11T10:03:48,197           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2025-06-11T10:03:48,198           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,198           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,199           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,200           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,201           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,202           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,203                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,203                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,204                 directory, all directories are treated like packages.
2025-06-11T10:03:48,204           ********************************************************************************

2025-06-11T10:03:48,206   !!
2025-06-11T10:03:48,206     check.warn(importable)
2025-06-11T10:03:48,207   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2025-06-11T10:03:48,207   !!

2025-06-11T10:03:48,208           ********************************************************************************
2025-06-11T10:03:48,208           ############################
2025-06-11T10:03:48,209           # Package would be ignored #
2025-06-11T10:03:48,209           ############################
2025-06-11T10:03:48,209           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2025-06-11T10:03:48,210           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,211           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,211           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2025-06-11T10:03:48,212           to the `packages` configuration field.

2025-06-11T10:03:48,212           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,213           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,213           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,214           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,215           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,216           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2025-06-11T10:03:48,217           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2025-06-11T10:03:48,217           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,217           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,218           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,219           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,220           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,222           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,223                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,223                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,224                 directory, all directories are treated like packages.
2025-06-11T10:03:48,225           ********************************************************************************

2025-06-11T10:03:48,226   !!
2025-06-11T10:03:48,226     check.warn(importable)
2025-06-11T10:03:48,227   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2025-06-11T10:03:48,227   !!

2025-06-11T10:03:48,228           ********************************************************************************
2025-06-11T10:03:48,229           ############################
2025-06-11T10:03:48,229           # Package would be ignored #
2025-06-11T10:03:48,230           ############################
2025-06-11T10:03:48,230           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2025-06-11T10:03:48,231           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,232           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,233           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2025-06-11T10:03:48,233           to the `packages` configuration field.

2025-06-11T10:03:48,235           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,235           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,235           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,236           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,237           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,238           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2025-06-11T10:03:48,238           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2025-06-11T10:03:48,239           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,239           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,240           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,240           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,241           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,243           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,243                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,243                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,244                 directory, all directories are treated like packages.
2025-06-11T10:03:48,244           ********************************************************************************

2025-06-11T10:03:48,245   !!
2025-06-11T10:03:48,246     check.warn(importable)
2025-06-11T10:03:48,246   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2025-06-11T10:03:48,247   !!

2025-06-11T10:03:48,248           ********************************************************************************
2025-06-11T10:03:48,249           ############################
2025-06-11T10:03:48,250           # Package would be ignored #
2025-06-11T10:03:48,250           ############################
2025-06-11T10:03:48,251           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2025-06-11T10:03:48,251           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,253           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,253           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2025-06-11T10:03:48,254           to the `packages` configuration field.

2025-06-11T10:03:48,255           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,255           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,256           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,257           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,258           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,259           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2025-06-11T10:03:48,260           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2025-06-11T10:03:48,260           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,261           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,262           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,263           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,264           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,265           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,266                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,266                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,267                 directory, all directories are treated like packages.
2025-06-11T10:03:48,267           ********************************************************************************

2025-06-11T10:03:48,268   !!
2025-06-11T10:03:48,268     check.warn(importable)
2025-06-11T10:03:48,269   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2025-06-11T10:03:48,269   !!

2025-06-11T10:03:48,270           ********************************************************************************
2025-06-11T10:03:48,270           ############################
2025-06-11T10:03:48,271           # Package would be ignored #
2025-06-11T10:03:48,271           ############################
2025-06-11T10:03:48,272           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2025-06-11T10:03:48,272           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,273           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,273           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2025-06-11T10:03:48,274           to the `packages` configuration field.

2025-06-11T10:03:48,275           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,275           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,276           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,277           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,278           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,279           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2025-06-11T10:03:48,280           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2025-06-11T10:03:48,280           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,281           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,282           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,283           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,284           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,285           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,286                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,286                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,287                 directory, all directories are treated like packages.
2025-06-11T10:03:48,287           ********************************************************************************

2025-06-11T10:03:48,289   !!
2025-06-11T10:03:48,289     check.warn(importable)
2025-06-11T10:03:48,290   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2025-06-11T10:03:48,291   !!

2025-06-11T10:03:48,292           ********************************************************************************
2025-06-11T10:03:48,292           ############################
2025-06-11T10:03:48,293           # Package would be ignored #
2025-06-11T10:03:48,293           ############################
2025-06-11T10:03:48,294           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2025-06-11T10:03:48,294           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,295           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,295           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2025-06-11T10:03:48,296           to the `packages` configuration field.

2025-06-11T10:03:48,296           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,297           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,297           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,298           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,299           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,300           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2025-06-11T10:03:48,300           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2025-06-11T10:03:48,301           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,301           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,302           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,303           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,304           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,306           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,306                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,307                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,307                 directory, all directories are treated like packages.
2025-06-11T10:03:48,308           ********************************************************************************

2025-06-11T10:03:48,309   !!
2025-06-11T10:03:48,310     check.warn(importable)
2025-06-11T10:03:48,310   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2025-06-11T10:03:48,311   !!

2025-06-11T10:03:48,312           ********************************************************************************
2025-06-11T10:03:48,313           ############################
2025-06-11T10:03:48,313           # Package would be ignored #
2025-06-11T10:03:48,314           ############################
2025-06-11T10:03:48,314           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2025-06-11T10:03:48,315           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,316           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,316           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2025-06-11T10:03:48,317           to the `packages` configuration field.

2025-06-11T10:03:48,318           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,319           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,319           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,321           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,322           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,323           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2025-06-11T10:03:48,323           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2025-06-11T10:03:48,324           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,324           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,324           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,325           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,326           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,327           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,328                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,328                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,328                 directory, all directories are treated like packages.
2025-06-11T10:03:48,329           ********************************************************************************

2025-06-11T10:03:48,330   !!
2025-06-11T10:03:48,330     check.warn(importable)
2025-06-11T10:03:48,331   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2025-06-11T10:03:48,331   !!

2025-06-11T10:03:48,332           ********************************************************************************
2025-06-11T10:03:48,332           ############################
2025-06-11T10:03:48,333           # Package would be ignored #
2025-06-11T10:03:48,333           ############################
2025-06-11T10:03:48,334           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2025-06-11T10:03:48,335           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,336           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,336           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2025-06-11T10:03:48,337           to the `packages` configuration field.

2025-06-11T10:03:48,338           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,338           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,339           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,340           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,342           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,343           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2025-06-11T10:03:48,343           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2025-06-11T10:03:48,344           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,345           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,345           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,346           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,348           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,349           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,350                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,351                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,351                 directory, all directories are treated like packages.
2025-06-11T10:03:48,352           ********************************************************************************

2025-06-11T10:03:48,353   !!
2025-06-11T10:03:48,354     check.warn(importable)
2025-06-11T10:03:48,354   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2025-06-11T10:03:48,354   !!

2025-06-11T10:03:48,355           ********************************************************************************
2025-06-11T10:03:48,356           ############################
2025-06-11T10:03:48,356           # Package would be ignored #
2025-06-11T10:03:48,356           ############################
2025-06-11T10:03:48,357           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2025-06-11T10:03:48,357           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,358           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,359           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2025-06-11T10:03:48,359           to the `packages` configuration field.

2025-06-11T10:03:48,360           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,360           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,361           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,362           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,363           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,364           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2025-06-11T10:03:48,364           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2025-06-11T10:03:48,365           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,365           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,366           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,367           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,368           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,370           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,370                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,371                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,371                 directory, all directories are treated like packages.
2025-06-11T10:03:48,372           ********************************************************************************

2025-06-11T10:03:48,373   !!
2025-06-11T10:03:48,374     check.warn(importable)
2025-06-11T10:03:48,374   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2025-06-11T10:03:48,375   !!

2025-06-11T10:03:48,376           ********************************************************************************
2025-06-11T10:03:48,377           ############################
2025-06-11T10:03:48,377           # Package would be ignored #
2025-06-11T10:03:48,378           ############################
2025-06-11T10:03:48,378           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2025-06-11T10:03:48,379           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,380           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,381           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2025-06-11T10:03:48,381           to the `packages` configuration field.

2025-06-11T10:03:48,383           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,383           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,383           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,384           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,385           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,386           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2025-06-11T10:03:48,386           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2025-06-11T10:03:48,387           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,387           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,388           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,388           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,389           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,391           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,391                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,392                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,392                 directory, all directories are treated like packages.
2025-06-11T10:03:48,393           ********************************************************************************

2025-06-11T10:03:48,394   !!
2025-06-11T10:03:48,394     check.warn(importable)
2025-06-11T10:03:48,394   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2025-06-11T10:03:48,395   !!

2025-06-11T10:03:48,396           ********************************************************************************
2025-06-11T10:03:48,397           ############################
2025-06-11T10:03:48,397           # Package would be ignored #
2025-06-11T10:03:48,398           ############################
2025-06-11T10:03:48,398           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2025-06-11T10:03:48,399           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,400           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,401           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2025-06-11T10:03:48,401           to the `packages` configuration field.

2025-06-11T10:03:48,402           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,403           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,403           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,404           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,405           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,406           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2025-06-11T10:03:48,407           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2025-06-11T10:03:48,408           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,408           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,409           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,410           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,412           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,413           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,413                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,414                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,414                 directory, all directories are treated like packages.
2025-06-11T10:03:48,414           ********************************************************************************

2025-06-11T10:03:48,415   !!
2025-06-11T10:03:48,416     check.warn(importable)
2025-06-11T10:03:48,416   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2025-06-11T10:03:48,416   !!

2025-06-11T10:03:48,417           ********************************************************************************
2025-06-11T10:03:48,418           ############################
2025-06-11T10:03:48,418           # Package would be ignored #
2025-06-11T10:03:48,418           ############################
2025-06-11T10:03:48,419           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2025-06-11T10:03:48,419           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,420           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,421           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2025-06-11T10:03:48,421           to the `packages` configuration field.

2025-06-11T10:03:48,422           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,423           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,423           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,424           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,425           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,427           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2025-06-11T10:03:48,427           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2025-06-11T10:03:48,428           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,428           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,429           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,430           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,431           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,433           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,433                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,434                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,434                 directory, all directories are treated like packages.
2025-06-11T10:03:48,435           ********************************************************************************

2025-06-11T10:03:48,436   !!
2025-06-11T10:03:48,437     check.warn(importable)
2025-06-11T10:03:48,437   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.compile' is absent from the `packages` configuration.
2025-06-11T10:03:48,438   !!

2025-06-11T10:03:48,439           ********************************************************************************
2025-06-11T10:03:48,440           ############################
2025-06-11T10:03:48,440           # Package would be ignored #
2025-06-11T10:03:48,441           ############################
2025-06-11T10:03:48,441           Python recognizes 'deepspeed.ops.csrc.compile' as an importable package[^1],
2025-06-11T10:03:48,442           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,443           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,443           package, please make sure that 'deepspeed.ops.csrc.compile' is explicitly added
2025-06-11T10:03:48,444           to the `packages` configuration field.

2025-06-11T10:03:48,444           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,445           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,445           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,446           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,447           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,448           If you don't want 'deepspeed.ops.csrc.compile' to be distributed and are
2025-06-11T10:03:48,448           already explicitly excluding 'deepspeed.ops.csrc.compile' via
2025-06-11T10:03:48,448           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,449           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,449           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,450           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,451           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,453           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,453                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,453                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,454                 directory, all directories are treated like packages.
2025-06-11T10:03:48,455           ********************************************************************************

2025-06-11T10:03:48,456   !!
2025-06-11T10:03:48,456     check.warn(importable)
2025-06-11T10:03:48,457   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2025-06-11T10:03:48,457   !!

2025-06-11T10:03:48,459           ********************************************************************************
2025-06-11T10:03:48,459           ############################
2025-06-11T10:03:48,460           # Package would be ignored #
2025-06-11T10:03:48,460           ############################
2025-06-11T10:03:48,461           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2025-06-11T10:03:48,462           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,463           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,463           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2025-06-11T10:03:48,464           to the `packages` configuration field.

2025-06-11T10:03:48,465           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,465           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,466           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,467           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,468           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,469           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2025-06-11T10:03:48,470           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2025-06-11T10:03:48,470           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,471           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,472           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,472           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,473           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,474           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,475                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,475                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,476                 directory, all directories are treated like packages.
2025-06-11T10:03:48,476           ********************************************************************************

2025-06-11T10:03:48,477   !!
2025-06-11T10:03:48,477     check.warn(importable)
2025-06-11T10:03:48,478   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2025-06-11T10:03:48,478   !!

2025-06-11T10:03:48,479           ********************************************************************************
2025-06-11T10:03:48,479           ############################
2025-06-11T10:03:48,480           # Package would be ignored #
2025-06-11T10:03:48,480           ############################
2025-06-11T10:03:48,481           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2025-06-11T10:03:48,481           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,482           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,483           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2025-06-11T10:03:48,483           to the `packages` configuration field.

2025-06-11T10:03:48,484           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,485           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,486           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,487           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,488           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,489           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2025-06-11T10:03:48,490           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2025-06-11T10:03:48,490           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,491           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,491           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,492           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,494           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,495           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,496                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,496                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,497                 directory, all directories are treated like packages.
2025-06-11T10:03:48,497           ********************************************************************************

2025-06-11T10:03:48,498   !!
2025-06-11T10:03:48,499     check.warn(importable)
2025-06-11T10:03:48,499   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2025-06-11T10:03:48,500   !!

2025-06-11T10:03:48,501           ********************************************************************************
2025-06-11T10:03:48,502           ############################
2025-06-11T10:03:48,502           # Package would be ignored #
2025-06-11T10:03:48,502           ############################
2025-06-11T10:03:48,503           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2025-06-11T10:03:48,503           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,504           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,504           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2025-06-11T10:03:48,505           to the `packages` configuration field.

2025-06-11T10:03:48,506           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,506           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,507           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,508           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,509           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,510           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2025-06-11T10:03:48,510           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2025-06-11T10:03:48,511           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,511           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,512           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,513           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,514           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,515           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,516                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,516                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,517                 directory, all directories are treated like packages.
2025-06-11T10:03:48,517           ********************************************************************************

2025-06-11T10:03:48,519   !!
2025-06-11T10:03:48,519     check.warn(importable)
2025-06-11T10:03:48,520   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2025-06-11T10:03:48,520   !!

2025-06-11T10:03:48,522           ********************************************************************************
2025-06-11T10:03:48,522           ############################
2025-06-11T10:03:48,523           # Package would be ignored #
2025-06-11T10:03:48,523           ############################
2025-06-11T10:03:48,524           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2025-06-11T10:03:48,524           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,525           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,526           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2025-06-11T10:03:48,526           to the `packages` configuration field.

2025-06-11T10:03:48,527           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,528           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,528           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,530           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,530           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,531           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2025-06-11T10:03:48,532           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2025-06-11T10:03:48,532           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,532           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,533           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,534           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,534           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,536           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,536                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,537                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,537                 directory, all directories are treated like packages.
2025-06-11T10:03:48,538           ********************************************************************************

2025-06-11T10:03:48,539   !!
2025-06-11T10:03:48,539     check.warn(importable)
2025-06-11T10:03:48,539   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2025-06-11T10:03:48,540   !!

2025-06-11T10:03:48,541           ********************************************************************************
2025-06-11T10:03:48,541           ############################
2025-06-11T10:03:48,542           # Package would be ignored #
2025-06-11T10:03:48,542           ############################
2025-06-11T10:03:48,543           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2025-06-11T10:03:48,543           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,545           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,545           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2025-06-11T10:03:48,546           to the `packages` configuration field.

2025-06-11T10:03:48,547           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,548           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,548           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,549           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,550           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,551           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2025-06-11T10:03:48,552           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2025-06-11T10:03:48,552           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,553           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,553           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,555           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,556           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,558           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,558                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,559                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,559                 directory, all directories are treated like packages.
2025-06-11T10:03:48,559           ********************************************************************************

2025-06-11T10:03:48,560   !!
2025-06-11T10:03:48,561     check.warn(importable)
2025-06-11T10:03:48,561   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2025-06-11T10:03:48,561   !!

2025-06-11T10:03:48,562           ********************************************************************************
2025-06-11T10:03:48,563           ############################
2025-06-11T10:03:48,563           # Package would be ignored #
2025-06-11T10:03:48,563           ############################
2025-06-11T10:03:48,564           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2025-06-11T10:03:48,564           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,565           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,566           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2025-06-11T10:03:48,566           to the `packages` configuration field.

2025-06-11T10:03:48,567           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,568           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,568           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,570           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,571           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,572           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2025-06-11T10:03:48,572           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2025-06-11T10:03:48,573           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,573           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,574           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,575           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,576           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,577           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,578                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,578                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,579                 directory, all directories are treated like packages.
2025-06-11T10:03:48,580           ********************************************************************************

2025-06-11T10:03:48,581   !!
2025-06-11T10:03:48,581     check.warn(importable)
2025-06-11T10:03:48,582   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2025-06-11T10:03:48,583   !!

2025-06-11T10:03:48,584           ********************************************************************************
2025-06-11T10:03:48,584           ############################
2025-06-11T10:03:48,585           # Package would be ignored #
2025-06-11T10:03:48,586           ############################
2025-06-11T10:03:48,587           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2025-06-11T10:03:48,587           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,588           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,588           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2025-06-11T10:03:48,589           to the `packages` configuration field.

2025-06-11T10:03:48,590           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,590           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,591           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,591           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,592           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,593           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2025-06-11T10:03:48,594           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2025-06-11T10:03:48,594           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,594           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,595           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,596           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,597           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,598           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,599                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,600                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,600                 directory, all directories are treated like packages.
2025-06-11T10:03:48,600           ********************************************************************************

2025-06-11T10:03:48,602   !!
2025-06-11T10:03:48,602     check.warn(importable)
2025-06-11T10:03:48,603   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2025-06-11T10:03:48,603   !!

2025-06-11T10:03:48,604           ********************************************************************************
2025-06-11T10:03:48,605           ############################
2025-06-11T10:03:48,605           # Package would be ignored #
2025-06-11T10:03:48,606           ############################
2025-06-11T10:03:48,606           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2025-06-11T10:03:48,607           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,608           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,608           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2025-06-11T10:03:48,609           to the `packages` configuration field.

2025-06-11T10:03:48,610           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,611           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,611           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,612           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,613           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,614           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2025-06-11T10:03:48,615           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2025-06-11T10:03:48,615           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,615           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,616           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,616           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,617           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,619           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,619                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,619                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,620                 directory, all directories are treated like packages.
2025-06-11T10:03:48,620           ********************************************************************************

2025-06-11T10:03:48,621   !!
2025-06-11T10:03:48,622     check.warn(importable)
2025-06-11T10:03:48,622   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2025-06-11T10:03:48,622   !!

2025-06-11T10:03:48,623           ********************************************************************************
2025-06-11T10:03:48,624           ############################
2025-06-11T10:03:48,624           # Package would be ignored #
2025-06-11T10:03:48,625           ############################
2025-06-11T10:03:48,625           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2025-06-11T10:03:48,626           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,627           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,627           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2025-06-11T10:03:48,628           to the `packages` configuration field.

2025-06-11T10:03:48,629           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,630           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,630           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,631           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,632           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,633           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2025-06-11T10:03:48,634           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2025-06-11T10:03:48,634           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,635           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,635           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,636           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,638           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,639           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,640                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,640                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,641                 directory, all directories are treated like packages.
2025-06-11T10:03:48,642           ********************************************************************************

2025-06-11T10:03:48,643   !!
2025-06-11T10:03:48,643     check.warn(importable)
2025-06-11T10:03:48,644   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2025-06-11T10:03:48,644   !!

2025-06-11T10:03:48,645           ********************************************************************************
2025-06-11T10:03:48,645           ############################
2025-06-11T10:03:48,645           # Package would be ignored #
2025-06-11T10:03:48,646           ############################
2025-06-11T10:03:48,646           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2025-06-11T10:03:48,647           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,648           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,648           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2025-06-11T10:03:48,648           to the `packages` configuration field.

2025-06-11T10:03:48,649           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,650           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,650           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,651           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,652           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,653           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2025-06-11T10:03:48,654           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2025-06-11T10:03:48,654           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,655           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,655           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,656           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,658           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,660           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,660                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,661                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,662                 directory, all directories are treated like packages.
2025-06-11T10:03:48,662           ********************************************************************************

2025-06-11T10:03:48,663   !!
2025-06-11T10:03:48,664     check.warn(importable)
2025-06-11T10:03:48,664   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2025-06-11T10:03:48,665   !!

2025-06-11T10:03:48,666           ********************************************************************************
2025-06-11T10:03:48,667           ############################
2025-06-11T10:03:48,667           # Package would be ignored #
2025-06-11T10:03:48,668           ############################
2025-06-11T10:03:48,668           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2025-06-11T10:03:48,669           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,671           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,671           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2025-06-11T10:03:48,672           to the `packages` configuration field.

2025-06-11T10:03:48,673           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,674           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,674           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,675           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,676           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,677           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2025-06-11T10:03:48,678           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2025-06-11T10:03:48,678           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,679           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,679           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,680           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,681           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,682           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,683                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,683                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,684                 directory, all directories are treated like packages.
2025-06-11T10:03:48,684           ********************************************************************************

2025-06-11T10:03:48,686   !!
2025-06-11T10:03:48,686     check.warn(importable)
2025-06-11T10:03:48,687   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2025-06-11T10:03:48,687   !!

2025-06-11T10:03:48,688           ********************************************************************************
2025-06-11T10:03:48,689           ############################
2025-06-11T10:03:48,689           # Package would be ignored #
2025-06-11T10:03:48,690           ############################
2025-06-11T10:03:48,690           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2025-06-11T10:03:48,691           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,692           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,693           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2025-06-11T10:03:48,694           to the `packages` configuration field.

2025-06-11T10:03:48,695           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,695           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,696           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,697           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,698           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,700           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2025-06-11T10:03:48,700           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2025-06-11T10:03:48,701           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,702           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,702           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,704           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,705           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,707           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,707                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,708                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,708                 directory, all directories are treated like packages.
2025-06-11T10:03:48,709           ********************************************************************************

2025-06-11T10:03:48,710   !!
2025-06-11T10:03:48,710     check.warn(importable)
2025-06-11T10:03:48,711   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2025-06-11T10:03:48,711   !!

2025-06-11T10:03:48,712           ********************************************************************************
2025-06-11T10:03:48,713           ############################
2025-06-11T10:03:48,713           # Package would be ignored #
2025-06-11T10:03:48,714           ############################
2025-06-11T10:03:48,714           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2025-06-11T10:03:48,715           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,716           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,717           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2025-06-11T10:03:48,717           to the `packages` configuration field.

2025-06-11T10:03:48,718           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,719           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,719           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,721           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,722           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,723           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2025-06-11T10:03:48,723           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2025-06-11T10:03:48,724           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,724           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,725           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,726           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,728           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,729           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,730                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,730                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,731                 directory, all directories are treated like packages.
2025-06-11T10:03:48,732           ********************************************************************************

2025-06-11T10:03:48,733   !!
2025-06-11T10:03:48,733     check.warn(importable)
2025-06-11T10:03:48,734   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2025-06-11T10:03:48,734   !!

2025-06-11T10:03:48,736           ********************************************************************************
2025-06-11T10:03:48,736           ############################
2025-06-11T10:03:48,737           # Package would be ignored #
2025-06-11T10:03:48,738           ############################
2025-06-11T10:03:48,738           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2025-06-11T10:03:48,739           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,740           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,740           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2025-06-11T10:03:48,741           to the `packages` configuration field.

2025-06-11T10:03:48,742           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,743           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,744           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,745           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,746           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,747           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2025-06-11T10:03:48,747           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2025-06-11T10:03:48,748           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,748           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,749           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,750           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,751           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,753           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,753                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,754                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,754                 directory, all directories are treated like packages.
2025-06-11T10:03:48,755           ********************************************************************************

2025-06-11T10:03:48,756   !!
2025-06-11T10:03:48,757     check.warn(importable)
2025-06-11T10:03:48,757   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2025-06-11T10:03:48,758   !!

2025-06-11T10:03:48,759           ********************************************************************************
2025-06-11T10:03:48,759           ############################
2025-06-11T10:03:48,760           # Package would be ignored #
2025-06-11T10:03:48,761           ############################
2025-06-11T10:03:48,762           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2025-06-11T10:03:48,762           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,764           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,764           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2025-06-11T10:03:48,765           to the `packages` configuration field.

2025-06-11T10:03:48,766           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,766           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,767           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,768           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,769           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,771           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2025-06-11T10:03:48,771           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2025-06-11T10:03:48,772           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,773           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,773           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,774           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,775           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,777           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,778                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,778                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,779                 directory, all directories are treated like packages.
2025-06-11T10:03:48,779           ********************************************************************************

2025-06-11T10:03:48,780   !!
2025-06-11T10:03:48,781     check.warn(importable)
2025-06-11T10:03:48,781   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2025-06-11T10:03:48,782   !!

2025-06-11T10:03:48,783           ********************************************************************************
2025-06-11T10:03:48,784           ############################
2025-06-11T10:03:48,784           # Package would be ignored #
2025-06-11T10:03:48,785           ############################
2025-06-11T10:03:48,785           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2025-06-11T10:03:48,786           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,787           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,787           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2025-06-11T10:03:48,788           to the `packages` configuration field.

2025-06-11T10:03:48,789           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,790           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,790           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,792           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,793           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,794           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2025-06-11T10:03:48,795           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2025-06-11T10:03:48,795           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,796           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,797           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,798           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,799           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,801           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,801                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,802                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,802                 directory, all directories are treated like packages.
2025-06-11T10:03:48,803           ********************************************************************************

2025-06-11T10:03:48,804   !!
2025-06-11T10:03:48,804     check.warn(importable)
2025-06-11T10:03:48,805   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2025-06-11T10:03:48,806   !!

2025-06-11T10:03:48,807           ********************************************************************************
2025-06-11T10:03:48,807           ############################
2025-06-11T10:03:48,808           # Package would be ignored #
2025-06-11T10:03:48,808           ############################
2025-06-11T10:03:48,809           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2025-06-11T10:03:48,809           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,810           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,811           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2025-06-11T10:03:48,811           to the `packages` configuration field.

2025-06-11T10:03:48,812           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,813           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,814           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,815           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,816           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,817           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2025-06-11T10:03:48,817           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2025-06-11T10:03:48,818           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,818           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,819           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,821           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,822           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,823           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,824                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,824                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,825                 directory, all directories are treated like packages.
2025-06-11T10:03:48,826           ********************************************************************************

2025-06-11T10:03:48,827   !!
2025-06-11T10:03:48,827     check.warn(importable)
2025-06-11T10:03:48,828   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2025-06-11T10:03:48,829   !!

2025-06-11T10:03:48,830           ********************************************************************************
2025-06-11T10:03:48,830           ############################
2025-06-11T10:03:48,831           # Package would be ignored #
2025-06-11T10:03:48,832           ############################
2025-06-11T10:03:48,832           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2025-06-11T10:03:48,833           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,834           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,835           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2025-06-11T10:03:48,835           to the `packages` configuration field.

2025-06-11T10:03:48,837           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,837           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,838           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,839           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,840           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,841           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2025-06-11T10:03:48,842           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2025-06-11T10:03:48,842           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,843           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,843           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,844           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,845           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,847           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,847                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,848                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,848                 directory, all directories are treated like packages.
2025-06-11T10:03:48,849           ********************************************************************************

2025-06-11T10:03:48,850   !!
2025-06-11T10:03:48,851     check.warn(importable)
2025-06-11T10:03:48,851   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2025-06-11T10:03:48,852   !!

2025-06-11T10:03:48,853           ********************************************************************************
2025-06-11T10:03:48,854           ############################
2025-06-11T10:03:48,854           # Package would be ignored #
2025-06-11T10:03:48,855           ############################
2025-06-11T10:03:48,855           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2025-06-11T10:03:48,856           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,857           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,858           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2025-06-11T10:03:48,858           to the `packages` configuration field.

2025-06-11T10:03:48,860           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,860           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,861           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,862           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,863           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,864           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2025-06-11T10:03:48,865           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2025-06-11T10:03:48,866           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,866           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,867           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,868           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,869           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,871           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,872                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,872                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,873                 directory, all directories are treated like packages.
2025-06-11T10:03:48,873           ********************************************************************************

2025-06-11T10:03:48,875   !!
2025-06-11T10:03:48,875     check.warn(importable)
2025-06-11T10:03:48,875   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2025-06-11T10:03:48,876   !!

2025-06-11T10:03:48,877           ********************************************************************************
2025-06-11T10:03:48,877           ############################
2025-06-11T10:03:48,878           # Package would be ignored #
2025-06-11T10:03:48,878           ############################
2025-06-11T10:03:48,879           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2025-06-11T10:03:48,879           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,880           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,881           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2025-06-11T10:03:48,881           to the `packages` configuration field.

2025-06-11T10:03:48,882           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,883           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,884           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,885           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,886           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,887           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2025-06-11T10:03:48,888           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2025-06-11T10:03:48,888           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,889           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,890           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,891           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,892           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,894           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,894                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,895                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,895                 directory, all directories are treated like packages.
2025-06-11T10:03:48,896           ********************************************************************************

2025-06-11T10:03:48,897   !!
2025-06-11T10:03:48,898     check.warn(importable)
2025-06-11T10:03:48,898   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2025-06-11T10:03:48,899   !!

2025-06-11T10:03:48,900           ********************************************************************************
2025-06-11T10:03:48,901           ############################
2025-06-11T10:03:48,901           # Package would be ignored #
2025-06-11T10:03:48,902           ############################
2025-06-11T10:03:48,902           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2025-06-11T10:03:48,903           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,905           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,905           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2025-06-11T10:03:48,906           to the `packages` configuration field.

2025-06-11T10:03:48,907           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,907           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,908           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,909           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,910           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,911           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2025-06-11T10:03:48,912           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2025-06-11T10:03:48,912           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,913           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,913           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,914           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,917           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,918           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,920                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,920                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,921                 directory, all directories are treated like packages.
2025-06-11T10:03:48,921           ********************************************************************************

2025-06-11T10:03:48,922   !!
2025-06-11T10:03:48,923     check.warn(importable)
2025-06-11T10:03:48,923   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2025-06-11T10:03:48,924   !!

2025-06-11T10:03:48,925           ********************************************************************************
2025-06-11T10:03:48,926           ############################
2025-06-11T10:03:48,926           # Package would be ignored #
2025-06-11T10:03:48,927           ############################
2025-06-11T10:03:48,927           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2025-06-11T10:03:48,928           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,929           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,930           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2025-06-11T10:03:48,930           to the `packages` configuration field.

2025-06-11T10:03:48,932           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,932           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,933           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,934           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,935           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,937           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2025-06-11T10:03:48,937           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2025-06-11T10:03:48,938           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,939           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,939           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,940           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,941           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,943           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,943                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,944                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,944                 directory, all directories are treated like packages.
2025-06-11T10:03:48,945           ********************************************************************************

2025-06-11T10:03:48,946   !!
2025-06-11T10:03:48,947     check.warn(importable)
2025-06-11T10:03:48,947   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2025-06-11T10:03:48,948   !!

2025-06-11T10:03:48,949           ********************************************************************************
2025-06-11T10:03:48,950           ############################
2025-06-11T10:03:48,950           # Package would be ignored #
2025-06-11T10:03:48,950           ############################
2025-06-11T10:03:48,951           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2025-06-11T10:03:48,952           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,953           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,953           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2025-06-11T10:03:48,954           to the `packages` configuration field.

2025-06-11T10:03:48,955           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,956           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,956           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,957           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,960           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,961           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2025-06-11T10:03:48,961           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2025-06-11T10:03:48,962           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,962           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,964           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,965           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,966           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,968           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,968                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,969                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,969                 directory, all directories are treated like packages.
2025-06-11T10:03:48,971           ********************************************************************************

2025-06-11T10:03:48,972   !!
2025-06-11T10:03:48,973     check.warn(importable)
2025-06-11T10:03:48,974   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2025-06-11T10:03:48,975   !!

2025-06-11T10:03:48,976           ********************************************************************************
2025-06-11T10:03:48,976           ############################
2025-06-11T10:03:48,977           # Package would be ignored #
2025-06-11T10:03:48,978           ############################
2025-06-11T10:03:48,979           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2025-06-11T10:03:48,979           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:48,980           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:48,981           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2025-06-11T10:03:48,981           to the `packages` configuration field.

2025-06-11T10:03:48,982           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:48,983           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:48,984           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:48,985           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:48,986           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:48,986           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2025-06-11T10:03:48,987           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2025-06-11T10:03:48,987           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:48,988           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:48,989           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:48,990           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:48,991           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:48,993           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:48,993                 even if it does not contain any `.py` files.
2025-06-11T10:03:48,994                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:48,994                 directory, all directories are treated like packages.
2025-06-11T10:03:48,995           ********************************************************************************

2025-06-11T10:03:48,996   !!
2025-06-11T10:03:48,996     check.warn(importable)
2025-06-11T10:03:48,997   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2025-06-11T10:03:48,998   !!

2025-06-11T10:03:48,999           ********************************************************************************
2025-06-11T10:03:49,000           ############################
2025-06-11T10:03:49,000           # Package would be ignored #
2025-06-11T10:03:49,001           ############################
2025-06-11T10:03:49,001           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2025-06-11T10:03:49,002           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:49,003           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:49,004           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2025-06-11T10:03:49,004           to the `packages` configuration field.

2025-06-11T10:03:49,006           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:49,006           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:49,007           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:49,008           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:49,009           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:49,010           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2025-06-11T10:03:49,011           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2025-06-11T10:03:49,011           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:49,012           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:49,012           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:49,013           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:49,014           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:49,016           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:49,016                 even if it does not contain any `.py` files.
2025-06-11T10:03:49,017                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:49,017                 directory, all directories are treated like packages.
2025-06-11T10:03:49,018           ********************************************************************************

2025-06-11T10:03:49,019   !!
2025-06-11T10:03:49,019     check.warn(importable)
2025-06-11T10:03:49,020   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2025-06-11T10:03:49,020   !!

2025-06-11T10:03:49,022           ********************************************************************************
2025-06-11T10:03:49,022           ############################
2025-06-11T10:03:49,023           # Package would be ignored #
2025-06-11T10:03:49,023           ############################
2025-06-11T10:03:49,024           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2025-06-11T10:03:49,024           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:49,026           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:49,026           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2025-06-11T10:03:49,027           to the `packages` configuration field.

2025-06-11T10:03:49,028           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:49,029           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:49,029           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:49,030           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:49,031           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:49,033           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2025-06-11T10:03:49,033           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2025-06-11T10:03:49,034           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:49,034           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:49,035           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:49,036           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:49,037           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:49,039           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:49,040                 even if it does not contain any `.py` files.
2025-06-11T10:03:49,040                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:49,041                 directory, all directories are treated like packages.
2025-06-11T10:03:49,042           ********************************************************************************

2025-06-11T10:03:49,043   !!
2025-06-11T10:03:49,043     check.warn(importable)
2025-06-11T10:03:49,044   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2025-06-11T10:03:49,044   !!

2025-06-11T10:03:49,045           ********************************************************************************
2025-06-11T10:03:49,046           ############################
2025-06-11T10:03:49,046           # Package would be ignored #
2025-06-11T10:03:49,047           ############################
2025-06-11T10:03:49,048           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2025-06-11T10:03:49,048           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:49,049           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:49,050           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2025-06-11T10:03:49,050           to the `packages` configuration field.

2025-06-11T10:03:49,051           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:49,052           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:49,053           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:49,054           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:49,055           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:49,056           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2025-06-11T10:03:49,057           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2025-06-11T10:03:49,057           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:49,058           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:49,059           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:49,060           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:49,061           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:49,063           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:49,063                 even if it does not contain any `.py` files.
2025-06-11T10:03:49,064                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:49,065                 directory, all directories are treated like packages.
2025-06-11T10:03:49,065           ********************************************************************************

2025-06-11T10:03:49,066   !!
2025-06-11T10:03:49,067     check.warn(importable)
2025-06-11T10:03:49,067   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2025-06-11T10:03:49,068   !!

2025-06-11T10:03:49,069           ********************************************************************************
2025-06-11T10:03:49,070           ############################
2025-06-11T10:03:49,071           # Package would be ignored #
2025-06-11T10:03:49,071           ############################
2025-06-11T10:03:49,072           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2025-06-11T10:03:49,072           but it is absent from setuptools' `packages` configuration.

2025-06-11T10:03:49,074           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-11T10:03:49,074           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2025-06-11T10:03:49,075           to the `packages` configuration field.

2025-06-11T10:03:49,076           Alternatively, you can also rely on setuptools' discovery methods
2025-06-11T10:03:49,076           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-11T10:03:49,077           instead of `find_packages(...)`/`find:`).

2025-06-11T10:03:49,078           You can read more about "package discovery" on setuptools documentation page:

2025-06-11T10:03:49,079           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-11T10:03:49,080           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2025-06-11T10:03:49,080           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2025-06-11T10:03:49,081           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-11T10:03:49,081           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-11T10:03:49,082           combination with a more fine grained `package-data` configuration.

2025-06-11T10:03:49,083           You can read more about "package data files" on setuptools documentation page:

2025-06-11T10:03:49,084           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-11T10:03:49,086           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-11T10:03:49,087                 even if it does not contain any `.py` files.
2025-06-11T10:03:49,087                 On the other hand, currently there is no concept of package data
2025-06-11T10:03:49,088                 directory, all directories are treated like packages.
2025-06-11T10:03:49,088           ********************************************************************************

2025-06-11T10:03:49,089   !!
2025-06-11T10:03:49,090     check.warn(importable)
2025-06-11T10:03:49,091   creating build/lib/deepspeed/autotuning/config_templates
2025-06-11T10:03:49,091   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-11T10:03:49,092   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-11T10:03:49,092   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-11T10:03:49,093   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-11T10:03:49,094   creating build/lib/deepspeed/ops/csrc/adagrad
2025-06-11T10:03:49,094   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2025-06-11T10:03:49,095   creating build/lib/deepspeed/ops/csrc/adam
2025-06-11T10:03:49,095   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-11T10:03:49,096   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-11T10:03:49,097   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-11T10:03:49,097   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2025-06-11T10:03:49,098   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2025-06-11T10:03:49,098   creating build/lib/deepspeed/ops/csrc/aio/common
2025-06-11T10:03:49,099   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-11T10:03:49,100   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-11T10:03:49,100   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-11T10:03:49,101   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-11T10:03:49,102   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-11T10:03:49,103   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-11T10:03:49,103   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,104   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,104   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,105   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,105   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,106   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,106   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,107   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,107   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,108   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,109   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,109   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,110   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,110   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,111   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,111   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,112   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,112   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:49,113   creating build/lib/deepspeed/ops/csrc/aio/py_test
2025-06-11T10:03:49,113   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2025-06-11T10:03:49,114   creating build/lib/deepspeed/ops/csrc/compile
2025-06-11T10:03:49,115   copying deepspeed/ops/csrc/compile/deepcompile.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-11T10:03:49,115   copying deepspeed/ops/csrc/compile/init.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-11T10:03:49,116   copying deepspeed/ops/csrc/compile/util.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-11T10:03:49,116   copying deepspeed/ops/csrc/compile/z1.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-11T10:03:49,117   copying deepspeed/ops/csrc/compile/z1.h -> build/lib/deepspeed/ops/csrc/compile
2025-06-11T10:03:49,117   copying deepspeed/ops/csrc/compile/z3.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-11T10:03:49,118   copying deepspeed/ops/csrc/compile/z3.h -> build/lib/deepspeed/ops/csrc/compile
2025-06-11T10:03:49,118   creating build/lib/deepspeed/ops/csrc/cpu/adam
2025-06-11T10:03:49,119   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2025-06-11T10:03:49,120   creating build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-11T10:03:49,120   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-11T10:03:49,121   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-11T10:03:49,122   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-11T10:03:49,122   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-11T10:03:49,123   creating build/lib/deepspeed/ops/csrc/cpu/lion
2025-06-11T10:03:49,123   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2025-06-11T10:03:49,124   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-11T10:03:49,124   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-11T10:03:49,125   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-11T10:03:49,125   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-11T10:03:49,126   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-11T10:03:49,126   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-11T10:03:49,127   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-11T10:03:49,127   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-11T10:03:49,128   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-11T10:03:49,128   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-11T10:03:49,129   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-11T10:03:49,130   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-11T10:03:49,130   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-11T10:03:49,131   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-11T10:03:49,131   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-11T10:03:49,132   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-11T10:03:49,133   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-11T10:03:49,133   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-11T10:03:49,134   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-11T10:03:49,134   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-11T10:03:49,135   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-11T10:03:49,135   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-11T10:03:49,136   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-11T10:03:49,137   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-11T10:03:49,137   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-11T10:03:49,138   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-11T10:03:49,138   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-11T10:03:49,139   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-11T10:03:49,140   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-11T10:03:49,141   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-11T10:03:49,141   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-11T10:03:49,142   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-11T10:03:49,142   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-11T10:03:49,143   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-11T10:03:49,144   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-11T10:03:49,144   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-11T10:03:49,145   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-11T10:03:49,145   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-11T10:03:49,146   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-11T10:03:49,147   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-11T10:03:49,147   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-11T10:03:49,148   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-11T10:03:49,148   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-11T10:03:49,149   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-11T10:03:49,150   creating build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,150   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,151   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,151   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,152   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,153   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,153   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,154   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,155   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,155   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,156   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,156   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,157   copying deepspeed/ops/csrc/includes/deepcompile.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,158   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,158   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,159   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,159   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,160   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,160   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,161   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,161   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,162   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,162   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,163   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,164   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,164   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,165   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,166   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,166   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,167   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,167   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-11T10:03:49,168   creating build/lib/deepspeed/ops/csrc/lamb
2025-06-11T10:03:49,168   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2025-06-11T10:03:49,169   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2025-06-11T10:03:49,170   creating build/lib/deepspeed/ops/csrc/lion
2025-06-11T10:03:49,170   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-11T10:03:49,171   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-11T10:03:49,171   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-11T10:03:49,172   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2025-06-11T10:03:49,172   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2025-06-11T10:03:49,173   creating build/lib/deepspeed/ops/csrc/quantization
2025-06-11T10:03:49,174   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-11T10:03:49,174   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-11T10:03:49,175   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2025-06-11T10:03:49,175   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-11T10:03:49,176   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-11T10:03:49,177   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-11T10:03:49,177   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-11T10:03:49,178   creating build/lib/deepspeed/ops/csrc/random_ltd
2025-06-11T10:03:49,178   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-11T10:03:49,179   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-11T10:03:49,179   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-11T10:03:49,180   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-11T10:03:49,180   creating build/lib/deepspeed/ops/csrc/sparse_attention
2025-06-11T10:03:49,181   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2025-06-11T10:03:49,181   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-11T10:03:49,182   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-11T10:03:49,183   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-11T10:03:49,183   creating build/lib/deepspeed/ops/csrc/spatial/includes
2025-06-11T10:03:49,184   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2025-06-11T10:03:49,186   creating build/lib/deepspeed/ops/csrc/transformer
2025-06-11T10:03:49,187   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-11T10:03:49,191   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-11T10:03:49,194   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2025-06-11T10:03:49,197   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-11T10:03:49,200   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-11T10:03:49,203   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-11T10:03:49,206   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-11T10:03:49,209   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-11T10:03:49,212   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:49,214   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:49,217   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:49,219   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:49,222   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:49,225   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:49,228   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:49,232   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:49,234   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:49,237   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:49,240   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:49,243   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-11T10:03:49,244   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-11T10:03:49,246   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-11T10:03:49,249   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-11T10:03:49,252   creating build/lib/deepspeed/ops/csrc/utils
2025-06-11T10:03:49,253   copying deepspeed/ops/csrc/utils/py_ds_utils.cpp -> build/lib/deepspeed/ops/csrc/utils
2025-06-11T10:03:49,255   copying deepspeed/ops/csrc/utils/tensor_cast.cpp -> build/lib/deepspeed/ops/csrc/utils
2025-06-11T10:03:49,257   copying deepspeed/ops/csrc/utils/tensor_cast.h -> build/lib/deepspeed/ops/csrc/utils
2025-06-11T10:03:49,259   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-06-11T10:03:49,261   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-06-11T10:03:49,264   creating build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-11T10:03:49,265   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-11T10:03:49,267   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-11T10:03:49,269   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-11T10:03:49,272   creating build/lib/deepspeed/ops/csrc/xpu/common
2025-06-11T10:03:49,273   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2025-06-11T10:03:49,275   creating build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-11T10:03:49,276   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-11T10:03:49,279   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-11T10:03:49,281   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-11T10:03:49,284   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-11T10:03:49,287   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-11T10:03:49,289   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2025-06-11T10:03:49,290   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2025-06-11T10:03:49,293   creating build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-11T10:03:49,294   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-11T10:03:49,296   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-11T10:03:49,298   creating build/lib/deepspeed/inference/v2/ragged/includes
2025-06-11T10:03:49,299   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2025-06-11T10:03:49,301   creating build/lib/deepspeed/inference/v2/kernels/includes
2025-06-11T10:03:49,302   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-11T10:03:49,305   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-11T10:03:49,308   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-11T10:03:49,310   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-11T10:03:49,313   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-11T10:03:49,316   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-11T10:03:49,318   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-11T10:03:49,319   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-11T10:03:49,322   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-11T10:03:49,324   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-11T10:03:49,325   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-11T10:03:49,327   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-11T10:03:49,328   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-11T10:03:49,330   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-11T10:03:49,333   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-11T10:03:49,335   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-11T10:03:49,337   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-11T10:03:49,340   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-11T10:03:49,342   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-11T10:03:49,344   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-11T10:03:49,347   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-11T10:03:49,349   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-11T10:03:49,351   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-11T10:03:49,353   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-11T10:03:49,356   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-11T10:03:49,358   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-11T10:03:49,360   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-11T10:03:49,362   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-11T10:03:49,365   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-11T10:03:49,367   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-11T10:03:49,369   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-11T10:03:49,372   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-11T10:03:49,374   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-11T10:03:49,376   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-11T10:03:49,379   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-11T10:03:49,381   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-11T10:03:49,384   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-11T10:03:49,386   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-11T10:03:49,388   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-11T10:03:49,390   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-11T10:03:49,393   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-11T10:03:49,395   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-11T10:03:49,398   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-11T10:03:49,400   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-11T10:03:49,403   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:49,405   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:49,408   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:49,410   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:49,413   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-11T10:03:49,415   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-11T10:03:49,418   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-11T10:03:49,420   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-11T10:03:49,423   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:49,425   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:49,427   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:49,430   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-11T10:03:49,433   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-11T10:03:49,436   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-11T10:03:49,438   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-11T10:03:49,440   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-11T10:03:49,443   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-11T10:03:49,446   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-11T10:03:49,448   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-11T10:03:49,451   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-11T10:03:49,453   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:49,454   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:49,457   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:49,460   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:49,462   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:49,464   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:49,467   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:49,470   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:49,472   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:49,474   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:49,477   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-11T10:03:49,480   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-11T10:03:49,482   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-11T10:03:49,484   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-11T10:03:49,487   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-11T10:03:49,489   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-11T10:03:49,492   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-11T10:03:49,494   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-11T10:03:49,497   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-11T10:03:49,558   running build_scripts
2025-06-11T10:03:49,559   creating build/scripts-3.11
2025-06-11T10:03:49,560   copying and adjusting bin/deepspeed -> build/scripts-3.11
2025-06-11T10:03:49,562   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2025-06-11T10:03:49,563   copying and adjusting bin/ds -> build/scripts-3.11
2025-06-11T10:03:49,565   copying bin/ds_ssh -> build/scripts-3.11
2025-06-11T10:03:49,567   copying and adjusting bin/ds_report -> build/scripts-3.11
2025-06-11T10:03:49,568   copying and adjusting bin/ds_bench -> build/scripts-3.11
2025-06-11T10:03:49,570   copying and adjusting bin/dsr -> build/scripts-3.11
2025-06-11T10:03:49,571   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2025-06-11T10:03:49,573   copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11
2025-06-11T10:03:49,575   copying and adjusting bin/ds_io -> build/scripts-3.11
2025-06-11T10:03:49,575   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2025-06-11T10:03:49,576   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2025-06-11T10:03:49,577   changing mode of build/scripts-3.11/ds from 644 to 755
2025-06-11T10:03:49,577   changing mode of build/scripts-3.11/ds_report from 644 to 755
2025-06-11T10:03:49,578   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2025-06-11T10:03:49,578   changing mode of build/scripts-3.11/dsr from 644 to 755
2025-06-11T10:03:49,579   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2025-06-11T10:03:49,580   changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755
2025-06-11T10:03:49,580   changing mode of build/scripts-3.11/ds_io from 644 to 755
2025-06-11T10:03:49,608   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2025-06-11T10:03:49,608   !!

2025-06-11T10:03:49,610           ********************************************************************************
2025-06-11T10:03:49,610           Please avoid running ``setup.py`` directly.
2025-06-11T10:03:49,611           Instead, use pypa/build, pypa/installer or other
2025-06-11T10:03:49,611           standards-based tools.

2025-06-11T10:03:49,613           By 2025-Oct-31, you need to update your project and remove deprecated calls
2025-06-11T10:03:49,613           or your builds will no longer be supported.

2025-06-11T10:03:49,614           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2025-06-11T10:03:49,615           ********************************************************************************

2025-06-11T10:03:49,616   !!
2025-06-11T10:03:49,617     self.initialize_options()
2025-06-11T10:03:49,637   installing to build/bdist.linux-armv7l/wheel
2025-06-11T10:03:49,637   running install
2025-06-11T10:03:49,661   running install_lib
2025-06-11T10:03:49,689   creating build/bdist.linux-armv7l/wheel
2025-06-11T10:03:49,692   creating build/bdist.linux-armv7l/wheel/deepspeed
2025-06-11T10:03:49,694   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2025-06-11T10:03:49,695   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-11T10:03:49,697   copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-11T10:03:49,700   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-11T10:03:49,702   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-11T10:03:49,705   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2025-06-11T10:03:49,706   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,708   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,711   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,713   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,714   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,716   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,719   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,721   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,723   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,725   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,727   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,730   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,732   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,735   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,737   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,739   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,741   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,744   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-11T10:03:49,747   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2025-06-11T10:03:49,748   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-11T10:03:49,750   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-11T10:03:49,752   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-11T10:03:49,755   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-11T10:03:49,757   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-11T10:03:49,760   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2025-06-11T10:03:49,761   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,763   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,765   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,768   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,770   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,772   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,775   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,777   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,779   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,781   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,783   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,785   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,787   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,790   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,792   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,794   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,797   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2025-06-11T10:03:49,798   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-11T10:03:49,800   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-11T10:03:49,803   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-11T10:03:49,805   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-11T10:03:49,807   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-11T10:03:49,809   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-11T10:03:49,811   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-11T10:03:49,813   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,816   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,818   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-11T10:03:49,820   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-11T10:03:49,822   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-11T10:03:49,824   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-11T10:03:49,827   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-11T10:03:49,828   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-11T10:03:49,831   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-11T10:03:49,833   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-11T10:03:49,835   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-11T10:03:49,838   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2025-06-11T10:03:49,839   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:49,842   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2025-06-11T10:03:49,844   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-11T10:03:49,848   copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-11T10:03:49,850   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-11T10:03:49,852   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-11T10:03:49,855   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-11T10:03:49,857   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-11T10:03:49,860   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-11T10:03:49,862   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-11T10:03:49,865   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-11T10:03:49,867   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-11T10:03:49,870   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-11T10:03:49,872   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-11T10:03:49,874   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-11T10:03:49,876   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-11T10:03:49,881   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-11T10:03:49,884   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-11T10:03:49,887   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-11T10:03:49,892   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/model_checkpointing
2025-06-11T10:03:49,893   copying build/lib/deepspeed/runtime/model_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2025-06-11T10:03:49,895   copying build/lib/deepspeed/runtime/model_checkpointing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2025-06-11T10:03:49,897   copying build/lib/deepspeed/runtime/model_checkpointing/writer_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2025-06-11T10:03:49,899   copying build/lib/deepspeed/runtime/model_checkpointing/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2025-06-11T10:03:49,901   copying build/lib/deepspeed/runtime/model_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2025-06-11T10:03:49,903   copying build/lib/deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2025-06-11T10:03:49,906   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2025-06-11T10:03:49,907   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-11T10:03:49,910   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-11T10:03:49,912   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-11T10:03:49,914   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-11T10:03:49,917   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-11T10:03:49,919   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-11T10:03:49,921   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-11T10:03:49,922   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-11T10:03:49,925   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-11T10:03:49,927   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:49,929   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:49,932   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2025-06-11T10:03:49,933   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-11T10:03:49,936   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-11T10:03:49,939   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-11T10:03:49,941   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-11T10:03:49,945   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-11T10:03:49,946   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-11T10:03:49,949   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:49,952   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:49,956   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/sequence_parallel
2025-06-11T10:03:49,956   copying build/lib/deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel
2025-06-11T10:03:49,960   copying build/lib/deepspeed/runtime/sequence_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel
2025-06-11T10:03:49,962   copying build/lib/deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel
2025-06-11T10:03:49,964   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:49,966   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:49,969   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:49,971   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:49,974   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino
2025-06-11T10:03:49,975   copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-11T10:03:49,978   copying build/lib/deepspeed/runtime/domino/async_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-11T10:03:49,981   copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-11T10:03:49,983   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:49,989   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2025-06-11T10:03:49,990   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-11T10:03:49,993   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-11T10:03:49,996   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2025-06-11T10:03:49,997   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-11T10:03:50,000   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-11T10:03:50,003   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-11T10:03:50,007   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-11T10:03:50,009   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-11T10:03:50,011   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-11T10:03:50,014   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-11T10:03:50,017   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-11T10:03:50,019   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2025-06-11T10:03:50,021   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-11T10:03:50,023   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-11T10:03:50,025   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-11T10:03:50,027   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-11T10:03:50,029   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-11T10:03:50,031   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:50,034   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:50,036   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2025-06-11T10:03:50,038   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-11T10:03:50,040   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-11T10:03:50,043   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-11T10:03:50,044   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-11T10:03:50,048   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2025-06-11T10:03:50,049   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-11T10:03:50,052   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-11T10:03:50,054   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-11T10:03:50,057   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-11T10:03:50,059   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:50,063   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2025-06-11T10:03:50,064   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-11T10:03:50,066   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-11T10:03:50,069   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-11T10:03:50,071   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-11T10:03:50,074   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-11T10:03:50,076   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-11T10:03:50,078   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:50,081   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/tensor_parallel
2025-06-11T10:03:50,083   copying build/lib/deepspeed/runtime/tensor_parallel/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-11T10:03:50,085   copying build/lib/deepspeed/runtime/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-11T10:03:50,087   copying build/lib/deepspeed/runtime/tensor_parallel/tp_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-11T10:03:50,089   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:50,091   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:50,093   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:50,096   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2025-06-11T10:03:50,097   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-11T10:03:50,099   copying build/lib/deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-11T10:03:50,101   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-11T10:03:50,104   copying build/lib/deepspeed/runtime/checkpoint_engine/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-11T10:03:50,106   copying build/lib/deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-11T10:03:50,108   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-11T10:03:50,110   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-11T10:03:50,112   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:50,115   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2025-06-11T10:03:50,116   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-06-11T10:03:50,118   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-06-11T10:03:50,120   copying build/lib/deepspeed/runtime/precision_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-11T10:03:50,122   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2025-06-11T10:03:50,123   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-11T10:03:50,127   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-11T10:03:50,129   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-11T10:03:50,131   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2025-06-11T10:03:50,132   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-11T10:03:50,135   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-11T10:03:50,137   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-11T10:03:50,139   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-11T10:03:50,141   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-11T10:03:50,143   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2025-06-11T10:03:50,144   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-11T10:03:50,147   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-11T10:03:50,149   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-11T10:03:50,151   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-11T10:03:50,153   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-11T10:03:50,155   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-11T10:03:50,158   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2025-06-11T10:03:50,159   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-11T10:03:50,162   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2025-06-11T10:03:50,163   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-06-11T10:03:50,165   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-06-11T10:03:50,168   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-11T10:03:50,170   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-11T10:03:50,172   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2025-06-11T10:03:50,173   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2025-06-11T10:03:50,175   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2025-06-11T10:03:50,177   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2025-06-11T10:03:50,178   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-11T10:03:50,181   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-11T10:03:50,183   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-11T10:03:50,185   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2025-06-11T10:03:50,187   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-11T10:03:50,189   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-11T10:03:50,191   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-11T10:03:50,193   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-11T10:03:50,195   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-11T10:03:50,197   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-11T10:03:50,199   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-11T10:03:50,201   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-11T10:03:50,203   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-11T10:03:50,205   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-11T10:03:50,207   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2025-06-11T10:03:50,209   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2025-06-11T10:03:50,210   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-06-11T10:03:50,212   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-06-11T10:03:50,214   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2025-06-11T10:03:50,215   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-11T10:03:50,218   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-11T10:03:50,221   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2025-06-11T10:03:50,222   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-11T10:03:50,224   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-11T10:03:50,227   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-11T10:03:50,229   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-11T10:03:50,231   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-11T10:03:50,233   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2025-06-11T10:03:50,234   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-11T10:03:50,237   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2025-06-11T10:03:50,238   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-11T10:03:50,240   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-11T10:03:50,243   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2025-06-11T10:03:50,244   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2025-06-11T10:03:50,247   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2025-06-11T10:03:50,248   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-06-11T10:03:50,250   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-06-11T10:03:50,252   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-11T10:03:50,255   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-11T10:03:50,257   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-11T10:03:50,260   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-11T10:03:50,262   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-11T10:03:50,264   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2025-06-11T10:03:50,266   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:50,267   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:50,269   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:50,271   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:50,273   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:50,275   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:50,277   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:50,279   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:50,281   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-11T10:03:50,283   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2025-06-11T10:03:50,284   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-11T10:03:50,286   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-11T10:03:50,288   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-11T10:03:50,290   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-11T10:03:50,292   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-11T10:03:50,294   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-11T10:03:50,296   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-11T10:03:50,298   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-11T10:03:50,301   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-11T10:03:50,303   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-11T10:03:50,306   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2025-06-11T10:03:50,307   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2025-06-11T10:03:50,309   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-11T10:03:50,312   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-11T10:03:50,313   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-11T10:03:50,316   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2025-06-11T10:03:50,317   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-06-11T10:03:50,320   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-06-11T10:03:50,322   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-11T10:03:50,323   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-11T10:03:50,325   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-11T10:03:50,327   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-11T10:03:50,330   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2025-06-11T10:03:50,331   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-06-11T10:03:50,333   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-06-11T10:03:50,335   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2025-06-11T10:03:50,336   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-06-11T10:03:50,339   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-06-11T10:03:50,341   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2025-06-11T10:03:50,343   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-11T10:03:50,344   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-06-11T10:03:50,347   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-06-11T10:03:50,349   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2025-06-11T10:03:50,350   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-06-11T10:03:50,353   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-06-11T10:03:50,355   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-11T10:03:50,357   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-11T10:03:50,358   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-11T10:03:50,361   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2025-06-11T10:03:50,363   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2025-06-11T10:03:50,364   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-11T10:03:50,366   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-11T10:03:50,368   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-11T10:03:50,370   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-11T10:03:50,373   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:50,374   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:50,376   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:50,378   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:50,380   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:50,382   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:50,385   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:50,387   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:50,389   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:50,391   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-11T10:03:50,393   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2025-06-11T10:03:50,394   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-11T10:03:50,397   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-11T10:03:50,399   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-11T10:03:50,401   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-11T10:03:50,404   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:50,404   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:50,406   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:50,408   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:50,410   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:50,412   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:50,414   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:50,416   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:50,418   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:50,420   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-11T10:03:50,422   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2025-06-11T10:03:50,423   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-11T10:03:50,426   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-11T10:03:50,428   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-11T10:03:50,430   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-11T10:03:50,432   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-11T10:03:50,433   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-11T10:03:50,436   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-11T10:03:50,438   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-11T10:03:50,440   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-11T10:03:50,442   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-11T10:03:50,445   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2025-06-11T10:03:50,446   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-11T10:03:50,449   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-11T10:03:50,451   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-11T10:03:50,452   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-11T10:03:50,455   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2025-06-11T10:03:50,456   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-11T10:03:50,458   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-11T10:03:50,460   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-11T10:03:50,462   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-11T10:03:50,464   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-11T10:03:50,467   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-11T10:03:50,469   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-11T10:03:50,472   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2025-06-11T10:03:50,473   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-11T10:03:50,476   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-11T10:03:50,478   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-11T10:03:50,480   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-11T10:03:50,482   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-11T10:03:50,483   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-11T10:03:50,486   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-11T10:03:50,488   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-11T10:03:50,490   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-11T10:03:50,493   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2025-06-11T10:03:50,494   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-11T10:03:50,497   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-11T10:03:50,499   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-11T10:03:50,501   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-11T10:03:50,503   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-11T10:03:50,505   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-11T10:03:50,507   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-11T10:03:50,510   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-11T10:03:50,511   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-11T10:03:50,514   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-11T10:03:50,516   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-11T10:03:50,518   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-11T10:03:50,520   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-11T10:03:50,523   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2025-06-11T10:03:50,524   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-11T10:03:50,526   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-11T10:03:50,527   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-11T10:03:50,529   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-11T10:03:50,531   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-11T10:03:50,534   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-11T10:03:50,536   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-11T10:03:50,537   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-11T10:03:50,539   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-06-11T10:03:50,542   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-11T10:03:50,543   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-11T10:03:50,545   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-06-11T10:03:50,548   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-11T10:03:50,549   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-11T10:03:50,551   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-11T10:03:50,553   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-11T10:03:50,555   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-11T10:03:50,557   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-11T10:03:50,560   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2025-06-11T10:03:50,561   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-06-11T10:03:50,563   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-11T10:03:50,564   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-11T10:03:50,567   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-11T10:03:50,569   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-11T10:03:50,570   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-11T10:03:50,572   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-11T10:03:50,574   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-11T10:03:50,577   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-11T10:03:50,578   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-11T10:03:50,581   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-11T10:03:50,582   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-11T10:03:50,584   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-11T10:03:50,586   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-11T10:03:50,589   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-11T10:03:50,591   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-11T10:03:50,593   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-11T10:03:50,595   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-11T10:03:50,597   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-11T10:03:50,599   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-11T10:03:50,601   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-11T10:03:50,603   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-11T10:03:50,605   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-11T10:03:50,606   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-11T10:03:50,609   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-11T10:03:50,611   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-11T10:03:50,613   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-11T10:03:50,615   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-11T10:03:50,617   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-11T10:03:50,621   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-11T10:03:50,622   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-11T10:03:50,624   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-11T10:03:50,626   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-11T10:03:50,628   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-11T10:03:50,630   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-11T10:03:50,632   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-11T10:03:50,634   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-11T10:03:50,635   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-11T10:03:50,638   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-11T10:03:50,640   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-11T10:03:50,642   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-11T10:03:50,644   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-11T10:03:50,646   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-11T10:03:50,648   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-06-11T10:03:50,650   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:50,651   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:50,653   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:50,655   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:50,658   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:50,660   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:50,662   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:50,664   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:50,666   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-11T10:03:50,669   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-11T10:03:50,670   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-11T10:03:50,672   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-11T10:03:50,674   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-11T10:03:50,676   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-11T10:03:50,677   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-11T10:03:50,680   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-11T10:03:50,682   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-11T10:03:50,684   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-11T10:03:50,685   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-11T10:03:50,687   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-11T10:03:50,690   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2025-06-11T10:03:50,691   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-11T10:03:50,694   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-11T10:03:50,696   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-11T10:03:50,699   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-11T10:03:50,701   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-11T10:03:50,703   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-06-11T10:03:50,705   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-06-11T10:03:50,708   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2025-06-11T10:03:50,710   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:50,711   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:50,713   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:50,715   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:50,717   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:50,720   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:50,722   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:50,724   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:50,726   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-11T10:03:50,728   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-06-11T10:03:50,730   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-11T10:03:50,731   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-11T10:03:50,734   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-11T10:03:50,736   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-11T10:03:50,738   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-11T10:03:50,741   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-11T10:03:50,742   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-11T10:03:50,744   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-11T10:03:50,746   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-11T10:03:50,748   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-11T10:03:50,750   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-11T10:03:50,752   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-06-11T10:03:50,755   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-11T10:03:50,756   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-11T10:03:50,758   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-11T10:03:50,761   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-11T10:03:50,763   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-11T10:03:50,765   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-11T10:03:50,767   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-11T10:03:50,770   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:50,771   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:50,773   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:50,776   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:50,778   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:50,781   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:50,783   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:50,785   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:50,787   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:50,789   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-11T10:03:50,792   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-11T10:03:50,793   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-11T10:03:50,795   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-11T10:03:50,797   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-11T10:03:50,799   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-11T10:03:50,801   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-11T10:03:50,803   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-11T10:03:50,805   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-11T10:03:50,808   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-11T10:03:50,809   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-11T10:03:50,811   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-11T10:03:50,813   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-11T10:03:50,815   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-11T10:03:50,817   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-11T10:03:50,820   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-11T10:03:50,822   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2025-06-11T10:03:50,823   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-11T10:03:50,825   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-11T10:03:50,827   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-11T10:03:50,829   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-11T10:03:50,832   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-11T10:03:50,834   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-11T10:03:50,836   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-11T10:03:50,838   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-11T10:03:50,840   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-11T10:03:50,842   creating build/bdist.linux-armv7l/wheel/deepspeed/nvme
2025-06-11T10:03:50,844   copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-11T10:03:50,846   copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-11T10:03:50,848   copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-11T10:03:50,850   copying build/lib/deepspeed/nvme/io_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-11T10:03:50,852   copying build/lib/deepspeed/nvme/torch_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-11T10:03:50,854   copying build/lib/deepspeed/nvme/ds_aio_constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-11T10:03:50,856   copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-11T10:03:50,858   copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-11T10:03:50,861   copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-11T10:03:50,863   copying build/lib/deepspeed/nvme/torch_fastio_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-11T10:03:50,865   copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-11T10:03:50,866   copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-11T10:03:50,868   copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-11T10:03:50,870   copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-11T10:03:50,872   copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-11T10:03:50,874   copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-11T10:03:50,877   creating build/bdist.linux-armv7l/wheel/deepspeed/io
2025-06-11T10:03:50,879   copying build/lib/deepspeed/io/base_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-11T10:03:50,881   copying build/lib/deepspeed/io/py_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-11T10:03:50,883   copying build/lib/deepspeed/io/single_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-11T10:03:50,885   copying build/lib/deepspeed/io/base_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-11T10:03:50,887   copying build/lib/deepspeed/io/double_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-11T10:03:50,889   copying build/lib/deepspeed/io/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-11T10:03:50,890   copying build/lib/deepspeed/io/mock_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-11T10:03:50,892   copying build/lib/deepspeed/io/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-11T10:03:50,894   copying build/lib/deepspeed/io/fast_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-11T10:03:50,897   copying build/lib/deepspeed/io/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-11T10:03:50,900   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2025-06-11T10:03:50,901   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-11T10:03:50,903   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-11T10:03:50,905   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-11T10:03:50,907   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-11T10:03:50,909   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-11T10:03:50,911   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-11T10:03:50,913   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-11T10:03:50,915   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-11T10:03:50,917   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2025-06-11T10:03:50,918   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-11T10:03:50,920   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-11T10:03:50,923   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-11T10:03:50,925   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-11T10:03:50,927   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-11T10:03:50,930   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-11T10:03:50,932   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-11T10:03:50,934   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-11T10:03:50,936   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-11T10:03:50,939   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-11T10:03:50,941   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2025-06-11T10:03:50,942   copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-11T10:03:50,945   copying build/lib/deepspeed/accelerator/sdaa_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-11T10:03:50,947   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-11T10:03:50,950   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-11T10:03:50,952   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-11T10:03:50,954   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-11T10:03:50,957   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-11T10:03:50,959   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-11T10:03:50,962   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-11T10:03:50,964   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-11T10:03:50,966   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-11T10:03:50,969   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2025-06-11T10:03:50,970   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-11T10:03:50,973   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-11T10:03:50,976   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-11T10:03:50,978   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-11T10:03:50,981   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2025-06-11T10:03:50,982   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-11T10:03:50,984   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-11T10:03:50,986   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-11T10:03:50,988   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-11T10:03:50,990   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-11T10:03:50,992   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-11T10:03:50,994   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-11T10:03:50,997   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2025-06-11T10:03:50,998   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-11T10:03:51,000   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-11T10:03:51,002   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-11T10:03:51,004   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-11T10:03:51,006   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-11T10:03:51,008   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2025-06-11T10:03:51,010   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-11T10:03:51,012   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-11T10:03:51,014   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-11T10:03:51,016   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-11T10:03:51,018   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-11T10:03:51,021   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-11T10:03:51,023   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-11T10:03:51,025   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-11T10:03:51,027   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-11T10:03:51,030   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-11T10:03:51,032   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-11T10:03:51,035   creating build/bdist.linux-armv7l/wheel/deepspeed/compile
2025-06-11T10:03:51,036   copying build/lib/deepspeed/compile/inductor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-11T10:03:51,040   creating build/bdist.linux-armv7l/wheel/deepspeed/compile/profilers
2025-06-11T10:03:51,041   copying build/lib/deepspeed/compile/profilers/graph_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-11T10:03:51,043   copying build/lib/deepspeed/compile/profilers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-11T10:03:51,045   copying build/lib/deepspeed/compile/profilers/comm_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-11T10:03:51,047   copying build/lib/deepspeed/compile/fx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-11T10:03:51,050   copying build/lib/deepspeed/compile/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-11T10:03:51,052   copying build/lib/deepspeed/compile/list_schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-11T10:03:51,054   copying build/lib/deepspeed/compile/patch_fake_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-11T10:03:51,057   copying build/lib/deepspeed/compile/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-11T10:03:51,059   copying build/lib/deepspeed/compile/graph_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-11T10:03:51,061   copying build/lib/deepspeed/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-11T10:03:51,063   copying build/lib/deepspeed/compile/init_z1.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-11T10:03:51,065   copying build/lib/deepspeed/compile/partitioner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-11T10:03:51,067   copying build/lib/deepspeed/compile/init_z3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-11T10:03:51,069   copying build/lib/deepspeed/compile/patch_compiled_func.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-11T10:03:51,071   creating build/bdist.linux-armv7l/wheel/deepspeed/compile/passes
2025-06-11T10:03:51,072   copying build/lib/deepspeed/compile/passes/offload_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-11T10:03:51,074   copying build/lib/deepspeed/compile/passes/offload_adam_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-11T10:03:51,077   copying build/lib/deepspeed/compile/passes/selective_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-11T10:03:51,079   copying build/lib/deepspeed/compile/passes/zero1_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-11T10:03:51,081   copying build/lib/deepspeed/compile/passes/zero3_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-11T10:03:51,083   copying build/lib/deepspeed/compile/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-11T10:03:51,085   copying build/lib/deepspeed/compile/passes/offload_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-11T10:03:51,087   copying build/lib/deepspeed/compile/passes/prefetch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-11T10:03:51,090   copying build/lib/deepspeed/compile/util.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-11T10:03:51,092   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-11T10:03:51,094   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2025-06-11T10:03:51,095   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-11T10:03:51,098   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-11T10:03:51,101   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-11T10:03:51,103   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-11T10:03:51,105   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-11T10:03:51,106   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-11T10:03:51,110   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2025-06-11T10:03:51,111   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-11T10:03:51,113   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-11T10:03:51,116   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-11T10:03:51,117   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-11T10:03:51,119   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-11T10:03:51,121   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-11T10:03:51,124   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2025-06-11T10:03:51,125   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-11T10:03:51,127   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-11T10:03:51,129   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-11T10:03:51,132   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2025-06-11T10:03:51,133   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2025-06-11T10:03:51,134   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-11T10:03:51,137   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-11T10:03:51,139   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-11T10:03:51,141   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-11T10:03:51,143   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2025-06-11T10:03:51,144   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-11T10:03:51,147   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-11T10:03:51,149   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-11T10:03:51,151   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-11T10:03:51,153   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2025-06-11T10:03:51,154   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-11T10:03:51,157   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-11T10:03:51,159   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-11T10:03:51,161   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-11T10:03:51,163   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2025-06-11T10:03:51,164   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-06-11T10:03:51,166   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-06-11T10:03:51,169   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2025-06-11T10:03:51,170   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-06-11T10:03:51,172   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-06-11T10:03:51,175   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2025-06-11T10:03:51,176   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-06-11T10:03:51,178   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-06-11T10:03:51,181   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2025-06-11T10:03:51,182   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2025-06-11T10:03:51,184   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2025-06-11T10:03:51,185   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-06-11T10:03:51,187   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-06-11T10:03:51,189   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2025-06-11T10:03:51,190   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2025-06-11T10:03:51,193   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2025-06-11T10:03:51,194   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-06-11T10:03:51,197   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2025-06-11T10:03:51,198   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-11T10:03:51,200   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-11T10:03:51,202   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-11T10:03:51,204   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-11T10:03:51,206   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-11T10:03:51,209   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,210   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,212   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,215   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,217   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,219   copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,221   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,224   copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,226   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,227   copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,230   copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,232   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,234   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,236   copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,238   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,240   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,242   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,244   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,246   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,248   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,250   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,252   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,254   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,256   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-11T10:03:51,258   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-11T10:03:51,261   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-11T10:03:51,264   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-11T10:03:51,266   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-11T10:03:51,268   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-11T10:03:51,271   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:51,272   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:51,275   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:51,277   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:51,279   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:51,282   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:51,284   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:51,286   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:51,288   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:51,291   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:51,293   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-11T10:03:51,295   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-06-11T10:03:51,297   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2025-06-11T10:03:51,299   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2025-06-11T10:03:51,300   copying build/lib/deepspeed/ops/csrc/utils/py_ds_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2025-06-11T10:03:51,303   copying build/lib/deepspeed/ops/csrc/utils/tensor_cast.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2025-06-11T10:03:51,305   copying build/lib/deepspeed/ops/csrc/utils/tensor_cast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2025-06-11T10:03:51,307   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2025-06-11T10:03:51,308   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-11T10:03:51,311   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-11T10:03:51,312   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-11T10:03:51,315   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-11T10:03:51,317   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-11T10:03:51,319   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2025-06-11T10:03:51,320   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-06-11T10:03:51,323   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-11T10:03:51,324   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-06-11T10:03:51,327   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-06-11T10:03:51,329   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-06-11T10:03:51,332   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2025-06-11T10:03:51,333   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-11T10:03:51,335   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-11T10:03:51,337   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-11T10:03:51,339   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-11T10:03:51,341   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-11T10:03:51,344   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2025-06-11T10:03:51,346   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2025-06-11T10:03:51,349   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2025-06-11T10:03:51,352   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2025-06-11T10:03:51,353   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-11T10:03:51,355   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-11T10:03:51,357   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-11T10:03:51,360   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2025-06-11T10:03:51,361   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2025-06-11T10:03:51,364   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2025-06-11T10:03:51,365   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2025-06-11T10:03:51,368   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2025-06-11T10:03:51,369   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-11T10:03:51,371   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-11T10:03:51,373   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-11T10:03:51,376   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-11T10:03:51,378   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-11T10:03:51,380   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2025-06-11T10:03:51,382   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2025-06-11T10:03:51,385   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2025-06-11T10:03:51,386   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-11T10:03:51,388   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-11T10:03:51,391   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-11T10:03:51,393   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-11T10:03:51,396   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2025-06-11T10:03:51,397   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-11T10:03:51,399   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-11T10:03:51,402   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-11T10:03:51,403   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-11T10:03:51,408   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-11T10:03:51,410   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-11T10:03:51,413   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-11T10:03:51,416   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-11T10:03:51,418   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-11T10:03:51,420   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-11T10:03:51,424   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-11T10:03:51,427   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-11T10:03:51,428   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-11T10:03:51,430   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-11T10:03:51,433   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-11T10:03:51,435   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-11T10:03:51,438   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-11T10:03:51,442   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-11T10:03:51,444   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-11T10:03:51,447   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-11T10:03:51,451   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-11T10:03:51,453   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-11T10:03:51,456   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-11T10:03:51,457   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-11T10:03:51,460   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-11T10:03:51,462   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-11T10:03:51,464   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-11T10:03:51,467   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-11T10:03:51,469   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-11T10:03:51,472   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-11T10:03:51,474   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-11T10:03:51,477   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2025-06-11T10:03:51,478   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2025-06-11T10:03:51,480   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2025-06-11T10:03:51,482   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2025-06-11T10:03:51,484   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2025-06-11T10:03:51,487   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2025-06-11T10:03:51,488   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-11T10:03:51,491   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-11T10:03:51,494   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-11T10:03:51,498   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-11T10:03:51,504   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2025-06-11T10:03:51,507   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2025-06-11T10:03:51,510   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-11T10:03:51,515   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-11T10:03:51,520   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-11T10:03:51,525   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-11T10:03:51,529   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-11T10:03:51,533   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-11T10:03:51,536   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2025-06-11T10:03:51,538   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2025-06-11T10:03:51,539   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-11T10:03:51,541   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-11T10:03:51,544   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-11T10:03:51,546   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-11T10:03:51,548   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-11T10:03:51,550   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-11T10:03:51,552   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,553   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,555   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,557   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,559   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,561   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,563   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,565   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,567   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,569   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,571   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,573   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,575   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,577   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,579   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,581   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,583   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,585   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-11T10:03:51,587   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2025-06-11T10:03:51,588   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2025-06-11T10:03:51,591   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2025-06-11T10:03:51,592   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-11T10:03:51,595   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-11T10:03:51,597   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-11T10:03:51,600   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-11T10:03:51,602   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-11T10:03:51,605   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2025-06-11T10:03:51,606   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2025-06-11T10:03:51,608   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-11T10:03:51,610   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-11T10:03:51,612   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-11T10:03:51,616   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:51,617   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:51,620   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:51,622   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:51,624   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:51,626   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:51,629   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:51,631   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:51,635   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:51,637   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:51,639   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-11T10:03:51,642   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-11T10:03:51,645   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-11T10:03:51,649   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-11T10:03:51,652   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2025-06-11T10:03:51,653   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-11T10:03:51,656   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-11T10:03:51,659   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-11T10:03:51,660   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-11T10:03:51,663   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-11T10:03:51,665   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-11T10:03:51,668   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-11T10:03:51,671   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2025-06-11T10:03:51,672   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,674   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,676   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,679   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,681   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,683   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,684   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,686   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,689   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,691   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,693   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,695   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,697   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,699   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,702   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,704   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,706   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,708   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,710   copying build/lib/deepspeed/ops/csrc/includes/deepcompile.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,713   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,715   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,717   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,719   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,721   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,723   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,725   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,727   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,730   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,732   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,734   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-11T10:03:51,737   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2025-06-11T10:03:51,739   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2025-06-11T10:03:51,740   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2025-06-11T10:03:51,743   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2025-06-11T10:03:51,744   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-06-11T10:03:51,746   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-06-11T10:03:51,748   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2025-06-11T10:03:51,749   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2025-06-11T10:03:51,752   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/compile
2025-06-11T10:03:51,753   copying build/lib/deepspeed/ops/csrc/compile/z3.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-11T10:03:51,755   copying build/lib/deepspeed/ops/csrc/compile/z1.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-11T10:03:51,757   copying build/lib/deepspeed/ops/csrc/compile/z3.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-11T10:03:51,760   copying build/lib/deepspeed/ops/csrc/compile/deepcompile.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-11T10:03:51,762   copying build/lib/deepspeed/ops/csrc/compile/init.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-11T10:03:51,764   copying build/lib/deepspeed/ops/csrc/compile/z1.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-11T10:03:51,766   copying build/lib/deepspeed/ops/csrc/compile/util.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-11T10:03:51,769   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2025-06-11T10:03:51,770   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-06-11T10:03:51,772   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-06-11T10:03:51,775   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2025-06-11T10:03:51,776   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-11T10:03:51,779   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-11T10:03:51,782   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2025-06-11T10:03:51,783   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-11T10:03:51,785   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-11T10:03:51,787   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-11T10:03:51,789   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-11T10:03:51,791   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-11T10:03:51,792   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-11T10:03:51,795   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-11T10:03:51,797   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-11T10:03:51,800   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-11T10:03:51,802   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2025-06-11T10:03:51,804   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/compile
2025-06-11T10:03:51,805   copying build/lib/deepspeed/ops/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/compile
2025-06-11T10:03:51,808   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2025-06-11T10:03:51,809   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-06-11T10:03:51,810   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-06-11T10:03:51,814   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2025-06-11T10:03:51,815   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,817   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,818   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,821   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,822   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,824   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,827   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2025-06-11T10:03:51,828   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-11T10:03:51,830   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-11T10:03:51,832   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-11T10:03:51,834   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-11T10:03:51,835   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-11T10:03:51,837   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-11T10:03:51,839   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-11T10:03:51,841   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-11T10:03:51,842   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-11T10:03:51,844   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-11T10:03:51,846   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,848   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,850   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,852   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,854   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,856   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2025-06-11T10:03:51,857   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-11T10:03:51,859   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-11T10:03:51,861   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-11T10:03:51,863   copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-11T10:03:51,865   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-11T10:03:51,867   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-11T10:03:51,869   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-11T10:03:51,870   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,873   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/sdaa
2025-06-11T10:03:51,874   copying build/lib/deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-11T10:03:51,877   copying build/lib/deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-11T10:03:51,879   copying build/lib/deepspeed/ops/op_builder/sdaa/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-11T10:03:51,881   copying build/lib/deepspeed/ops/op_builder/sdaa/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-11T10:03:51,883   copying build/lib/deepspeed/ops/op_builder/sdaa/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-11T10:03:51,885   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,887   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,889   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,891   copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,893   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu
2025-06-11T10:03:51,894   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-11T10:03:51,896   copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-11T10:03:51,898   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-11T10:03:51,899   copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-11T10:03:51,901   copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-11T10:03:51,903   copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-11T10:03:51,905   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,907   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,909   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,911   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,914   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2025-06-11T10:03:51,915   copying build/lib/deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-11T10:03:51,917   copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-11T10:03:51,919   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-11T10:03:51,921   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-11T10:03:51,923   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-11T10:03:51,925   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-11T10:03:51,927   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-11T10:03:51,929   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,931   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,934   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,936   copying build/lib/deepspeed/ops/op_builder/dc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,938   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2025-06-11T10:03:51,939   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-11T10:03:51,941   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-11T10:03:51,944   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-11T10:03:51,946   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-11T10:03:51,948   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-11T10:03:51,950   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-11T10:03:51,952   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-11T10:03:51,954   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-11T10:03:51,956   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-11T10:03:51,957   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,960   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-11T10:03:51,963   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-11T10:03:51,964   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-11T10:03:51,967   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2025-06-11T10:03:51,968   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-11T10:03:51,971   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-11T10:03:51,974   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-11T10:03:51,977   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-11T10:03:51,981   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-11T10:03:51,987   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-11T10:03:51,993   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-11T10:03:51,998   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-11T10:03:52,002   running install_egg_info
2025-06-11T10:03:52,037   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.17.1-py3.11.egg-info
2025-06-11T10:03:52,051   running install_scripts
2025-06-11T10:03:52,052   creating build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts
2025-06-11T10:03:52,054   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts
2025-06-11T10:03:52,056   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts
2025-06-11T10:03:52,058   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts
2025-06-11T10:03:52,060   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts
2025-06-11T10:03:52,062   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts
2025-06-11T10:03:52,064   copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts
2025-06-11T10:03:52,065   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts
2025-06-11T10:03:52,067   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts
2025-06-11T10:03:52,069   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts
2025-06-11T10:03:52,071   copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts
2025-06-11T10:03:52,072   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts/dsr to 755
2025-06-11T10:03:52,072   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts/deepspeed to 755
2025-06-11T10:03:52,073   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts/ds_elastic to 755
2025-06-11T10:03:52,073   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts/deepspeed.pt to 755
2025-06-11T10:03:52,074   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts/ds to 755
2025-06-11T10:03:52,074   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts/ds_nvme_tune to 755
2025-06-11T10:03:52,075   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts/ds_ssh to 755
2025-06-11T10:03:52,076   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts/ds_report to 755
2025-06-11T10:03:52,076   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts/ds_bench to 755
2025-06-11T10:03:52,077   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.data/scripts/ds_io to 755
2025-06-11T10:03:52,090   creating build/bdist.linux-armv7l/wheel/deepspeed-0.17.1.dist-info/WHEEL
2025-06-11T10:03:52,093   creating '/tmp/pip-wheel-99jmc_rp/deepspeed-0.17.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2025-06-11T10:03:52,097   adding 'deepspeed/__init__.py'
2025-06-11T10:03:52,098   adding 'deepspeed/constants.py'
2025-06-11T10:03:52,100   adding 'deepspeed/env_report.py'
2025-06-11T10:03:52,101   adding 'deepspeed/git_version_info.py'
2025-06-11T10:03:52,103   adding 'deepspeed/git_version_info_installed.py'
2025-06-11T10:03:52,104   adding 'deepspeed/accelerator/__init__.py'
2025-06-11T10:03:52,106   adding 'deepspeed/accelerator/abstract_accelerator.py'
2025-06-11T10:03:52,108   adding 'deepspeed/accelerator/cpu_accelerator.py'
2025-06-11T10:03:52,110   adding 'deepspeed/accelerator/cuda_accelerator.py'
2025-06-11T10:03:52,112   adding 'deepspeed/accelerator/hpu_accelerator.py'
2025-06-11T10:03:52,114   adding 'deepspeed/accelerator/mlu_accelerator.py'
2025-06-11T10:03:52,115   adding 'deepspeed/accelerator/mps_accelerator.py'
2025-06-11T10:03:52,117   adding 'deepspeed/accelerator/npu_accelerator.py'
2025-06-11T10:03:52,119   adding 'deepspeed/accelerator/real_accelerator.py'
2025-06-11T10:03:52,121   adding 'deepspeed/accelerator/sdaa_accelerator.py'
2025-06-11T10:03:52,123   adding 'deepspeed/accelerator/xpu_accelerator.py'
2025-06-11T10:03:52,124   adding 'deepspeed/autotuning/__init__.py'
2025-06-11T10:03:52,130   adding 'deepspeed/autotuning/autotuner.py'
2025-06-11T10:03:52,132   adding 'deepspeed/autotuning/config.py'
2025-06-11T10:03:52,133   adding 'deepspeed/autotuning/constants.py'
2025-06-11T10:03:52,135   adding 'deepspeed/autotuning/scheduler.py'
2025-06-11T10:03:52,138   adding 'deepspeed/autotuning/utils.py'
2025-06-11T10:03:52,140   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2025-06-11T10:03:52,141   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2025-06-11T10:03:52,142   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2025-06-11T10:03:52,143   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2025-06-11T10:03:52,145   adding 'deepspeed/autotuning/tuner/__init__.py'
2025-06-11T10:03:52,146   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2025-06-11T10:03:52,148   adding 'deepspeed/autotuning/tuner/cost_model.py'
2025-06-11T10:03:52,149   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2025-06-11T10:03:52,151   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2025-06-11T10:03:52,152   adding 'deepspeed/autotuning/tuner/utils.py'
2025-06-11T10:03:52,154   adding 'deepspeed/checkpoint/__init__.py'
2025-06-11T10:03:52,155   adding 'deepspeed/checkpoint/constants.py'
2025-06-11T10:03:52,157   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2025-06-11T10:03:52,160   adding 'deepspeed/checkpoint/ds_to_universal.py'
2025-06-11T10:03:52,161   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2025-06-11T10:03:52,163   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2025-06-11T10:03:52,164   adding 'deepspeed/checkpoint/reshape_utils.py'
2025-06-11T10:03:52,166   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2025-06-11T10:03:52,167   adding 'deepspeed/checkpoint/utils.py'
2025-06-11T10:03:52,168   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2025-06-11T10:03:52,170   adding 'deepspeed/comm/__init__.py'
2025-06-11T10:03:52,171   adding 'deepspeed/comm/backend.py'
2025-06-11T10:03:52,173   adding 'deepspeed/comm/ccl.py'
2025-06-11T10:03:52,176   adding 'deepspeed/comm/comm.py'
2025-06-11T10:03:52,178   adding 'deepspeed/comm/config.py'
2025-06-11T10:03:52,179   adding 'deepspeed/comm/constants.py'
2025-06-11T10:03:52,180   adding 'deepspeed/comm/reduce_op.py'
2025-06-11T10:03:52,183   adding 'deepspeed/comm/torch.py'
2025-06-11T10:03:52,184   adding 'deepspeed/comm/utils.py'
2025-06-11T10:03:52,186   adding 'deepspeed/compile/__init__.py'
2025-06-11T10:03:52,188   adding 'deepspeed/compile/backend.py'
2025-06-11T10:03:52,189   adding 'deepspeed/compile/config.py'
2025-06-11T10:03:52,191   adding 'deepspeed/compile/fx.py'
2025-06-11T10:03:52,192   adding 'deepspeed/compile/graph_param.py'
2025-06-11T10:03:52,194   adding 'deepspeed/compile/inductor.py'
2025-06-11T10:03:52,195   adding 'deepspeed/compile/init_z1.py'
2025-06-11T10:03:52,197   adding 'deepspeed/compile/init_z3.py'
2025-06-11T10:03:52,199   adding 'deepspeed/compile/list_schedule.py'
2025-06-11T10:03:52,201   adding 'deepspeed/compile/partitioner.py'
2025-06-11T10:03:52,202   adding 'deepspeed/compile/patch_compiled_func.py'
2025-06-11T10:03:52,203   adding 'deepspeed/compile/patch_fake_tensor.py'
2025-06-11T10:03:52,206   adding 'deepspeed/compile/util.py'
2025-06-11T10:03:52,208   adding 'deepspeed/compile/passes/__init__.py'
2025-06-11T10:03:52,209   adding 'deepspeed/compile/passes/offload_activation.py'
2025-06-11T10:03:52,212   adding 'deepspeed/compile/passes/offload_adam_states.py'
2025-06-11T10:03:52,213   adding 'deepspeed/compile/passes/offload_parameters.py'
2025-06-11T10:03:52,214   adding 'deepspeed/compile/passes/prefetch.py'
2025-06-11T10:03:52,216   adding 'deepspeed/compile/passes/selective_gather.py'
2025-06-11T10:03:52,217   adding 'deepspeed/compile/passes/zero1_compile.py'
2025-06-11T10:03:52,219   adding 'deepspeed/compile/passes/zero3_compile.py'
2025-06-11T10:03:52,221   adding 'deepspeed/compile/profilers/__init__.py'
2025-06-11T10:03:52,222   adding 'deepspeed/compile/profilers/comm_profile.py'
2025-06-11T10:03:52,224   adding 'deepspeed/compile/profilers/graph_profile.py'
2025-06-11T10:03:52,226   adding 'deepspeed/compression/__init__.py'
2025-06-11T10:03:52,229   adding 'deepspeed/compression/basic_layer.py'
2025-06-11T10:03:52,231   adding 'deepspeed/compression/compress.py'
2025-06-11T10:03:52,234   adding 'deepspeed/compression/config.py'
2025-06-11T10:03:52,235   adding 'deepspeed/compression/constants.py'
2025-06-11T10:03:52,237   adding 'deepspeed/compression/helper.py'
2025-06-11T10:03:52,239   adding 'deepspeed/compression/scheduler.py'
2025-06-11T10:03:52,240   adding 'deepspeed/compression/utils.py'
2025-06-11T10:03:52,242   adding 'deepspeed/elasticity/__init__.py'
2025-06-11T10:03:52,244   adding 'deepspeed/elasticity/config.py'
2025-06-11T10:03:52,245   adding 'deepspeed/elasticity/constants.py'
2025-06-11T10:03:52,247   adding 'deepspeed/elasticity/elastic_agent.py'
2025-06-11T10:03:52,249   adding 'deepspeed/elasticity/elasticity.py'
2025-06-11T10:03:52,251   adding 'deepspeed/elasticity/utils.py'
2025-06-11T10:03:52,252   adding 'deepspeed/inference/__init__.py'
2025-06-11T10:03:52,254   adding 'deepspeed/inference/config.py'
2025-06-11T10:03:52,257   adding 'deepspeed/inference/engine.py'
2025-06-11T10:03:52,259   adding 'deepspeed/inference/quantization/__init__.py'
2025-06-11T10:03:52,261   adding 'deepspeed/inference/quantization/layers.py'
2025-06-11T10:03:52,262   adding 'deepspeed/inference/quantization/quantization.py'
2025-06-11T10:03:52,263   adding 'deepspeed/inference/quantization/quantization_context.py'
2025-06-11T10:03:52,265   adding 'deepspeed/inference/quantization/utils.py'
2025-06-11T10:03:52,267   adding 'deepspeed/inference/v2/__init__.py'
2025-06-11T10:03:52,268   adding 'deepspeed/inference/v2/allocator.py'
2025-06-11T10:03:52,269   adding 'deepspeed/inference/v2/config_v2.py'
2025-06-11T10:03:52,271   adding 'deepspeed/inference/v2/engine_factory.py'
2025-06-11T10:03:52,272   adding 'deepspeed/inference/v2/engine_v2.py'
2025-06-11T10:03:52,274   adding 'deepspeed/inference/v2/inference_parameter.py'
2025-06-11T10:03:52,275   adding 'deepspeed/inference/v2/inference_utils.py'
2025-06-11T10:03:52,276   adding 'deepspeed/inference/v2/logging.py'
2025-06-11T10:03:52,278   adding 'deepspeed/inference/v2/scheduling_utils.py'
2025-06-11T10:03:52,279   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2025-06-11T10:03:52,280   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2025-06-11T10:03:52,282   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2025-06-11T10:03:52,283   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2025-06-11T10:03:52,285   adding 'deepspeed/inference/v2/kernels/__init__.py'
2025-06-11T10:03:52,286   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2025-06-11T10:03:52,288   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2025-06-11T10:03:52,289   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2025-06-11T10:03:52,291   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2025-06-11T10:03:52,292   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2025-06-11T10:03:52,294   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2025-06-11T10:03:52,295   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2025-06-11T10:03:52,296   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2025-06-11T10:03:52,298   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2025-06-11T10:03:52,300   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2025-06-11T10:03:52,301   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2025-06-11T10:03:52,303   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2025-06-11T10:03:52,305   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2025-06-11T10:03:52,306   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2025-06-11T10:03:52,307   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2025-06-11T10:03:52,308   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2025-06-11T10:03:52,310   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2025-06-11T10:03:52,311   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2025-06-11T10:03:52,312   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2025-06-11T10:03:52,314   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2025-06-11T10:03:52,316   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2025-06-11T10:03:52,318   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2025-06-11T10:03:52,320   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2025-06-11T10:03:52,321   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2025-06-11T10:03:52,323   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2025-06-11T10:03:52,324   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2025-06-11T10:03:52,326   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2025-06-11T10:03:52,328   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2025-06-11T10:03:52,329   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2025-06-11T10:03:52,331   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2025-06-11T10:03:52,332   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2025-06-11T10:03:52,334   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2025-06-11T10:03:52,335   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2025-06-11T10:03:52,337   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2025-06-11T10:03:52,338   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2025-06-11T10:03:52,340   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2025-06-11T10:03:52,341   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2025-06-11T10:03:52,343   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2025-06-11T10:03:52,344   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2025-06-11T10:03:52,345   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2025-06-11T10:03:52,347   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2025-06-11T10:03:52,348   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2025-06-11T10:03:52,350   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2025-06-11T10:03:52,351   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2025-06-11T10:03:52,352   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2025-06-11T10:03:52,353   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2025-06-11T10:03:52,355   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2025-06-11T10:03:52,357   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2025-06-11T10:03:52,358   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2025-06-11T10:03:52,360   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2025-06-11T10:03:52,361   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2025-06-11T10:03:52,362   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2025-06-11T10:03:52,364   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2025-06-11T10:03:52,365   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2025-06-11T10:03:52,367   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2025-06-11T10:03:52,368   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2025-06-11T10:03:52,370   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2025-06-11T10:03:52,371   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2025-06-11T10:03:52,372   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2025-06-11T10:03:52,374   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2025-06-11T10:03:52,375   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2025-06-11T10:03:52,377   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2025-06-11T10:03:52,379   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2025-06-11T10:03:52,380   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2025-06-11T10:03:52,383   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2025-06-11T10:03:52,385   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2025-06-11T10:03:52,387   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2025-06-11T10:03:52,388   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2025-06-11T10:03:52,390   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2025-06-11T10:03:52,391   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2025-06-11T10:03:52,392   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2025-06-11T10:03:52,394   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2025-06-11T10:03:52,395   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2025-06-11T10:03:52,397   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2025-06-11T10:03:52,398   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2025-06-11T10:03:52,399   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2025-06-11T10:03:52,401   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2025-06-11T10:03:52,402   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2025-06-11T10:03:52,404   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2025-06-11T10:03:52,405   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2025-06-11T10:03:52,406   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2025-06-11T10:03:52,407   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2025-06-11T10:03:52,409   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2025-06-11T10:03:52,411   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2025-06-11T10:03:52,412   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2025-06-11T10:03:52,414   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2025-06-11T10:03:52,416   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2025-06-11T10:03:52,417   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2025-06-11T10:03:52,419   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2025-06-11T10:03:52,421   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2025-06-11T10:03:52,423   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2025-06-11T10:03:52,424   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2025-06-11T10:03:52,426   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2025-06-11T10:03:52,428   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2025-06-11T10:03:52,429   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2025-06-11T10:03:52,430   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2025-06-11T10:03:52,431   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2025-06-11T10:03:52,433   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2025-06-11T10:03:52,434   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2025-06-11T10:03:52,436   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2025-06-11T10:03:52,437   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2025-06-11T10:03:52,439   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2025-06-11T10:03:52,440   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2025-06-11T10:03:52,441   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2025-06-11T10:03:52,443   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2025-06-11T10:03:52,444   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2025-06-11T10:03:52,445   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2025-06-11T10:03:52,447   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2025-06-11T10:03:52,448   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2025-06-11T10:03:52,449   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2025-06-11T10:03:52,451   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2025-06-11T10:03:52,453   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2025-06-11T10:03:52,454   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2025-06-11T10:03:52,455   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2025-06-11T10:03:52,457   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2025-06-11T10:03:52,458   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2025-06-11T10:03:52,460   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2025-06-11T10:03:52,461   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2025-06-11T10:03:52,463   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2025-06-11T10:03:52,464   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2025-06-11T10:03:52,466   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2025-06-11T10:03:52,468   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2025-06-11T10:03:52,470   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2025-06-11T10:03:52,472   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2025-06-11T10:03:52,474   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2025-06-11T10:03:52,476   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2025-06-11T10:03:52,478   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2025-06-11T10:03:52,480   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2025-06-11T10:03:52,481   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2025-06-11T10:03:52,483   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2025-06-11T10:03:52,484   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2025-06-11T10:03:52,485   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2025-06-11T10:03:52,487   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2025-06-11T10:03:52,488   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2025-06-11T10:03:52,489   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2025-06-11T10:03:52,491   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2025-06-11T10:03:52,493   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2025-06-11T10:03:52,494   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2025-06-11T10:03:52,496   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2025-06-11T10:03:52,497   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2025-06-11T10:03:52,499   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2025-06-11T10:03:52,500   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2025-06-11T10:03:52,502   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2025-06-11T10:03:52,503   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2025-06-11T10:03:52,506   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2025-06-11T10:03:52,507   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2025-06-11T10:03:52,508   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2025-06-11T10:03:52,510   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2025-06-11T10:03:52,511   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2025-06-11T10:03:52,513   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2025-06-11T10:03:52,514   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2025-06-11T10:03:52,516   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2025-06-11T10:03:52,517   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2025-06-11T10:03:52,519   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2025-06-11T10:03:52,520   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2025-06-11T10:03:52,521   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2025-06-11T10:03:52,523   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2025-06-11T10:03:52,524   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2025-06-11T10:03:52,526   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2025-06-11T10:03:52,527   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2025-06-11T10:03:52,529   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2025-06-11T10:03:52,530   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2025-06-11T10:03:52,532   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2025-06-11T10:03:52,533   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2025-06-11T10:03:52,535   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2025-06-11T10:03:52,536   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2025-06-11T10:03:52,538   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2025-06-11T10:03:52,540   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2025-06-11T10:03:52,541   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2025-06-11T10:03:52,543   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2025-06-11T10:03:52,544   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2025-06-11T10:03:52,546   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2025-06-11T10:03:52,548   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2025-06-11T10:03:52,549   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2025-06-11T10:03:52,551   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2025-06-11T10:03:52,552   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2025-06-11T10:03:52,554   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2025-06-11T10:03:52,555   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2025-06-11T10:03:52,557   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2025-06-11T10:03:52,558   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2025-06-11T10:03:52,560   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2025-06-11T10:03:52,561   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2025-06-11T10:03:52,562   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2025-06-11T10:03:52,564   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2025-06-11T10:03:52,565   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2025-06-11T10:03:52,567   adding 'deepspeed/inference/v2/modules/__init__.py'
2025-06-11T10:03:52,568   adding 'deepspeed/inference/v2/modules/ds_module.py'
2025-06-11T10:03:52,570   adding 'deepspeed/inference/v2/modules/heuristics.py'
2025-06-11T10:03:52,571   adding 'deepspeed/inference/v2/modules/module_registry.py'
2025-06-11T10:03:52,573   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2025-06-11T10:03:52,574   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2025-06-11T10:03:52,575   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2025-06-11T10:03:52,577   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2025-06-11T10:03:52,578   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2025-06-11T10:03:52,579   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2025-06-11T10:03:52,580   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2025-06-11T10:03:52,582   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2025-06-11T10:03:52,583   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2025-06-11T10:03:52,585   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2025-06-11T10:03:52,587   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2025-06-11T10:03:52,588   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2025-06-11T10:03:52,590   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2025-06-11T10:03:52,592   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2025-06-11T10:03:52,593   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2025-06-11T10:03:52,595   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2025-06-11T10:03:52,597   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2025-06-11T10:03:52,599   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2025-06-11T10:03:52,600   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2025-06-11T10:03:52,602   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2025-06-11T10:03:52,603   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2025-06-11T10:03:52,605   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2025-06-11T10:03:52,606   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2025-06-11T10:03:52,608   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2025-06-11T10:03:52,610   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2025-06-11T10:03:52,611   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2025-06-11T10:03:52,613   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2025-06-11T10:03:52,614   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2025-06-11T10:03:52,615   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2025-06-11T10:03:52,617   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2025-06-11T10:03:52,618   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2025-06-11T10:03:52,619   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2025-06-11T10:03:52,621   adding 'deepspeed/inference/v2/ragged/__init__.py'
2025-06-11T10:03:52,623   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2025-06-11T10:03:52,624   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2025-06-11T10:03:52,626   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2025-06-11T10:03:52,628   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2025-06-11T10:03:52,630   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2025-06-11T10:03:52,631   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2025-06-11T10:03:52,633   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2025-06-11T10:03:52,634   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2025-06-11T10:03:52,636   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2025-06-11T10:03:52,638   adding 'deepspeed/io/__init__.py'
2025-06-11T10:03:52,639   adding 'deepspeed/io/base_file_writer.py'
2025-06-11T10:03:52,640   adding 'deepspeed/io/base_io_buffer.py'
2025-06-11T10:03:52,641   adding 'deepspeed/io/constants.py'
2025-06-11T10:03:52,643   adding 'deepspeed/io/double_io_buffer.py'
2025-06-11T10:03:52,645   adding 'deepspeed/io/fast_file_writer.py'
2025-06-11T10:03:52,646   adding 'deepspeed/io/mock_file_writer.py'
2025-06-11T10:03:52,647   adding 'deepspeed/io/py_file_writer.py'
2025-06-11T10:03:52,648   adding 'deepspeed/io/single_io_buffer.py'
2025-06-11T10:03:52,650   adding 'deepspeed/io/utils.py'
2025-06-11T10:03:52,651   adding 'deepspeed/launcher/__init__.py'
2025-06-11T10:03:52,652   adding 'deepspeed/launcher/constants.py'
2025-06-11T10:03:52,655   adding 'deepspeed/launcher/launch.py'
2025-06-11T10:03:52,656   adding 'deepspeed/launcher/launcher_helper.py'
2025-06-11T10:03:52,658   adding 'deepspeed/launcher/multinode_runner.py'
2025-06-11T10:03:52,661   adding 'deepspeed/launcher/runner.py'
2025-06-11T10:03:52,663   adding 'deepspeed/linear/__init__.py'
2025-06-11T10:03:52,664   adding 'deepspeed/linear/config.py'
2025-06-11T10:03:52,666   adding 'deepspeed/linear/context_manager.py'
2025-06-11T10:03:52,668   adding 'deepspeed/linear/optimized_linear.py'
2025-06-11T10:03:52,669   adding 'deepspeed/linear/quantization.py'
2025-06-11T10:03:52,671   adding 'deepspeed/model_implementations/__init__.py'
2025-06-11T10:03:52,673   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2025-06-11T10:03:52,674   adding 'deepspeed/model_implementations/diffusers/unet.py'
2025-06-11T10:03:52,675   adding 'deepspeed/model_implementations/diffusers/vae.py'
2025-06-11T10:03:52,677   adding 'deepspeed/model_implementations/features/__init__.py'
2025-06-11T10:03:52,678   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2025-06-11T10:03:52,680   adding 'deepspeed/model_implementations/transformers/__init__.py'
2025-06-11T10:03:52,682   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2025-06-11T10:03:52,683   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2025-06-11T10:03:52,684   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2025-06-11T10:03:52,685   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2025-06-11T10:03:52,686   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2025-06-11T10:03:52,688   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2025-06-11T10:03:52,689   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2025-06-11T10:03:52,690   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2025-06-11T10:03:52,692   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2025-06-11T10:03:52,694   adding 'deepspeed/module_inject/__init__.py'
2025-06-11T10:03:52,697   adding 'deepspeed/module_inject/auto_tp.py'
2025-06-11T10:03:52,699   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2025-06-11T10:03:52,700   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2025-06-11T10:03:52,702   adding 'deepspeed/module_inject/inject.py'
2025-06-11T10:03:52,706   adding 'deepspeed/module_inject/layers.py'
2025-06-11T10:03:52,708   adding 'deepspeed/module_inject/load_checkpoint.py'
2025-06-11T10:03:52,710   adding 'deepspeed/module_inject/module_quantize.py'
2025-06-11T10:03:52,711   adding 'deepspeed/module_inject/policy.py'
2025-06-11T10:03:52,715   adding 'deepspeed/module_inject/replace_module.py'
2025-06-11T10:03:52,716   adding 'deepspeed/module_inject/replace_policy.py'
2025-06-11T10:03:52,717   adding 'deepspeed/module_inject/tp_shard.py'
2025-06-11T10:03:52,719   adding 'deepspeed/module_inject/utils.py'
2025-06-11T10:03:52,721   adding 'deepspeed/module_inject/containers/__init__.py'
2025-06-11T10:03:52,723   adding 'deepspeed/module_inject/containers/base.py'
2025-06-11T10:03:52,725   adding 'deepspeed/module_inject/containers/base_moe.py'
2025-06-11T10:03:52,726   adding 'deepspeed/module_inject/containers/bert.py'
2025-06-11T10:03:52,727   adding 'deepspeed/module_inject/containers/bloom.py'
2025-06-11T10:03:52,729   adding 'deepspeed/module_inject/containers/clip.py'
2025-06-11T10:03:52,730   adding 'deepspeed/module_inject/containers/distil_bert.py'
2025-06-11T10:03:52,731   adding 'deepspeed/module_inject/containers/gpt2.py'
2025-06-11T10:03:52,733   adding 'deepspeed/module_inject/containers/gptj.py'
2025-06-11T10:03:52,734   adding 'deepspeed/module_inject/containers/gptneo.py'
2025-06-11T10:03:52,736   adding 'deepspeed/module_inject/containers/gptneox.py'
2025-06-11T10:03:52,737   adding 'deepspeed/module_inject/containers/internlm.py'
2025-06-11T10:03:52,739   adding 'deepspeed/module_inject/containers/llama.py'
2025-06-11T10:03:52,740   adding 'deepspeed/module_inject/containers/llama2.py'
2025-06-11T10:03:52,742   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2025-06-11T10:03:52,743   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2025-06-11T10:03:52,745   adding 'deepspeed/module_inject/containers/opt.py'
2025-06-11T10:03:52,746   adding 'deepspeed/module_inject/containers/unet.py'
2025-06-11T10:03:52,747   adding 'deepspeed/module_inject/containers/vae.py'
2025-06-11T10:03:52,749   adding 'deepspeed/module_inject/containers/features/__init__.py'
2025-06-11T10:03:52,751   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2025-06-11T10:03:52,752   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2025-06-11T10:03:52,754   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2025-06-11T10:03:52,755   adding 'deepspeed/module_inject/containers/features/megatron.py'
2025-06-11T10:03:52,757   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2025-06-11T10:03:52,758   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2025-06-11T10:03:52,760   adding 'deepspeed/moe/__init__.py'
2025-06-11T10:03:52,761   adding 'deepspeed/moe/experts.py'
2025-06-11T10:03:52,763   adding 'deepspeed/moe/layer.py'
2025-06-11T10:03:52,765   adding 'deepspeed/moe/mappings.py'
2025-06-11T10:03:52,768   adding 'deepspeed/moe/sharded_moe.py'
2025-06-11T10:03:52,770   adding 'deepspeed/moe/utils.py'
2025-06-11T10:03:52,772   adding 'deepspeed/monitor/__init__.py'
2025-06-11T10:03:52,773   adding 'deepspeed/monitor/comet.py'
2025-06-11T10:03:52,774   adding 'deepspeed/monitor/config.py'
2025-06-11T10:03:52,776   adding 'deepspeed/monitor/csv_monitor.py'
2025-06-11T10:03:52,777   adding 'deepspeed/monitor/monitor.py'
2025-06-11T10:03:52,778   adding 'deepspeed/monitor/tensorboard.py'
2025-06-11T10:03:52,780   adding 'deepspeed/monitor/utils.py'
2025-06-11T10:03:52,781   adding 'deepspeed/monitor/wandb.py'
2025-06-11T10:03:52,783   adding 'deepspeed/nebula/__init__.py'
2025-06-11T10:03:52,784   adding 'deepspeed/nebula/config.py'
2025-06-11T10:03:52,786   adding 'deepspeed/nebula/constants.py'
2025-06-11T10:03:52,788   adding 'deepspeed/nvme/__init__.py'
2025-06-11T10:03:52,789   adding 'deepspeed/nvme/ds_aio_args.py'
2025-06-11T10:03:52,791   adding 'deepspeed/nvme/ds_aio_basic.py'
2025-06-11T10:03:52,792   adding 'deepspeed/nvme/ds_aio_constants.py'
2025-06-11T10:03:52,794   adding 'deepspeed/nvme/ds_aio_handle.py'
2025-06-11T10:03:52,795   adding 'deepspeed/nvme/ds_aio_job.py'
2025-06-11T10:03:52,796   adding 'deepspeed/nvme/io_engine.py'
2025-06-11T10:03:52,798   adding 'deepspeed/nvme/parse_nvme_stats.py'
2025-06-11T10:03:52,799   adding 'deepspeed/nvme/perf_generate_param.py'
2025-06-11T10:03:52,801   adding 'deepspeed/nvme/perf_run_sweep.py'
2025-06-11T10:03:52,803   adding 'deepspeed/nvme/perf_sweep_utils.py'
2025-06-11T10:03:52,804   adding 'deepspeed/nvme/test_ds_aio.py'
2025-06-11T10:03:52,805   adding 'deepspeed/nvme/test_ds_aio_utils.py'
2025-06-11T10:03:52,806   adding 'deepspeed/nvme/torch_fastio_engine.py'
2025-06-11T10:03:52,808   adding 'deepspeed/nvme/torch_io.py'
2025-06-11T10:03:52,809   adding 'deepspeed/nvme/validate_async_io.py'
2025-06-11T10:03:52,811   adding 'deepspeed/ops/__init__.py'
2025-06-11T10:03:52,812   adding 'deepspeed/ops/adagrad/__init__.py'
2025-06-11T10:03:52,814   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2025-06-11T10:03:52,815   adding 'deepspeed/ops/adam/__init__.py'
2025-06-11T10:03:52,817   adding 'deepspeed/ops/adam/cpu_adam.py'
2025-06-11T10:03:52,819   adding 'deepspeed/ops/adam/fused_adam.py'
2025-06-11T10:03:52,820   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2025-06-11T10:03:52,822   adding 'deepspeed/ops/aio/__init__.py'
2025-06-11T10:03:52,824   adding 'deepspeed/ops/compile/__init__.py'
2025-06-11T10:03:52,826   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2025-06-11T10:03:52,828   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2025-06-11T10:03:52,830   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2025-06-11T10:03:52,831   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2025-06-11T10:03:52,833   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2025-06-11T10:03:52,834   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2025-06-11T10:03:52,837   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2025-06-11T10:03:52,838   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2025-06-11T10:03:52,840   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2025-06-11T10:03:52,841   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2025-06-11T10:03:52,843   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2025-06-11T10:03:52,844   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2025-06-11T10:03:52,846   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2025-06-11T10:03:52,847   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2025-06-11T10:03:52,848   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2025-06-11T10:03:52,850   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2025-06-11T10:03:52,851   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2025-06-11T10:03:52,852   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2025-06-11T10:03:52,854   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2025-06-11T10:03:52,855   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2025-06-11T10:03:52,856   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2025-06-11T10:03:52,858   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2025-06-11T10:03:52,859   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2025-06-11T10:03:52,860   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2025-06-11T10:03:52,862   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2025-06-11T10:03:52,863   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2025-06-11T10:03:52,865   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2025-06-11T10:03:52,867   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2025-06-11T10:03:52,868   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2025-06-11T10:03:52,870   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2025-06-11T10:03:52,872   adding 'deepspeed/ops/csrc/compile/deepcompile.cpp'
2025-06-11T10:03:52,873   adding 'deepspeed/ops/csrc/compile/init.cpp'
2025-06-11T10:03:52,875   adding 'deepspeed/ops/csrc/compile/util.cpp'
2025-06-11T10:03:52,876   adding 'deepspeed/ops/csrc/compile/z1.cpp'
2025-06-11T10:03:52,877   adding 'deepspeed/ops/csrc/compile/z1.h'
2025-06-11T10:03:52,880   adding 'deepspeed/ops/csrc/compile/z3.cpp'
2025-06-11T10:03:52,881   adding 'deepspeed/ops/csrc/compile/z3.h'
2025-06-11T10:03:52,884   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2025-06-11T10:03:52,886   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2025-06-11T10:03:52,889   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2025-06-11T10:03:52,890   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2025-06-11T10:03:52,892   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2025-06-11T10:03:52,894   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2025-06-11T10:03:52,896   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2025-06-11T10:03:52,898   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2025-06-11T10:03:52,899   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2025-06-11T10:03:52,901   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2025-06-11T10:03:52,909   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2025-06-11T10:03:52,914   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2025-06-11T10:03:52,916   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2025-06-11T10:03:52,919   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2025-06-11T10:03:52,921   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2025-06-11T10:03:52,923   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2025-06-11T10:03:52,925   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2025-06-11T10:03:52,927   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2025-06-11T10:03:52,930   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2025-06-11T10:03:52,932   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2025-06-11T10:03:52,934   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2025-06-11T10:03:52,936   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2025-06-11T10:03:52,943   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2025-06-11T10:03:52,947   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2025-06-11T10:03:52,949   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2025-06-11T10:03:52,953   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2025-06-11T10:03:52,956   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2025-06-11T10:03:52,960   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2025-06-11T10:03:52,962   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2025-06-11T10:03:52,964   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2025-06-11T10:03:52,966   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2025-06-11T10:03:52,967   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2025-06-11T10:03:52,969   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2025-06-11T10:03:52,972   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2025-06-11T10:03:52,974   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2025-06-11T10:03:52,975   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2025-06-11T10:03:52,978   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2025-06-11T10:03:52,979   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2025-06-11T10:03:52,981   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2025-06-11T10:03:52,982   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2025-06-11T10:03:52,983   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2025-06-11T10:03:52,985   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2025-06-11T10:03:52,987   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2025-06-11T10:03:52,988   adding 'deepspeed/ops/csrc/includes/Timer.h'
2025-06-11T10:03:52,989   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2025-06-11T10:03:52,990   adding 'deepspeed/ops/csrc/includes/compat.h'
2025-06-11T10:03:52,992   adding 'deepspeed/ops/csrc/includes/context.h'
2025-06-11T10:03:52,994   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2025-06-11T10:03:52,995   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2025-06-11T10:03:52,997   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2025-06-11T10:03:52,998   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2025-06-11T10:03:53,000   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2025-06-11T10:03:53,001   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2025-06-11T10:03:53,004   adding 'deepspeed/ops/csrc/includes/deepcompile.h'
2025-06-11T10:03:53,006   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2025-06-11T10:03:53,007   adding 'deepspeed/ops/csrc/includes/dropout.h'
2025-06-11T10:03:53,008   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2025-06-11T10:03:53,010   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2025-06-11T10:03:53,011   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2025-06-11T10:03:53,013   adding 'deepspeed/ops/csrc/includes/gelu.h'
2025-06-11T10:03:53,014   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2025-06-11T10:03:53,016   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2025-06-11T10:03:53,018   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2025-06-11T10:03:53,020   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2025-06-11T10:03:53,021   adding 'deepspeed/ops/csrc/includes/quantization.h'
2025-06-11T10:03:53,024   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2025-06-11T10:03:53,025   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2025-06-11T10:03:53,027   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2025-06-11T10:03:53,029   adding 'deepspeed/ops/csrc/includes/simd.h'
2025-06-11T10:03:53,031   adding 'deepspeed/ops/csrc/includes/softmax.h'
2025-06-11T10:03:53,032   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2025-06-11T10:03:53,034   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2025-06-11T10:03:53,036   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2025-06-11T10:03:53,038   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2025-06-11T10:03:53,040   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2025-06-11T10:03:53,041   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2025-06-11T10:03:53,043   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2025-06-11T10:03:53,044   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2025-06-11T10:03:53,046   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2025-06-11T10:03:53,048   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2025-06-11T10:03:53,051   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2025-06-11T10:03:53,053   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2025-06-11T10:03:53,055   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2025-06-11T10:03:53,057   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2025-06-11T10:03:53,059   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2025-06-11T10:03:53,061   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2025-06-11T10:03:53,063   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2025-06-11T10:03:53,065   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2025-06-11T10:03:53,066   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2025-06-11T10:03:53,068   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2025-06-11T10:03:53,070   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2025-06-11T10:03:53,072   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2025-06-11T10:03:53,073   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2025-06-11T10:03:53,075   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2025-06-11T10:03:53,077   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2025-06-11T10:03:53,080   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2025-06-11T10:03:53,084   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2025-06-11T10:03:53,086   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2025-06-11T10:03:53,088   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2025-06-11T10:03:53,092   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2025-06-11T10:03:53,095   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2025-06-11T10:03:53,097   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2025-06-11T10:03:53,100   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2025-06-11T10:03:53,102   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2025-06-11T10:03:53,104   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2025-06-11T10:03:53,107   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2025-06-11T10:03:53,108   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2025-06-11T10:03:53,114   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2025-06-11T10:03:53,116   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2025-06-11T10:03:53,117   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2025-06-11T10:03:53,120   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2025-06-11T10:03:53,123   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2025-06-11T10:03:53,125   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2025-06-11T10:03:53,127   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2025-06-11T10:03:53,129   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2025-06-11T10:03:53,131   adding 'deepspeed/ops/csrc/utils/py_ds_utils.cpp'
2025-06-11T10:03:53,133   adding 'deepspeed/ops/csrc/utils/tensor_cast.cpp'
2025-06-11T10:03:53,134   adding 'deepspeed/ops/csrc/utils/tensor_cast.h'
2025-06-11T10:03:53,136   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2025-06-11T10:03:53,138   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2025-06-11T10:03:53,140   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2025-06-11T10:03:53,141   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2025-06-11T10:03:53,143   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2025-06-11T10:03:53,145   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2025-06-11T10:03:53,146   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2025-06-11T10:03:53,148   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2025-06-11T10:03:53,150   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2025-06-11T10:03:53,151   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2025-06-11T10:03:53,153   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2025-06-11T10:03:53,155   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2025-06-11T10:03:53,156   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2025-06-11T10:03:53,158   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2025-06-11T10:03:53,159   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2025-06-11T10:03:53,161   adding 'deepspeed/ops/fp_quantizer/fp8_gemm_triton.py'
2025-06-11T10:03:53,163   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2025-06-11T10:03:53,164   adding 'deepspeed/ops/gds/__init__.py'
2025-06-11T10:03:53,166   adding 'deepspeed/ops/lamb/__init__.py'
2025-06-11T10:03:53,168   adding 'deepspeed/ops/lamb/fused_lamb.py'
2025-06-11T10:03:53,169   adding 'deepspeed/ops/lion/__init__.py'
2025-06-11T10:03:53,171   adding 'deepspeed/ops/lion/cpu_lion.py'
2025-06-11T10:03:53,172   adding 'deepspeed/ops/lion/fused_lion.py'
2025-06-11T10:03:53,173   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2025-06-11T10:03:53,176   adding 'deepspeed/ops/op_builder/__init__.py'
2025-06-11T10:03:53,177   adding 'deepspeed/ops/op_builder/all_ops.py'
2025-06-11T10:03:53,178   adding 'deepspeed/ops/op_builder/async_io.py'
2025-06-11T10:03:53,182   adding 'deepspeed/ops/op_builder/builder.py'
2025-06-11T10:03:53,183   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2025-06-11T10:03:53,184   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2025-06-11T10:03:53,186   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2025-06-11T10:03:53,187   adding 'deepspeed/ops/op_builder/dc.py'
2025-06-11T10:03:53,188   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2025-06-11T10:03:53,190   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2025-06-11T10:03:53,191   adding 'deepspeed/ops/op_builder/fused_adam.py'
2025-06-11T10:03:53,192   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2025-06-11T10:03:53,194   adding 'deepspeed/ops/op_builder/fused_lion.py'
2025-06-11T10:03:53,195   adding 'deepspeed/ops/op_builder/gds.py'
2025-06-11T10:03:53,196   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2025-06-11T10:03:53,198   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2025-06-11T10:03:53,199   adding 'deepspeed/ops/op_builder/quantizer.py'
2025-06-11T10:03:53,200   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2025-06-11T10:03:53,202   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2025-06-11T10:03:53,203   adding 'deepspeed/ops/op_builder/random_ltd.py'
2025-06-11T10:03:53,204   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2025-06-11T10:03:53,205   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2025-06-11T10:03:53,207   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2025-06-11T10:03:53,208   adding 'deepspeed/ops/op_builder/transformer.py'
2025-06-11T10:03:53,209   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2025-06-11T10:03:53,211   adding 'deepspeed/ops/op_builder/utils.py'
2025-06-11T10:03:53,212   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2025-06-11T10:03:53,214   adding 'deepspeed/ops/op_builder/cpu/async_io.py'
2025-06-11T10:03:53,215   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2025-06-11T10:03:53,216   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2025-06-11T10:03:53,218   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2025-06-11T10:03:53,219   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2025-06-11T10:03:53,220   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2025-06-11T10:03:53,222   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2025-06-11T10:03:53,223   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2025-06-11T10:03:53,224   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2025-06-11T10:03:53,226   adding 'deepspeed/ops/op_builder/hpu/fp_quantizer.py'
2025-06-11T10:03:53,227   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2025-06-11T10:03:53,229   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2025-06-11T10:03:53,230   adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py'
2025-06-11T10:03:53,232   adding 'deepspeed/ops/op_builder/mlu/__init__.py'
2025-06-11T10:03:53,233   adding 'deepspeed/ops/op_builder/mlu/builder.py'
2025-06-11T10:03:53,235   adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py'
2025-06-11T10:03:53,236   adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py'
2025-06-11T10:03:53,237   adding 'deepspeed/ops/op_builder/mlu/fused_adam.py'
2025-06-11T10:03:53,239   adding 'deepspeed/ops/op_builder/mlu/no_impl.py'
2025-06-11T10:03:53,240   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2025-06-11T10:03:53,242   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2025-06-11T10:03:53,243   adding 'deepspeed/ops/op_builder/npu/builder.py'
2025-06-11T10:03:53,244   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2025-06-11T10:03:53,246   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2025-06-11T10:03:53,247   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2025-06-11T10:03:53,248   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2025-06-11T10:03:53,250   adding 'deepspeed/ops/op_builder/npu/inference.py'
2025-06-11T10:03:53,251   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2025-06-11T10:03:53,253   adding 'deepspeed/ops/op_builder/sdaa/__init__.py'
2025-06-11T10:03:53,254   adding 'deepspeed/ops/op_builder/sdaa/builder.py'
2025-06-11T10:03:53,255   adding 'deepspeed/ops/op_builder/sdaa/cpu_adam.py'
2025-06-11T10:03:53,257   adding 'deepspeed/ops/op_builder/sdaa/fused_adam.py'
2025-06-11T10:03:53,258   adding 'deepspeed/ops/op_builder/sdaa/no_impl.py'
2025-06-11T10:03:53,260   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2025-06-11T10:03:53,261   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2025-06-11T10:03:53,263   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2025-06-11T10:03:53,264   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2025-06-11T10:03:53,265   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2025-06-11T10:03:53,267   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2025-06-11T10:03:53,268   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2025-06-11T10:03:53,269   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2025-06-11T10:03:53,270   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2025-06-11T10:03:53,272   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2025-06-11T10:03:53,274   adding 'deepspeed/ops/quantizer/__init__.py'
2025-06-11T10:03:53,275   adding 'deepspeed/ops/quantizer/quantizer.py'
2025-06-11T10:03:53,277   adding 'deepspeed/ops/random_ltd/__init__.py'
2025-06-11T10:03:53,278   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2025-06-11T10:03:53,280   adding 'deepspeed/ops/sparse_attention/__init__.py'
2025-06-11T10:03:53,281   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2025-06-11T10:03:53,285   adding 'deepspeed/ops/sparse_attention/matmul.py'
2025-06-11T10:03:53,287   adding 'deepspeed/ops/sparse_attention/softmax.py'
2025-06-11T10:03:53,289   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2025-06-11T10:03:53,291   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2025-06-11T10:03:53,295   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2025-06-11T10:03:53,297   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2025-06-11T10:03:53,298   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2025-06-11T10:03:53,300   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2025-06-11T10:03:53,301   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2025-06-11T10:03:53,303   adding 'deepspeed/ops/transformer/__init__.py'
2025-06-11T10:03:53,305   adding 'deepspeed/ops/transformer/transformer.py'
2025-06-11T10:03:53,307   adding 'deepspeed/ops/transformer/inference/__init__.py'
2025-06-11T10:03:53,309   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2025-06-11T10:03:53,310   adding 'deepspeed/ops/transformer/inference/config.py'
2025-06-11T10:03:53,311   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2025-06-11T10:03:53,313   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2025-06-11T10:03:53,315   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2025-06-11T10:03:53,317   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2025-06-11T10:03:53,318   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2025-06-11T10:03:53,321   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2025-06-11T10:03:53,323   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2025-06-11T10:03:53,325   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2025-06-11T10:03:53,326   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2025-06-11T10:03:53,327   adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py'
2025-06-11T10:03:53,329   adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py'
2025-06-11T10:03:53,330   adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py'
2025-06-11T10:03:53,331   adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py'
2025-06-11T10:03:53,332   adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py'
2025-06-11T10:03:53,333   adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py'
2025-06-11T10:03:53,335   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2025-06-11T10:03:53,336   adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py'
2025-06-11T10:03:53,337   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2025-06-11T10:03:53,339   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2025-06-11T10:03:53,340   adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py'
2025-06-11T10:03:53,341   adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py'
2025-06-11T10:03:53,342   adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py'
2025-06-11T10:03:53,344   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2025-06-11T10:03:53,345   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2025-06-11T10:03:53,346   adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py'
2025-06-11T10:03:53,348   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2025-06-11T10:03:53,349   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2025-06-11T10:03:53,351   adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py'
2025-06-11T10:03:53,352   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2025-06-11T10:03:53,354   adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py'
2025-06-11T10:03:53,356   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2025-06-11T10:03:53,358   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2025-06-11T10:03:53,359   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2025-06-11T10:03:53,361   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2025-06-11T10:03:53,363   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2025-06-11T10:03:53,365   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2025-06-11T10:03:53,366   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2025-06-11T10:03:53,367   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2025-06-11T10:03:53,369   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2025-06-11T10:03:53,371   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2025-06-11T10:03:53,372   adding 'deepspeed/pipe/__init__.py'
2025-06-11T10:03:53,374   adding 'deepspeed/profiling/__init__.py'
2025-06-11T10:03:53,376   adding 'deepspeed/profiling/config.py'
2025-06-11T10:03:53,377   adding 'deepspeed/profiling/constants.py'
2025-06-11T10:03:53,379   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2025-06-11T10:03:53,385   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2025-06-11T10:03:53,387   adding 'deepspeed/runtime/__init__.py'
2025-06-11T10:03:53,389   adding 'deepspeed/runtime/base_optimizer.py'
2025-06-11T10:03:53,392   adding 'deepspeed/runtime/bf16_optimizer.py'
2025-06-11T10:03:53,393   adding 'deepspeed/runtime/compiler.py'
2025-06-11T10:03:53,397   adding 'deepspeed/runtime/config.py'
2025-06-11T10:03:53,400   adding 'deepspeed/runtime/config_utils.py'
2025-06-11T10:03:53,402   adding 'deepspeed/runtime/constants.py'
2025-06-11T10:03:53,403   adding 'deepspeed/runtime/dataloader.py'
2025-06-11T10:03:53,405   adding 'deepspeed/runtime/eigenvalue.py'
2025-06-11T10:03:53,426   adding 'deepspeed/runtime/engine.py'
2025-06-11T10:03:53,429   adding 'deepspeed/runtime/hybrid_engine.py'
2025-06-11T10:03:53,433   adding 'deepspeed/runtime/lr_schedules.py'
2025-06-11T10:03:53,435   adding 'deepspeed/runtime/precision_config.py'
2025-06-11T10:03:53,436   adding 'deepspeed/runtime/progressive_layer_drop.py'
2025-06-11T10:03:53,437   adding 'deepspeed/runtime/quantize.py'
2025-06-11T10:03:53,439   adding 'deepspeed/runtime/sparse_tensor.py'
2025-06-11T10:03:53,441   adding 'deepspeed/runtime/state_dict_factory.py'
2025-06-11T10:03:53,446   adding 'deepspeed/runtime/utils.py'
2025-06-11T10:03:53,448   adding 'deepspeed/runtime/weight_quantizer.py'
2025-06-11T10:03:53,450   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2025-06-11T10:03:53,454   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2025-06-11T10:03:53,456   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2025-06-11T10:03:53,458   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2025-06-11T10:03:53,459   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2025-06-11T10:03:53,461   adding 'deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py'
2025-06-11T10:03:53,462   adding 'deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py'
2025-06-11T10:03:53,463   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2025-06-11T10:03:53,465   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2025-06-11T10:03:53,466   adding 'deepspeed/runtime/checkpoint_engine/utils.py'
2025-06-11T10:03:53,468   adding 'deepspeed/runtime/comm/__init__.py'
2025-06-11T10:03:53,469   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2025-06-11T10:03:53,471   adding 'deepspeed/runtime/comm/compressed.py'
2025-06-11T10:03:53,472   adding 'deepspeed/runtime/comm/hccl.py'
2025-06-11T10:03:53,474   adding 'deepspeed/runtime/comm/mpi.py'
2025-06-11T10:03:53,476   adding 'deepspeed/runtime/comm/nccl.py'
2025-06-11T10:03:53,477   adding 'deepspeed/runtime/compression/__init__.py'
2025-06-11T10:03:53,479   adding 'deepspeed/runtime/compression/cupy.py'
2025-06-11T10:03:53,480   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2025-06-11T10:03:53,482   adding 'deepspeed/runtime/data_pipeline/config.py'
2025-06-11T10:03:53,483   adding 'deepspeed/runtime/data_pipeline/constants.py'
2025-06-11T10:03:53,485   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2025-06-11T10:03:53,487   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2025-06-11T10:03:53,488   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2025-06-11T10:03:53,490   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2025-06-11T10:03:53,491   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2025-06-11T10:03:53,492   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2025-06-11T10:03:53,494   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2025-06-11T10:03:53,499   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2025-06-11T10:03:53,502   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2025-06-11T10:03:53,505   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2025-06-11T10:03:53,507   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2025-06-11T10:03:53,510   adding 'deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py'
2025-06-11T10:03:53,512   adding 'deepspeed/runtime/domino/__init__.py'
2025-06-11T10:03:53,513   adding 'deepspeed/runtime/domino/async_linear.py'
2025-06-11T10:03:53,516   adding 'deepspeed/runtime/domino/transformer.py'
2025-06-11T10:03:53,517   adding 'deepspeed/runtime/fp16/__init__.py'
2025-06-11T10:03:53,520   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2025-06-11T10:03:53,522   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2025-06-11T10:03:53,525   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2025-06-11T10:03:53,527   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2025-06-11T10:03:53,529   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2025-06-11T10:03:53,532   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2025-06-11T10:03:53,534   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2025-06-11T10:03:53,536   adding 'deepspeed/runtime/model_checkpointing/__init__.py'
2025-06-11T10:03:53,537   adding 'deepspeed/runtime/model_checkpointing/config.py'
2025-06-11T10:03:53,538   adding 'deepspeed/runtime/model_checkpointing/constants.py'
2025-06-11T10:03:53,540   adding 'deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py'
2025-06-11T10:03:53,541   adding 'deepspeed/runtime/model_checkpointing/utils.py'
2025-06-11T10:03:53,543   adding 'deepspeed/runtime/model_checkpointing/writer_factory.py'
2025-06-11T10:03:53,545   adding 'deepspeed/runtime/pipe/__init__.py'
2025-06-11T10:03:53,551   adding 'deepspeed/runtime/pipe/engine.py'
2025-06-11T10:03:53,556   adding 'deepspeed/runtime/pipe/module.py'
2025-06-11T10:03:53,557   adding 'deepspeed/runtime/pipe/p2p.py'
2025-06-11T10:03:53,559   adding 'deepspeed/runtime/pipe/schedule.py'
2025-06-11T10:03:53,562   adding 'deepspeed/runtime/pipe/topology.py'
2025-06-11T10:03:53,564   adding 'deepspeed/runtime/sequence_parallel/__init__.py'
2025-06-11T10:03:53,565   adding 'deepspeed/runtime/sequence_parallel/parallel_state_sp.py'
2025-06-11T10:03:53,572   adding 'deepspeed/runtime/sequence_parallel/ulysses_sp.py'
2025-06-11T10:03:53,574   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2025-06-11T10:03:53,575   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2025-06-11T10:03:53,577   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2025-06-11T10:03:53,578   adding 'deepspeed/runtime/swap_tensor/constants.py'
2025-06-11T10:03:53,581   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2025-06-11T10:03:53,583   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2025-06-11T10:03:53,585   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2025-06-11T10:03:53,587   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2025-06-11T10:03:53,589   adding 'deepspeed/runtime/swap_tensor/utils.py'
2025-06-11T10:03:53,591   adding 'deepspeed/runtime/tensor_parallel/__init__.py'
2025-06-11T10:03:53,592   adding 'deepspeed/runtime/tensor_parallel/config.py'
2025-06-11T10:03:53,594   adding 'deepspeed/runtime/tensor_parallel/tp_manager.py'
2025-06-11T10:03:53,596   adding 'deepspeed/runtime/zero/__init__.py'
2025-06-11T10:03:53,598   adding 'deepspeed/runtime/zero/config.py'
2025-06-11T10:03:53,600   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2025-06-11T10:03:53,602   adding 'deepspeed/runtime/zero/linear.py'
2025-06-11T10:03:53,605   adding 'deepspeed/runtime/zero/mics.py'
2025-06-11T10:03:53,607   adding 'deepspeed/runtime/zero/mics_utils.py'
2025-06-11T10:03:53,608   adding 'deepspeed/runtime/zero/offload_config.py'
2025-06-11T10:03:53,610   adding 'deepspeed/runtime/zero/offload_states.py'
2025-06-11T10:03:53,613   adding 'deepspeed/runtime/zero/parameter_offload.py'
2025-06-11T10:03:53,626   adding 'deepspeed/runtime/zero/partition_parameters.py'
2025-06-11T10:03:53,630   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2025-06-11T10:03:53,632   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2025-06-11T10:03:53,649   adding 'deepspeed/runtime/zero/stage3.py'
2025-06-11T10:03:53,665   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2025-06-11T10:03:53,667   adding 'deepspeed/runtime/zero/test.py'
2025-06-11T10:03:53,669   adding 'deepspeed/runtime/zero/tiling.py'
2025-06-11T10:03:53,671   adding 'deepspeed/runtime/zero/utils.py'
2025-06-11T10:03:53,672   adding 'deepspeed/sequence/__init__.py'
2025-06-11T10:03:53,674   adding 'deepspeed/sequence/cross_entropy.py'
2025-06-11T10:03:53,678   adding 'deepspeed/sequence/fpdt_layer.py'
2025-06-11T10:03:53,681   adding 'deepspeed/sequence/layer.py'
2025-06-11T10:03:53,683   adding 'deepspeed/utils/__init__.py'
2025-06-11T10:03:53,685   adding 'deepspeed/utils/bwc.py'
2025-06-11T10:03:53,686   adding 'deepspeed/utils/comms_logging.py'
2025-06-11T10:03:53,688   adding 'deepspeed/utils/config.py'
2025-06-11T10:03:53,689   adding 'deepspeed/utils/debug.py'
2025-06-11T10:03:53,690   adding 'deepspeed/utils/exceptions.py'
2025-06-11T10:03:53,694   adding 'deepspeed/utils/groups.py'
2025-06-11T10:03:53,695   adding 'deepspeed/utils/init_on_device.py'
2025-06-11T10:03:53,697   adding 'deepspeed/utils/logging.py'
2025-06-11T10:03:53,698   adding 'deepspeed/utils/mixed_precision_linkage.py'
2025-06-11T10:03:53,700   adding 'deepspeed/utils/numa.py'
2025-06-11T10:03:53,701   adding 'deepspeed/utils/nvtx.py'
2025-06-11T10:03:53,704   adding 'deepspeed/utils/tensor_fragment.py'
2025-06-11T10:03:53,706   adding 'deepspeed/utils/timer.py'
2025-06-11T10:03:53,707   adding 'deepspeed/utils/torch.py'
2025-06-11T10:03:53,709   adding 'deepspeed/utils/types.py'
2025-06-11T10:03:53,710   adding 'deepspeed/utils/z3_leaf_module.py'
2025-06-11T10:03:53,714   adding 'deepspeed/utils/zero_to_fp32.py'
2025-06-11T10:03:53,716   adding 'deepspeed-0.17.1.data/scripts/deepspeed'
2025-06-11T10:03:53,717   adding 'deepspeed-0.17.1.data/scripts/deepspeed.pt'
2025-06-11T10:03:53,718   adding 'deepspeed-0.17.1.data/scripts/ds'
2025-06-11T10:03:53,719   adding 'deepspeed-0.17.1.data/scripts/ds_bench'
2025-06-11T10:03:53,721   adding 'deepspeed-0.17.1.data/scripts/ds_elastic'
2025-06-11T10:03:53,722   adding 'deepspeed-0.17.1.data/scripts/ds_io'
2025-06-11T10:03:53,723   adding 'deepspeed-0.17.1.data/scripts/ds_nvme_tune'
2025-06-11T10:03:53,724   adding 'deepspeed-0.17.1.data/scripts/ds_report'
2025-06-11T10:03:53,725   adding 'deepspeed-0.17.1.data/scripts/ds_ssh'
2025-06-11T10:03:53,726   adding 'deepspeed-0.17.1.data/scripts/dsr'
2025-06-11T10:03:53,730   adding 'deepspeed-0.17.1.dist-info/licenses/LICENSE'
2025-06-11T10:03:53,735   adding 'deepspeed-0.17.1.dist-info/METADATA'
2025-06-11T10:03:53,736   adding 'deepspeed-0.17.1.dist-info/WHEEL'
2025-06-11T10:03:53,737   adding 'deepspeed-0.17.1.dist-info/entry_points.txt'
2025-06-11T10:03:53,738   adding 'deepspeed-0.17.1.dist-info/top_level.txt'
2025-06-11T10:03:53,754   adding 'deepspeed-0.17.1.dist-info/RECORD'
2025-06-11T10:03:53,789   removing build/bdist.linux-armv7l/wheel
2025-06-11T10:03:54,042   deepspeed build time = 12.638381719589233 secs
2025-06-11T10:03:54,175   Building wheel for deepspeed (setup.py): finished with status 'done'
2025-06-11T10:03:54,194   Created wheel for deepspeed: filename=deepspeed-0.17.1-py3-none-any.whl size=1690731 sha256=317c4287d7bc03d677f5153dbc7225b5f6920c800dbbf1714eb61e2a5495b2b1
2025-06-11T10:03:54,196   Stored in directory: /tmp/pip-ephem-wheel-cache-19o84i2k/wheels/34/86/36/22db26525829160fd1c4add33d8a834ec046b90abf45cd363b
2025-06-11T10:03:54,243 Successfully built deepspeed
2025-06-11T10:03:54,304 Removed build tracker: '/tmp/pip-build-tracker-skad60r7'