2025-06-01T07:36:37,529 Created temporary directory: /tmp/pip-build-tracker-46libh5f
2025-06-01T07:36:37,530 Initialized build tracking at /tmp/pip-build-tracker-46libh5f
2025-06-01T07:36:37,530 Created build tracker: /tmp/pip-build-tracker-46libh5f
2025-06-01T07:36:37,531 Entered build tracker: /tmp/pip-build-tracker-46libh5f
2025-06-01T07:36:37,532 Created temporary directory: /tmp/pip-wheel-gvwgwb_o
2025-06-01T07:36:37,536 Created temporary directory: /tmp/pip-ephem-wheel-cache-tkgv8vqd
2025-06-01T07:36:37,587 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2025-06-01T07:36:37,589 2 location(s) to search for versions of deepspeed:
2025-06-01T07:36:37,589 * https://pypi.org/simple/deepspeed/
2025-06-01T07:36:37,589 * https://www.piwheels.org/simple/deepspeed/
2025-06-01T07:36:37,590 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2025-06-01T07:36:37,591 Getting page https://pypi.org/simple/deepspeed/
2025-06-01T07:36:37,593 Found index url https://pypi.org/simple/
2025-06-01T07:36:37,822 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2025-06-01T07:36:37,845   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T07:36:37,845   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2025-06-01T07:36:37,846   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T07:36:37,847   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2025-06-01T07:36:37,848   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T07:36:37,848   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2025-06-01T07:36:37,849   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T07:36:37,850   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2025-06-01T07:36:37,851   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T07:36:37,851   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2025-06-01T07:36:37,852   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2025-06-01T07:36:37,853   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2025-06-01T07:36:37,853   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2025-06-01T07:36:37,854   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2025-06-01T07:36:37,855   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2025-06-01T07:36:37,856   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2025-06-01T07:36:37,856   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2025-06-01T07:36:37,857   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2025-06-01T07:36:37,857   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2025-06-01T07:36:37,858   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2025-06-01T07:36:37,859   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2025-06-01T07:36:37,859   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2025-06-01T07:36:37,860   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2025-06-01T07:36:37,861   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2025-06-01T07:36:37,862   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2025-06-01T07:36:37,863   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2025-06-01T07:36:37,863   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2025-06-01T07:36:37,864   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2025-06-01T07:36:37,865   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2025-06-01T07:36:37,866   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2025-06-01T07:36:37,866   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2025-06-01T07:36:37,867   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2025-06-01T07:36:37,868   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2025-06-01T07:36:37,869   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2025-06-01T07:36:37,869   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2025-06-01T07:36:37,870   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2025-06-01T07:36:37,871   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2025-06-01T07:36:37,872   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2025-06-01T07:36:37,872   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2025-06-01T07:36:37,873   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2025-06-01T07:36:37,874   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2025-06-01T07:36:37,875   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2025-06-01T07:36:37,876   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2025-06-01T07:36:37,877   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2025-06-01T07:36:37,878   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2025-06-01T07:36:37,878   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2025-06-01T07:36:37,879   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2025-06-01T07:36:37,880   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2025-06-01T07:36:37,881   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2025-06-01T07:36:37,882   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2025-06-01T07:36:37,883   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2025-06-01T07:36:37,883   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2025-06-01T07:36:37,884   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2025-06-01T07:36:37,885   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2025-06-01T07:36:37,885   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2025-06-01T07:36:37,886   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2025-06-01T07:36:37,887   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2025-06-01T07:36:37,887   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2025-06-01T07:36:37,888   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2025-06-01T07:36:37,889   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2025-06-01T07:36:37,890   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2025-06-01T07:36:37,891   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2025-06-01T07:36:37,892   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2025-06-01T07:36:37,892   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2025-06-01T07:36:37,893   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2025-06-01T07:36:37,894   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2025-06-01T07:36:37,895   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2025-06-01T07:36:37,896   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2025-06-01T07:36:37,897   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2025-06-01T07:36:37,897   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2025-06-01T07:36:37,898   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2025-06-01T07:36:37,899   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2025-06-01T07:36:37,899   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2025-06-01T07:36:37,900   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2025-06-01T07:36:37,901   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2025-06-01T07:36:37,901   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2025-06-01T07:36:37,902   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2025-06-01T07:36:37,903   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2025-06-01T07:36:37,904   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2025-06-01T07:36:37,905   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2025-06-01T07:36:37,906   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2025-06-01T07:36:37,906   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2025-06-01T07:36:37,907   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2025-06-01T07:36:37,908   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2025-06-01T07:36:37,909   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2025-06-01T07:36:37,909   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2025-06-01T07:36:37,911   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2025-06-01T07:36:37,911   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2025-06-01T07:36:37,912   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2025-06-01T07:36:37,913   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2025-06-01T07:36:37,913   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2025-06-01T07:36:37,914   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2025-06-01T07:36:37,915   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2025-06-01T07:36:37,915   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2025-06-01T07:36:37,916   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2025-06-01T07:36:37,917   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2025-06-01T07:36:37,918   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T07:36:37,918   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2025-06-01T07:36:37,919   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T07:36:37,920   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2025-06-01T07:36:37,921   Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1
2025-06-01T07:36:37,922   Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2
2025-06-01T07:36:37,922   Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3
2025-06-01T07:36:37,923   Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4
2025-06-01T07:36:37,924   Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0
2025-06-01T07:36:37,925   Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1
2025-06-01T07:36:37,926   Found link https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.2
2025-06-01T07:36:37,927   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/52/23/cfe2166f06f1817b73b8695addd2fded55f4189322bcf181cfb7feaba550/deepspeed-0.16.3-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T07:36:37,927   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/ce/92/853de2a32b3f9c0945e0c9e145eddac98e570c1faebcd58aa85e6dcd89ba/deepspeed-0.16.3-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T07:36:37,928   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/55/8f/57ee424e114478a667c604b2f3f05bbc1addc0afc089b9ab6a64b233063d/deepspeed-0.16.3-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T07:36:37,928   Found link https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.3
2025-06-01T07:36:37,929   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/3d/65/1a6394f5d6dee851e9ea59e385f6d6428e3bfe36f83c06e0336e14dcfd11/deepspeed-0.16.4-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T07:36:37,930   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a3/aa/bb67b63cc25c5e29e4ca3f8b155e0faf74d5a33acf2ec67e249206a36b0f/deepspeed-0.16.4-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T07:36:37,931   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d4/59/fd251661b78b049eed7ee46f0d8d51c69ae7fbb710716a1ebcc796a6b0fd/deepspeed-0.16.4-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T07:36:37,932   Found link https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.4
2025-06-01T07:36:37,933   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/15/b0/be6cc74fd1e23da20d6c34db923858a8ae5017d39a13dedc188a935c646a/deepspeed-0.16.5-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T07:36:37,933   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/0b/78/9a87d137f83f53dd57f425ac174723c746c53029bf6cdce22eb9e805e3f0/deepspeed-0.16.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T07:36:37,934   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/80/f8/a9b1fca237fe8ea25f866956778280d0b735350f29fb6f4e0b548aa02a5f/deepspeed-0.16.5-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-01T07:36:37,935   Found link https://files.pythonhosted.org/packages/0d/88/96569b2acb3219c9c72068f9b952c59beffe366e7d1edd9e922e5c68f08b/deepspeed-0.16.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.5
2025-06-01T07:36:37,936   Found link https://files.pythonhosted.org/packages/cb/a3/1d758fcbcdb3f5ecf4e71907e293f17bae8a9f448b112e65c6195e90c2d3/deepspeed-0.16.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.6
2025-06-01T07:36:37,937   Found link https://files.pythonhosted.org/packages/06/b3/a3903de5c5b707170c5c27e1a40f4ef613f14d241bd84d8b151a2a8786f6/deepspeed-0.16.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.7
2025-06-01T07:36:37,938   Found link https://files.pythonhosted.org/packages/e1/27/f857569546dc97f64169df1cc35d1ec5161766c4a0ec32f2af5d39614a51/deepspeed-0.16.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.8
2025-06-01T07:36:37,938   Found link https://files.pythonhosted.org/packages/4f/5c/7542904cddfaa50a9a7ae6770349d468773359f5af1718865452cea8729d/deepspeed-0.16.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.9
2025-06-01T07:36:37,939   Found link https://files.pythonhosted.org/packages/1e/35/eef570f4da4a39d0e7f2e72757295fdba3718a8eca60d8d6dcfeb9e6f26d/deepspeed-0.17.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.0
2025-06-01T07:36:37,940   Found link https://files.pythonhosted.org/packages/38/10/a7f63e086c1e1c12e290c98363c748ef5ddd6313fde739d2aeccd5ed0cd4/deepspeed-0.17.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.1
2025-06-01T07:36:37,941   Found link https://files.pythonhosted.org/packages/8c/45/1ddcf8f8500d90fad9f3396bfb1295462d46a747ddcbfafcd7714d46827e/deepspeed-0.17.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.2
2025-06-01T07:36:37,941   Found link https://files.pythonhosted.org/packages/9e/6b/89faa30a38405cd2d7a81790b262673ca4c8e8ec97c2f8c433da04d7a002/deepspeed-0.17.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.3
2025-06-01T07:36:37,942   Found link https://files.pythonhosted.org/packages/84/b3/02d000bfd0d6f0ba3f5dac487e4151b3e9b4b3ee71336882102dc9ad79ad/deepspeed-0.17.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.4
2025-06-01T07:36:37,943   Found link https://files.pythonhosted.org/packages/46/e7/bc1e5868d85cb8e21c43915023e462b9a147f739f26d8584e3c46771ec67/deepspeed-0.17.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.5
2025-06-01T07:36:37,944 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2025-06-01T07:36:37,945 Getting page https://www.piwheels.org/simple/deepspeed/
2025-06-01T07:36:37,947 Found index url https://www.piwheels.org/simple/
2025-06-01T07:36:38,104 WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-01T07:36:38,760 WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-01T07:36:39,932 WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-01T07:36:42,107 WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-01T07:36:46,278 WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-01T07:36:46,448 Could not fetch URL https://www.piwheels.org/simple/deepspeed/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='www.piwheels.org', port=443): Max retries exceeded with url: /simple/deepspeed/ (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))) - skipping
2025-06-01T07:36:46,451 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2025-06-01T07:36:46,451 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2025-06-01T07:36:46,483 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2025-06-01T07:36:46,486 Collecting deepspeed==0.17.2
2025-06-01T07:36:46,488   Created temporary directory: /tmp/pip-unpack-1uxecdr6
2025-06-01T07:36:46,635   Downloading deepspeed-0.17.2.tar.gz (1.6 MB)
2025-06-01T07:36:49,585   Added deepspeed==0.17.2 from https://files.pythonhosted.org/packages/8c/45/1ddcf8f8500d90fad9f3396bfb1295462d46a747ddcbfafcd7714d46827e/deepspeed-0.17.2.tar.gz to build tracker '/tmp/pip-build-tracker-46libh5f'
2025-06-01T07:36:49,587   Running setup.py (path:/tmp/pip-wheel-gvwgwb_o/deepspeed_90cbc9e4f6324d00b24e5d890adc4112/setup.py) egg_info for package deepspeed
2025-06-01T07:36:49,588   Created temporary directory: /tmp/pip-pip-egg-info-ke1bkbs9
2025-06-01T07:36:49,589   Preparing metadata (setup.py): started
2025-06-01T07:36:49,590   Running command python setup.py egg_info
2025-06-01T07:36:50,679   fatal: not a git repository (or any of the parent directories): .git
2025-06-01T07:36:51,164   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-06-01T07:36:51,165    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-06-01T07:36:51,166   DS_BUILD_OPS=0
2025-06-01T07:36:51,166   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-06-01T07:36:51,167   version=0.17.2, git_hash=unknown, git_branch=unknown
2025-06-01T07:36:51,168   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-06-01T07:36:51,168   ext_modules=[]
2025-06-01T07:36:51,169   running egg_info
2025-06-01T07:36:51,194   creating /tmp/pip-pip-egg-info-ke1bkbs9/deepspeed.egg-info
2025-06-01T07:36:51,195   writing /tmp/pip-pip-egg-info-ke1bkbs9/deepspeed.egg-info/PKG-INFO
2025-06-01T07:36:51,231   writing dependency_links to /tmp/pip-pip-egg-info-ke1bkbs9/deepspeed.egg-info/dependency_links.txt
2025-06-01T07:36:51,233   writing entry points to /tmp/pip-pip-egg-info-ke1bkbs9/deepspeed.egg-info/entry_points.txt
2025-06-01T07:36:51,252   writing requirements to /tmp/pip-pip-egg-info-ke1bkbs9/deepspeed.egg-info/requires.txt
2025-06-01T07:36:51,253   writing top-level names to /tmp/pip-pip-egg-info-ke1bkbs9/deepspeed.egg-info/top_level.txt
2025-06-01T07:36:51,254   writing manifest file '/tmp/pip-pip-egg-info-ke1bkbs9/deepspeed.egg-info/SOURCES.txt'
2025-06-01T07:36:51,522   reading manifest file '/tmp/pip-pip-egg-info-ke1bkbs9/deepspeed.egg-info/SOURCES.txt'
2025-06-01T07:36:51,523   reading manifest template 'MANIFEST.in'
2025-06-01T07:36:51,525   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-06-01T07:36:51,526   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-06-01T07:36:53,572   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-06-01T07:36:54,752   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-06-01T07:36:55,553   warning: no files found matching '*.tr' under directory 'csrc'
2025-06-01T07:36:55,702   warning: no files found matching '*.cc' under directory 'csrc'
2025-06-01T07:36:55,762   warning: no files found matching '*.py' under directory 'benchmarks'
2025-06-01T07:36:55,769   adding license file 'LICENSE'
2025-06-01T07:36:55,816   writing manifest file '/tmp/pip-pip-egg-info-ke1bkbs9/deepspeed.egg-info/SOURCES.txt'
2025-06-01T07:36:55,818   deepspeed build time = 5.134986400604248 secs
2025-06-01T07:36:55,935   Preparing metadata (setup.py): finished with status 'done'
2025-06-01T07:36:55,941   Source in /tmp/pip-wheel-gvwgwb_o/deepspeed_90cbc9e4f6324d00b24e5d890adc4112 has version 0.17.2, which satisfies requirement deepspeed==0.17.2 from https://files.pythonhosted.org/packages/8c/45/1ddcf8f8500d90fad9f3396bfb1295462d46a747ddcbfafcd7714d46827e/deepspeed-0.17.2.tar.gz
2025-06-01T07:36:55,942   Removed deepspeed==0.17.2 from https://files.pythonhosted.org/packages/8c/45/1ddcf8f8500d90fad9f3396bfb1295462d46a747ddcbfafcd7714d46827e/deepspeed-0.17.2.tar.gz from build tracker '/tmp/pip-build-tracker-46libh5f'
2025-06-01T07:36:56,022 Created temporary directory: /tmp/pip-unpack-_8bbz0yw
2025-06-01T07:36:56,022 Created temporary directory: /tmp/pip-unpack-7oyfu32a
2025-06-01T07:36:56,023 Building wheels for collected packages: deepspeed
2025-06-01T07:36:56,027   Created temporary directory: /tmp/pip-wheel-agjf22ir
2025-06-01T07:36:56,027   DEPRECATION: Building 'deepspeed' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'deepspeed'. Discussion can be found at https://github.com/pypa/pip/issues/6334
2025-06-01T07:36:56,029   Building wheel for deepspeed (setup.py): started
2025-06-01T07:36:56,030   Destination directory: /tmp/pip-wheel-agjf22ir
2025-06-01T07:36:56,030   Running command python setup.py bdist_wheel
2025-06-01T07:36:56,519   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-06-01T07:36:56,522    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-06-01T07:36:56,654   DS_BUILD_OPS=0
2025-06-01T07:36:57,017   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-06-01T07:36:57,040   fatal: not a git repository (or any of the parent directories): .git
2025-06-01T07:36:57,042   version=0.17.2, git_hash=unknown, git_branch=unknown
2025-06-01T07:36:57,043   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-06-01T07:36:57,044   ext_modules=[]
2025-06-01T07:36:57,452   running bdist_wheel
2025-06-01T07:36:57,593   running build
2025-06-01T07:36:57,594   running build_py
2025-06-01T07:36:57,625   creating build/lib/deepspeed
2025-06-01T07:36:57,627   copying deepspeed/__init__.py -> build/lib/deepspeed
2025-06-01T07:36:57,630   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2025-06-01T07:36:57,632   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2025-06-01T07:36:57,634   copying deepspeed/env_report.py -> build/lib/deepspeed
2025-06-01T07:36:57,636   copying deepspeed/constants.py -> build/lib/deepspeed
2025-06-01T07:36:57,639   creating build/lib/deepspeed/linear
2025-06-01T07:36:57,640   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2025-06-01T07:36:57,643   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2025-06-01T07:36:57,645   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2025-06-01T07:36:57,647   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2025-06-01T07:36:57,649   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2025-06-01T07:36:57,652   creating build/lib/deepspeed/profiling
2025-06-01T07:36:57,653   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2025-06-01T07:36:57,655   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2025-06-01T07:36:57,657   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2025-06-01T07:36:57,660   creating build/lib/deepspeed/module_inject
2025-06-01T07:36:57,661   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2025-06-01T07:36:57,665   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2025-06-01T07:36:57,667   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2025-06-01T07:36:57,670   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2025-06-01T07:36:57,672   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2025-06-01T07:36:57,675   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2025-06-01T07:36:57,677   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2025-06-01T07:36:57,680   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2025-06-01T07:36:57,683   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2025-06-01T07:36:57,685   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2025-06-01T07:36:57,687   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2025-06-01T07:36:57,689   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2025-06-01T07:36:57,692   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2025-06-01T07:36:57,695   creating build/lib/deepspeed/utils
2025-06-01T07:36:57,697   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,699   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,701   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,703   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,706   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,708   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,711   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,713   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,715   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,717   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,719   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,722   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,725   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,727   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,730   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,732   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,734   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,738   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2025-06-01T07:36:57,740   creating build/lib/deepspeed/elasticity
2025-06-01T07:36:57,742   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2025-06-01T07:36:57,744   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2025-06-01T07:36:57,747   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2025-06-01T07:36:57,749   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2025-06-01T07:36:57,751   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2025-06-01T07:36:57,754   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2025-06-01T07:36:57,757   creating build/lib/deepspeed/checkpoint
2025-06-01T07:36:57,758   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2025-06-01T07:36:57,761   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2025-06-01T07:36:57,763   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2025-06-01T07:36:57,765   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2025-06-01T07:36:57,768   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2025-06-01T07:36:57,770   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-01T07:36:57,772   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2025-06-01T07:36:57,775   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-01T07:36:57,778   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2025-06-01T07:36:57,780   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-01T07:36:57,783   creating build/lib/deepspeed/nvme
2025-06-01T07:36:57,785   copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme
2025-06-01T07:36:57,787   copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme
2025-06-01T07:36:57,790   copying deepspeed/nvme/torch_fastio_engine.py -> build/lib/deepspeed/nvme
2025-06-01T07:36:57,792   copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme
2025-06-01T07:36:57,794   copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme
2025-06-01T07:36:57,797   copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme
2025-06-01T07:36:57,799   copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme
2025-06-01T07:36:57,802   copying deepspeed/nvme/ds_aio_constants.py -> build/lib/deepspeed/nvme
2025-06-01T07:36:57,804   copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme
2025-06-01T07:36:57,806   copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme
2025-06-01T07:36:57,808   copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme
2025-06-01T07:36:57,811   copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme
2025-06-01T07:36:57,813   copying deepspeed/nvme/torch_io.py -> build/lib/deepspeed/nvme
2025-06-01T07:36:57,815   copying deepspeed/nvme/io_engine.py -> build/lib/deepspeed/nvme
2025-06-01T07:36:57,817   copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme
2025-06-01T07:36:57,820   copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme
2025-06-01T07:36:57,822   creating build/lib/deepspeed/compression
2025-06-01T07:36:57,824   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2025-06-01T07:36:57,827   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2025-06-01T07:36:57,830   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2025-06-01T07:36:57,832   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2025-06-01T07:36:57,835   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2025-06-01T07:36:57,838   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2025-06-01T07:36:57,841   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2025-06-01T07:36:57,844   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2025-06-01T07:36:57,847   creating build/lib/deepspeed/io
2025-06-01T07:36:57,849   copying deepspeed/io/single_io_buffer.py -> build/lib/deepspeed/io
2025-06-01T07:36:57,851   copying deepspeed/io/base_io_buffer.py -> build/lib/deepspeed/io
2025-06-01T07:36:57,853   copying deepspeed/io/__init__.py -> build/lib/deepspeed/io
2025-06-01T07:36:57,856   copying deepspeed/io/mock_file_writer.py -> build/lib/deepspeed/io
2025-06-01T07:36:57,858   copying deepspeed/io/fast_file_writer.py -> build/lib/deepspeed/io
2025-06-01T07:36:57,861   copying deepspeed/io/double_io_buffer.py -> build/lib/deepspeed/io
2025-06-01T07:36:57,863   copying deepspeed/io/py_file_writer.py -> build/lib/deepspeed/io
2025-06-01T07:36:57,865   copying deepspeed/io/utils.py -> build/lib/deepspeed/io
2025-06-01T07:36:57,868   copying deepspeed/io/constants.py -> build/lib/deepspeed/io
2025-06-01T07:36:57,870   copying deepspeed/io/base_file_writer.py -> build/lib/deepspeed/io
2025-06-01T07:36:57,873   creating build/lib/deepspeed/ops
2025-06-01T07:36:57,874   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2025-06-01T07:36:57,876   creating build/lib/deepspeed/pipe
2025-06-01T07:36:57,878   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2025-06-01T07:36:57,880   creating build/lib/deepspeed/model_implementations
2025-06-01T07:36:57,881   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2025-06-01T07:36:57,884   creating build/lib/deepspeed/compile
2025-06-01T07:36:57,885   copying deepspeed/compile/__init__.py -> build/lib/deepspeed/compile
2025-06-01T07:36:57,887   copying deepspeed/compile/config.py -> build/lib/deepspeed/compile
2025-06-01T07:36:57,889   copying deepspeed/compile/list_schedule.py -> build/lib/deepspeed/compile
2025-06-01T07:36:57,892   copying deepspeed/compile/partitioner.py -> build/lib/deepspeed/compile
2025-06-01T07:36:57,895   copying deepspeed/compile/patch_fake_tensor.py -> build/lib/deepspeed/compile
2025-06-01T07:36:57,897   copying deepspeed/compile/inductor.py -> build/lib/deepspeed/compile
2025-06-01T07:36:57,899   copying deepspeed/compile/graph_param.py -> build/lib/deepspeed/compile
2025-06-01T07:36:57,901   copying deepspeed/compile/input_storage.py -> build/lib/deepspeed/compile
2025-06-01T07:36:57,904   copying deepspeed/compile/patch_compiled_func.py -> build/lib/deepspeed/compile
2025-06-01T07:36:57,906   copying deepspeed/compile/backend.py -> build/lib/deepspeed/compile
2025-06-01T07:36:57,909   copying deepspeed/compile/util.py -> build/lib/deepspeed/compile
2025-06-01T07:36:57,912   copying deepspeed/compile/init_z1.py -> build/lib/deepspeed/compile
2025-06-01T07:36:57,914   copying deepspeed/compile/init_z3.py -> build/lib/deepspeed/compile
2025-06-01T07:36:57,916   copying deepspeed/compile/fx.py -> build/lib/deepspeed/compile
2025-06-01T07:36:57,920   creating build/lib/deepspeed/monitor
2025-06-01T07:36:57,921   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2025-06-01T07:36:57,923   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2025-06-01T07:36:57,926   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2025-06-01T07:36:57,928   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2025-06-01T07:36:57,930   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2025-06-01T07:36:57,932   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2025-06-01T07:36:57,934   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2025-06-01T07:36:57,937   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2025-06-01T07:36:57,939   creating build/lib/deepspeed/autotuning
2025-06-01T07:36:57,941   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2025-06-01T07:36:57,944   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2025-06-01T07:36:57,946   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2025-06-01T07:36:57,949   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2025-06-01T07:36:57,953   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2025-06-01T07:36:57,956   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2025-06-01T07:36:57,959   creating build/lib/deepspeed/nebula
2025-06-01T07:36:57,960   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2025-06-01T07:36:57,963   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2025-06-01T07:36:57,965   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2025-06-01T07:36:57,968   creating build/lib/deepspeed/comm
2025-06-01T07:36:57,969   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2025-06-01T07:36:57,971   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2025-06-01T07:36:57,973   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2025-06-01T07:36:57,975   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2025-06-01T07:36:57,977   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2025-06-01T07:36:57,980   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2025-06-01T07:36:57,982   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2025-06-01T07:36:57,984   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2025-06-01T07:36:57,987   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2025-06-01T07:36:57,990   creating build/lib/deepspeed/launcher
2025-06-01T07:36:57,991   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2025-06-01T07:36:57,993   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2025-06-01T07:36:57,996   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2025-06-01T07:36:57,999   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2025-06-01T07:36:58,002   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2025-06-01T07:36:58,004   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2025-06-01T07:36:58,008   creating build/lib/deepspeed/sequence
2025-06-01T07:36:58,009   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2025-06-01T07:36:58,011   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2025-06-01T07:36:58,014   copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence
2025-06-01T07:36:58,018   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2025-06-01T07:36:58,021   creating build/lib/deepspeed/accelerator
2025-06-01T07:36:58,022   copying deepspeed/accelerator/sdaa_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T07:36:58,025   copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T07:36:58,028   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2025-06-01T07:36:58,030   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T07:36:58,033   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T07:36:58,035   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T07:36:58,038   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T07:36:58,041   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T07:36:58,043   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T07:36:58,046   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T07:36:58,049   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-01T07:36:58,052   creating build/lib/deepspeed/inference
2025-06-01T07:36:58,053   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2025-06-01T07:36:58,056   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2025-06-01T07:36:58,058   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2025-06-01T07:36:58,062   creating build/lib/deepspeed/moe
2025-06-01T07:36:58,064   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2025-06-01T07:36:58,067   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2025-06-01T07:36:58,069   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2025-06-01T07:36:58,071   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2025-06-01T07:36:58,073   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2025-06-01T07:36:58,076   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2025-06-01T07:36:58,079   creating build/lib/deepspeed/runtime
2025-06-01T07:36:58,080   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,082   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,084   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,086   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,088   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,091   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,094   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,097   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,099   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,102   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,104   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,107   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,109   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,111   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,113   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,116   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,120   copying deepspeed/runtime/torch_autocast.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,122   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,124   copying deepspeed/runtime/precision_config.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,126   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2025-06-01T07:36:58,133   creating build/lib/deepspeed/profiling/flops_profiler
2025-06-01T07:36:58,134   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2025-06-01T07:36:58,137   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2025-06-01T07:36:58,142   creating build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,143   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,146   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,148   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,151   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,153   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,156   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,158   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,160   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,163   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,166   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,168   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,171   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,174   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,176   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,178   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,181   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,183   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,186   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,189   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2025-06-01T07:36:58,193   creating build/lib/deepspeed/module_inject/containers/features
2025-06-01T07:36:58,194   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-01T07:36:58,197   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-01T07:36:58,199   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-01T07:36:58,202   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-01T07:36:58,204   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-01T07:36:58,207   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-01T07:36:58,210   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-01T07:36:58,214   creating build/lib/deepspeed/ops/deepspeed4science
2025-06-01T07:36:58,215   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2025-06-01T07:36:58,218   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2025-06-01T07:36:58,221   creating build/lib/deepspeed/ops/adagrad
2025-06-01T07:36:58,222   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2025-06-01T07:36:58,225   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2025-06-01T07:36:58,228   creating build/lib/deepspeed/ops/aio
2025-06-01T07:36:58,229   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2025-06-01T07:36:58,233   creating build/lib/deepspeed/ops/fp_quantizer
2025-06-01T07:36:58,234   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-01T07:36:58,237   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-01T07:36:58,239   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-01T07:36:58,242   copying deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-01T07:36:58,246   creating build/lib/deepspeed/ops/random_ltd
2025-06-01T07:36:58,247   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2025-06-01T07:36:58,250   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2025-06-01T07:36:58,253   creating build/lib/deepspeed/ops/lion
2025-06-01T07:36:58,255   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2025-06-01T07:36:58,258   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2025-06-01T07:36:58,260   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2025-06-01T07:36:58,263   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2025-06-01T07:36:58,266   creating build/lib/deepspeed/ops/transformer
2025-06-01T07:36:58,268   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2025-06-01T07:36:58,270   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2025-06-01T07:36:58,274   creating build/lib/deepspeed/ops/adam
2025-06-01T07:36:58,276   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2025-06-01T07:36:58,279   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2025-06-01T07:36:58,281   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2025-06-01T07:36:58,284   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2025-06-01T07:36:58,287   creating build/lib/deepspeed/ops/quantizer
2025-06-01T07:36:58,288   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2025-06-01T07:36:58,291   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2025-06-01T07:36:58,294   creating build/lib/deepspeed/ops/compile
2025-06-01T07:36:58,295   copying deepspeed/ops/compile/__init__.py -> build/lib/deepspeed/ops/compile
2025-06-01T07:36:58,298   creating build/lib/deepspeed/ops/lamb
2025-06-01T07:36:58,300   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2025-06-01T07:36:58,302   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2025-06-01T07:36:58,306   creating build/lib/deepspeed/ops/sparse_attention
2025-06-01T07:36:58,307   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-01T07:36:58,310   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-01T07:36:58,313   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-01T07:36:58,316   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-01T07:36:58,319   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-01T07:36:58,322   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-01T07:36:58,325   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-01T07:36:58,329   creating build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,331   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,334   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,336   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,339   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,342   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,344   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,347   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,349   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,352   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,354   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,357   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,359   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,362   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,364   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,367   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,369   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,372   copying deepspeed/ops/op_builder/dc.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,375   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,378   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,380   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,383   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,386   copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,388   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,391   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,394   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,397   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-06-01T07:36:58,400   creating build/lib/deepspeed/ops/gds
2025-06-01T07:36:58,402   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2025-06-01T07:36:58,405   creating build/lib/deepspeed/ops/transformer/inference
2025-06-01T07:36:58,407   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T07:36:58,410   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T07:36:58,412   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T07:36:58,416   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T07:36:58,419   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T07:36:58,422   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T07:36:58,425   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T07:36:58,428   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T07:36:58,431   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T07:36:58,434   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-01T07:36:58,438   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,439   copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,442   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,444   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,447   copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,450   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,453   copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,456   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,458   copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,461   copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,463   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,466   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,469   copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,472   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,475   copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,477   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,480   copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,483   copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,486   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,488   copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,491   copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,493   copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,496   copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,499   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:36:58,502   creating build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T07:36:58,504   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T07:36:58,507   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T07:36:58,510   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T07:36:58,513   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T07:36:58,516   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T07:36:58,519   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T07:36:58,522   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T07:36:58,525   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T07:36:58,528   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T07:36:58,531   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-01T07:36:58,534   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-01T07:36:58,536   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-01T07:36:58,539   creating build/lib/deepspeed/ops/op_builder/mlu
2025-06-01T07:36:58,541   copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-01T07:36:58,543   copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-01T07:36:58,546   copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-01T07:36:58,548   copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-01T07:36:58,551   copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-01T07:36:58,553   copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-01T07:36:58,557   creating build/lib/deepspeed/ops/op_builder/hpu
2025-06-01T07:36:58,558   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-01T07:36:58,561   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-01T07:36:58,564   copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-01T07:36:58,566   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-01T07:36:58,569   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-01T07:36:58,571   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-01T07:36:58,574   copying deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-01T07:36:58,577   creating build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T07:36:58,579   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T07:36:58,582   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T07:36:58,584   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T07:36:58,586   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T07:36:58,589   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T07:36:58,591   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T07:36:58,594   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T07:36:58,597   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T07:36:58,599   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T07:36:58,602   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-01T07:36:58,605   creating build/lib/deepspeed/ops/op_builder/npu
2025-06-01T07:36:58,607   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T07:36:58,610   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T07:36:58,613   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T07:36:58,615   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T07:36:58,618   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T07:36:58,620   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T07:36:58,623   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T07:36:58,626   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T07:36:58,628   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-01T07:36:58,631   creating build/lib/deepspeed/ops/op_builder/sdaa
2025-06-01T07:36:58,633   copying deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-01T07:36:58,636   copying deepspeed/ops/op_builder/sdaa/__init__.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-01T07:36:58,638   copying deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-01T07:36:58,641   copying deepspeed/ops/op_builder/sdaa/builder.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-01T07:36:58,643   copying deepspeed/ops/op_builder/sdaa/no_impl.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-01T07:36:58,646   creating build/lib/deepspeed/ops/op_builder/cpu
2025-06-01T07:36:58,648   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-01T07:36:58,650   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-01T07:36:58,653   copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-01T07:36:58,656   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-01T07:36:58,658   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-01T07:36:58,661   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-01T07:36:58,663   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-01T07:36:58,666   creating build/lib/deepspeed/model_implementations/features
2025-06-01T07:36:58,668   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2025-06-01T07:36:58,670   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2025-06-01T07:36:58,673   creating build/lib/deepspeed/model_implementations/diffusers
2025-06-01T07:36:58,675   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-01T07:36:58,678   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-01T07:36:58,680   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-01T07:36:58,683   creating build/lib/deepspeed/model_implementations/transformers
2025-06-01T07:36:58,685   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T07:36:58,687   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T07:36:58,690   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T07:36:58,693   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T07:36:58,695   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T07:36:58,698   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T07:36:58,700   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T07:36:58,703   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T07:36:58,705   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T07:36:58,708   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-01T07:36:58,711   creating build/lib/deepspeed/compile/passes
2025-06-01T07:36:58,713   copying deepspeed/compile/passes/__init__.py -> build/lib/deepspeed/compile/passes
2025-06-01T07:36:58,715   copying deepspeed/compile/passes/zero1_compile.py -> build/lib/deepspeed/compile/passes
2025-06-01T07:36:58,718   copying deepspeed/compile/passes/offload_activation.py -> build/lib/deepspeed/compile/passes
2025-06-01T07:36:58,720   copying deepspeed/compile/passes/offload_adam_states.py -> build/lib/deepspeed/compile/passes
2025-06-01T07:36:58,724   copying deepspeed/compile/passes/zero3_compile.py -> build/lib/deepspeed/compile/passes
2025-06-01T07:36:58,726   copying deepspeed/compile/passes/selective_gather.py -> build/lib/deepspeed/compile/passes
2025-06-01T07:36:58,729   copying deepspeed/compile/passes/offload_parameters.py -> build/lib/deepspeed/compile/passes
2025-06-01T07:36:58,732   copying deepspeed/compile/passes/prefetch.py -> build/lib/deepspeed/compile/passes
2025-06-01T07:36:58,735   creating build/lib/deepspeed/compile/profilers
2025-06-01T07:36:58,736   copying deepspeed/compile/profilers/comm_profile.py -> build/lib/deepspeed/compile/profilers
2025-06-01T07:36:58,739   copying deepspeed/compile/profilers/graph_profile.py -> build/lib/deepspeed/compile/profilers
2025-06-01T07:36:58,741   copying deepspeed/compile/profilers/__init__.py -> build/lib/deepspeed/compile/profilers
2025-06-01T07:36:58,744   creating build/lib/deepspeed/autotuning/tuner
2025-06-01T07:36:58,745   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2025-06-01T07:36:58,747   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-01T07:36:58,749   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-01T07:36:58,752   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2025-06-01T07:36:58,754   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2025-06-01T07:36:58,756   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-01T07:36:58,759   creating build/lib/deepspeed/inference/quantization
2025-06-01T07:36:58,760   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2025-06-01T07:36:58,763   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2025-06-01T07:36:58,765   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2025-06-01T07:36:58,767   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2025-06-01T07:36:58,770   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2025-06-01T07:36:58,773   creating build/lib/deepspeed/inference/v2
2025-06-01T07:36:58,774   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2025-06-01T07:36:58,777   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2025-06-01T07:36:58,779   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2025-06-01T07:36:58,781   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2025-06-01T07:36:58,784   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2025-06-01T07:36:58,786   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2025-06-01T07:36:58,788   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2025-06-01T07:36:58,791   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2025-06-01T07:36:58,793   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2025-06-01T07:36:58,796   creating build/lib/deepspeed/inference/v2/checkpoint
2025-06-01T07:36:58,798   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-01T07:36:58,800   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-01T07:36:58,802   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-01T07:36:58,805   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-01T07:36:58,808   creating build/lib/deepspeed/inference/v2/kernels
2025-06-01T07:36:58,809   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2025-06-01T07:36:58,812   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2025-06-01T07:36:58,815   creating build/lib/deepspeed/inference/v2/model_implementations
2025-06-01T07:36:58,816   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-01T07:36:58,819   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-01T07:36:58,822   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-01T07:36:58,824   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-01T07:36:58,827   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-01T07:36:58,829   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-01T07:36:58,832   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-01T07:36:58,836   creating build/lib/deepspeed/inference/v2/modules
2025-06-01T07:36:58,837   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2025-06-01T07:36:58,840   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2025-06-01T07:36:58,842   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2025-06-01T07:36:58,844   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2025-06-01T07:36:58,847   creating build/lib/deepspeed/inference/v2/ragged
2025-06-01T07:36:58,849   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-01T07:36:58,851   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-01T07:36:58,854   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-01T07:36:58,856   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-01T07:36:58,859   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-01T07:36:58,861   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-01T07:36:58,864   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-01T07:36:58,867   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-01T07:36:58,868   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-01T07:36:58,871   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-01T07:36:58,873   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-01T07:36:58,876   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-01T07:36:58,877   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-01T07:36:58,880   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T07:36:58,881   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T07:36:58,884   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T07:36:58,887   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T07:36:58,888   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T07:36:58,891   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T07:36:58,894   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T07:36:58,895   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T07:36:58,898   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T07:36:58,901   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T07:36:58,902   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T07:36:58,904   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T07:36:58,906   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T07:36:58,909   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T07:36:58,911   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T07:36:58,913   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T07:36:58,915   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T07:36:58,918   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:36:58,919   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:36:58,922   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:36:58,924   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:36:58,927   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:36:58,929   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:36:58,932   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T07:36:58,933   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T07:36:58,936   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T07:36:58,939   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T07:36:58,941   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T07:36:58,943   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T07:36:58,945   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T07:36:58,948   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T07:36:58,949   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T07:36:58,952   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T07:36:58,954   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T07:36:58,955   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T07:36:58,957   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T07:36:58,960   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T07:36:58,962   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T07:36:58,964   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T07:36:58,967   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T07:36:58,968   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T07:36:58,971   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T07:36:58,974   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T07:36:58,975   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T07:36:58,978   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T07:36:58,981   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T07:36:58,982   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T07:36:58,984   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T07:36:58,987   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:36:58,989   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:36:58,991   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:36:58,994   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:36:58,996   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:36:58,999   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T07:36:59,001   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T07:36:59,003   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T07:36:59,006   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-01T07:36:59,007   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-01T07:36:59,010   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-01T07:36:59,013   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-01T07:36:59,015   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-01T07:36:59,018   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:36:59,020   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:36:59,022   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:36:59,024   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:36:59,027   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:36:59,029   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:36:59,032   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:36:59,035   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:36:59,037   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:36:59,039   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:36:59,042   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-01T07:36:59,044   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-01T07:36:59,046   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-01T07:36:59,048   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-01T07:36:59,051   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-01T07:36:59,054   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T07:36:59,055   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T07:36:59,058   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T07:36:59,060   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T07:36:59,062   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T07:36:59,065   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-01T07:36:59,067   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-01T07:36:59,069   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-01T07:36:59,071   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-01T07:36:59,073   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-01T07:36:59,076   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-01T07:36:59,078   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-01T07:36:59,080   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-01T07:36:59,082   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-01T07:36:59,084   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-01T07:36:59,088   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T07:36:59,089   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T07:36:59,092   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T07:36:59,094   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T07:36:59,096   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T07:36:59,099   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:36:59,100   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:36:59,103   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:36:59,105   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:36:59,107   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:36:59,109   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:36:59,112   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:36:59,114   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:36:59,116   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:36:59,118   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:36:59,121   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T07:36:59,122   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T07:36:59,125   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T07:36:59,127   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T07:36:59,129   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T07:36:59,132   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-01T07:36:59,133   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-01T07:36:59,136   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-01T07:36:59,138   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-01T07:36:59,140   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-01T07:36:59,143   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T07:36:59,145   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T07:36:59,147   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T07:36:59,149   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T07:36:59,151   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T07:36:59,154   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-01T07:36:59,156   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-01T07:36:59,158   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-01T07:36:59,160   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-01T07:36:59,163   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-01T07:36:59,166   creating build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T07:36:59,167   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T07:36:59,169   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T07:36:59,172   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T07:36:59,174   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T07:36:59,176   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T07:36:59,178   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T07:36:59,181   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T07:36:59,183   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-01T07:36:59,186   creating build/lib/deepspeed/inference/v2/modules/configs
2025-06-01T07:36:59,187   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-01T07:36:59,189   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-01T07:36:59,191   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-01T07:36:59,194   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-01T07:36:59,195   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-01T07:36:59,197   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-01T07:36:59,199   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-01T07:36:59,202   creating build/lib/deepspeed/inference/v2/modules/implementations
2025-06-01T07:36:59,203   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2025-06-01T07:36:59,206   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-01T07:36:59,207   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-01T07:36:59,210   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-01T07:36:59,212   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-01T07:36:59,214   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-01T07:36:59,215   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-01T07:36:59,218   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-01T07:36:59,221   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-01T07:36:59,222   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-01T07:36:59,224   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-01T07:36:59,227   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-01T07:36:59,228   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-01T07:36:59,230   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-01T07:36:59,234   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-01T07:36:59,235   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-01T07:36:59,238   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-01T07:36:59,241   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-01T07:36:59,242   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-01T07:36:59,245   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-01T07:36:59,247   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-01T07:36:59,250   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-01T07:36:59,251   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-01T07:36:59,254   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-01T07:36:59,257   creating build/lib/deepspeed/runtime/domino
2025-06-01T07:36:59,259   copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino
2025-06-01T07:36:59,261   copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino
2025-06-01T07:36:59,264   copying deepspeed/runtime/domino/async_linear.py -> build/lib/deepspeed/runtime/domino
2025-06-01T07:36:59,268   creating build/lib/deepspeed/runtime/data_pipeline
2025-06-01T07:36:59,269   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-01T07:36:59,271   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-01T07:36:59,274   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-01T07:36:59,277   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-01T07:36:59,280   creating build/lib/deepspeed/runtime/tensor_parallel
2025-06-01T07:36:59,281   copying deepspeed/runtime/tensor_parallel/__init__.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-01T07:36:59,283   copying deepspeed/runtime/tensor_parallel/config.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-01T07:36:59,286   copying deepspeed/runtime/tensor_parallel/tp_manager.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-01T07:36:59,289   creating build/lib/deepspeed/runtime/compression
2025-06-01T07:36:59,290   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2025-06-01T07:36:59,293   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2025-06-01T07:36:59,295   creating build/lib/deepspeed/runtime/model_checkpointing
2025-06-01T07:36:59,297   copying deepspeed/runtime/model_checkpointing/__init__.py -> build/lib/deepspeed/runtime/model_checkpointing
2025-06-01T07:36:59,299   copying deepspeed/runtime/model_checkpointing/config.py -> build/lib/deepspeed/runtime/model_checkpointing
2025-06-01T07:36:59,302   copying deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py -> build/lib/deepspeed/runtime/model_checkpointing
2025-06-01T07:36:59,304   copying deepspeed/runtime/model_checkpointing/utils.py -> build/lib/deepspeed/runtime/model_checkpointing
2025-06-01T07:36:59,307   copying deepspeed/runtime/model_checkpointing/constants.py -> build/lib/deepspeed/runtime/model_checkpointing
2025-06-01T07:36:59,309   copying deepspeed/runtime/model_checkpointing/writer_factory.py -> build/lib/deepspeed/runtime/model_checkpointing
2025-06-01T07:36:59,313   creating build/lib/deepspeed/runtime/pipe
2025-06-01T07:36:59,314   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2025-06-01T07:36:59,316   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2025-06-01T07:36:59,319   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2025-06-01T07:36:59,322   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2025-06-01T07:36:59,325   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2025-06-01T07:36:59,329   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2025-06-01T07:36:59,333   creating build/lib/deepspeed/runtime/swap_tensor
2025-06-01T07:36:59,334   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T07:36:59,337   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T07:36:59,340   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T07:36:59,343   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T07:36:59,346   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T07:36:59,350   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T07:36:59,353   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T07:36:59,355   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T07:36:59,358   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-01T07:36:59,362   creating build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,363   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,366   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,368   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,371   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,374   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,376   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,382   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,385   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,388   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,391   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,394   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,396   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,402   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,405   copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,407   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,412   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,415   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2025-06-01T07:36:59,419   creating build/lib/deepspeed/runtime/sequence_parallel
2025-06-01T07:36:59,420   copying deepspeed/runtime/sequence_parallel/__init__.py -> build/lib/deepspeed/runtime/sequence_parallel
2025-06-01T07:36:59,423   copying deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/lib/deepspeed/runtime/sequence_parallel
2025-06-01T07:36:59,426   copying deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/lib/deepspeed/runtime/sequence_parallel
2025-06-01T07:36:59,429   creating build/lib/deepspeed/runtime/comm
2025-06-01T07:36:59,431   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2025-06-01T07:36:59,433   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2025-06-01T07:36:59,435   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2025-06-01T07:36:59,438   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2025-06-01T07:36:59,441   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2025-06-01T07:36:59,443   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2025-06-01T07:36:59,446   creating build/lib/deepspeed/runtime/checkpoint_engine
2025-06-01T07:36:59,447   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-01T07:36:59,450   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-01T07:36:59,452   copying deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-01T07:36:59,454   copying deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-01T07:36:59,456   copying deepspeed/runtime/checkpoint_engine/utils.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-01T07:36:59,459   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-01T07:36:59,461   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-01T07:36:59,465   creating build/lib/deepspeed/runtime/fp16
2025-06-01T07:36:59,466   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2025-06-01T07:36:59,469   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-06-01T07:36:59,472   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2025-06-01T07:36:59,475   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-06-01T07:36:59,478   creating build/lib/deepspeed/runtime/activation_checkpointing
2025-06-01T07:36:59,479   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-01T07:36:59,482   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-01T07:36:59,484   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-01T07:36:59,488   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-01T07:36:59,489   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-01T07:36:59,492   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-01T07:36:59,494   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-01T07:36:59,497   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-01T07:36:59,500   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-01T07:36:59,503   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T07:36:59,504   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T07:36:59,507   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T07:36:59,510   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T07:36:59,538   copying deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T07:36:59,542   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T07:36:59,545   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T07:36:59,550   creating build/lib/deepspeed/runtime/fp16/onebit
2025-06-01T07:36:59,551   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-01T07:36:59,554   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-01T07:36:59,558   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-01T07:36:59,561   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-01T07:36:59,566   running egg_info
2025-06-01T07:36:59,599   writing deepspeed.egg-info/PKG-INFO
2025-06-01T07:36:59,635   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2025-06-01T07:36:59,636   writing entry points to deepspeed.egg-info/entry_points.txt
2025-06-01T07:36:59,654   writing requirements to deepspeed.egg-info/requires.txt
2025-06-01T07:36:59,656   writing top-level names to deepspeed.egg-info/top_level.txt
2025-06-01T07:36:59,804   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-06-01T07:36:59,898   reading manifest template 'MANIFEST.in'
2025-06-01T07:36:59,900   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-06-01T07:36:59,901   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-06-01T07:37:01,991   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-06-01T07:37:03,328   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-06-01T07:37:04,277   warning: no files found matching '*.tr' under directory 'csrc'
2025-06-01T07:37:04,493   warning: no files found matching '*.cc' under directory 'csrc'
2025-06-01T07:37:04,557   warning: no files found matching '*.py' under directory 'benchmarks'
2025-06-01T07:37:04,565   adding license file 'LICENSE'
2025-06-01T07:37:04,627   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-06-01T07:37:04,639   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2025-06-01T07:37:04,640   !!

2025-06-01T07:37:04,643           ********************************************************************************
2025-06-01T07:37:04,645           ############################
2025-06-01T07:37:04,646           # Package would be ignored #
2025-06-01T07:37:04,648           ############################
2025-06-01T07:37:04,650           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2025-06-01T07:37:04,651           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:04,655           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:04,657           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2025-06-01T07:37:04,659           to the `packages` configuration field.

2025-06-01T07:37:04,662           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:04,664           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:04,665           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:04,668           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:04,671           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:04,676           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2025-06-01T07:37:04,677           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2025-06-01T07:37:04,678           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:04,680           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:04,681           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:04,684           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:04,686           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:04,690           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:04,691                 even if it does not contain any `.py` files.
2025-06-01T07:37:04,692                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:04,694                 directory, all directories are treated like packages.
2025-06-01T07:37:04,694           ********************************************************************************

2025-06-01T07:37:04,696   !!
2025-06-01T07:37:04,697     check.warn(importable)
2025-06-01T07:37:04,698   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2025-06-01T07:37:04,699   !!

2025-06-01T07:37:04,701           ********************************************************************************
2025-06-01T07:37:04,702           ############################
2025-06-01T07:37:04,703           # Package would be ignored #
2025-06-01T07:37:04,704           ############################
2025-06-01T07:37:04,705           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2025-06-01T07:37:04,706           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:04,708           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:04,709           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2025-06-01T07:37:04,710           to the `packages` configuration field.

2025-06-01T07:37:04,712           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:04,713           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:04,714           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:04,716           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:04,718           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:04,720           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2025-06-01T07:37:04,721           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2025-06-01T07:37:04,722           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:04,724           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:04,725           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:04,727           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:04,730           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:04,734           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:04,735                 even if it does not contain any `.py` files.
2025-06-01T07:37:04,737                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:04,738                 directory, all directories are treated like packages.
2025-06-01T07:37:04,741           ********************************************************************************

2025-06-01T07:37:04,744   !!
2025-06-01T07:37:04,745     check.warn(importable)
2025-06-01T07:37:04,747   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2025-06-01T07:37:04,748   !!

2025-06-01T07:37:04,752           ********************************************************************************
2025-06-01T07:37:04,753           ############################
2025-06-01T07:37:04,755           # Package would be ignored #
2025-06-01T07:37:04,757           ############################
2025-06-01T07:37:04,758           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2025-06-01T07:37:04,759           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:04,760           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:04,760           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2025-06-01T07:37:04,761           to the `packages` configuration field.

2025-06-01T07:37:04,762           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:04,763           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:04,763           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:04,765           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:04,766           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:04,767           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2025-06-01T07:37:04,768           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2025-06-01T07:37:04,768           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:04,769           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:04,770           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:04,771           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:04,773           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:04,775           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:04,775                 even if it does not contain any `.py` files.
2025-06-01T07:37:04,776                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:04,777                 directory, all directories are treated like packages.
2025-06-01T07:37:04,778           ********************************************************************************

2025-06-01T07:37:04,779   !!
2025-06-01T07:37:04,780     check.warn(importable)
2025-06-01T07:37:04,780   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2025-06-01T07:37:04,781   !!

2025-06-01T07:37:04,782           ********************************************************************************
2025-06-01T07:37:04,783           ############################
2025-06-01T07:37:04,784           # Package would be ignored #
2025-06-01T07:37:04,784           ############################
2025-06-01T07:37:04,785           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2025-06-01T07:37:04,786           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:04,787           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:04,787           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2025-06-01T07:37:04,788           to the `packages` configuration field.

2025-06-01T07:37:04,789           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:04,789           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:04,790           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:04,791           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:04,791           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:04,792           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2025-06-01T07:37:04,793           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2025-06-01T07:37:04,793           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:04,794           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:04,794           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:04,796           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:04,797           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:04,799           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:04,800                 even if it does not contain any `.py` files.
2025-06-01T07:37:04,801                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:04,802                 directory, all directories are treated like packages.
2025-06-01T07:37:04,803           ********************************************************************************

2025-06-01T07:37:04,805   !!
2025-06-01T07:37:04,806     check.warn(importable)
2025-06-01T07:37:04,807   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2025-06-01T07:37:04,808   !!

2025-06-01T07:37:04,811           ********************************************************************************
2025-06-01T07:37:04,812           ############################
2025-06-01T07:37:04,814           # Package would be ignored #
2025-06-01T07:37:04,815           ############################
2025-06-01T07:37:04,816           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2025-06-01T07:37:04,818           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:04,821           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:04,822           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2025-06-01T07:37:04,824           to the `packages` configuration field.

2025-06-01T07:37:04,827           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:04,828           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:04,830           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:04,833           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:04,836           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:04,838           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2025-06-01T07:37:04,840           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2025-06-01T07:37:04,842           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:04,843           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:04,846           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:04,850           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:04,853           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:04,857           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:04,859                 even if it does not contain any `.py` files.
2025-06-01T07:37:04,860                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:04,861                 directory, all directories are treated like packages.
2025-06-01T07:37:04,862           ********************************************************************************

2025-06-01T07:37:04,863   !!
2025-06-01T07:37:04,863     check.warn(importable)
2025-06-01T07:37:04,864   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2025-06-01T07:37:04,864   !!

2025-06-01T07:37:04,865           ********************************************************************************
2025-06-01T07:37:04,866           ############################
2025-06-01T07:37:04,867           # Package would be ignored #
2025-06-01T07:37:04,867           ############################
2025-06-01T07:37:04,868           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2025-06-01T07:37:04,869           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:04,870           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:04,871           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2025-06-01T07:37:04,872           to the `packages` configuration field.

2025-06-01T07:37:04,873           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:04,874           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:04,875           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:04,877           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:04,879           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:04,881           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2025-06-01T07:37:04,882           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2025-06-01T07:37:04,883           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:04,884           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:04,885           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:04,887           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:04,889           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:04,892           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:04,893                 even if it does not contain any `.py` files.
2025-06-01T07:37:04,894                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:04,895                 directory, all directories are treated like packages.
2025-06-01T07:37:04,896           ********************************************************************************

2025-06-01T07:37:04,898   !!
2025-06-01T07:37:04,899     check.warn(importable)
2025-06-01T07:37:04,901   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2025-06-01T07:37:04,902   !!

2025-06-01T07:37:04,905           ********************************************************************************
2025-06-01T07:37:04,906           ############################
2025-06-01T07:37:04,907           # Package would be ignored #
2025-06-01T07:37:04,908           ############################
2025-06-01T07:37:04,910           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2025-06-01T07:37:04,911           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:04,913           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:04,914           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2025-06-01T07:37:04,916           to the `packages` configuration field.

2025-06-01T07:37:04,918           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:04,919           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:04,920           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:04,923           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:04,925           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:04,926           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2025-06-01T07:37:04,926           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2025-06-01T07:37:04,927           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:04,927           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:04,928           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:04,929           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:04,931           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:04,933           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:04,934                 even if it does not contain any `.py` files.
2025-06-01T07:37:04,935                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:04,935                 directory, all directories are treated like packages.
2025-06-01T07:37:04,936           ********************************************************************************

2025-06-01T07:37:04,937   !!
2025-06-01T07:37:04,938     check.warn(importable)
2025-06-01T07:37:04,938   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2025-06-01T07:37:04,939   !!

2025-06-01T07:37:04,940           ********************************************************************************
2025-06-01T07:37:04,941           ############################
2025-06-01T07:37:04,942           # Package would be ignored #
2025-06-01T07:37:04,942           ############################
2025-06-01T07:37:04,943           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2025-06-01T07:37:04,943           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:04,945           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:04,946           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2025-06-01T07:37:04,946           to the `packages` configuration field.

2025-06-01T07:37:04,947           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:04,948           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:04,949           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:04,950           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:04,951           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:04,952           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2025-06-01T07:37:04,952           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2025-06-01T07:37:04,952           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:04,953           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:04,953           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:04,954           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:04,955           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:04,956           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:04,957                 even if it does not contain any `.py` files.
2025-06-01T07:37:04,957                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:04,958                 directory, all directories are treated like packages.
2025-06-01T07:37:04,958           ********************************************************************************

2025-06-01T07:37:04,959   !!
2025-06-01T07:37:04,960     check.warn(importable)
2025-06-01T07:37:04,960   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2025-06-01T07:37:04,961   !!

2025-06-01T07:37:04,962           ********************************************************************************
2025-06-01T07:37:04,963           ############################
2025-06-01T07:37:04,964           # Package would be ignored #
2025-06-01T07:37:04,964           ############################
2025-06-01T07:37:04,965           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2025-06-01T07:37:04,966           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:04,967           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:04,967           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2025-06-01T07:37:04,968           to the `packages` configuration field.

2025-06-01T07:37:04,969           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:04,970           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:04,971           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:04,973           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:04,974           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:04,975           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2025-06-01T07:37:04,976           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2025-06-01T07:37:04,976           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:04,977           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:04,978           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:04,979           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:04,980           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:04,982           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:04,982                 even if it does not contain any `.py` files.
2025-06-01T07:37:04,983                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:04,984                 directory, all directories are treated like packages.
2025-06-01T07:37:04,984           ********************************************************************************

2025-06-01T07:37:04,985   !!
2025-06-01T07:37:04,985     check.warn(importable)
2025-06-01T07:37:04,986   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2025-06-01T07:37:04,986   !!

2025-06-01T07:37:04,987           ********************************************************************************
2025-06-01T07:37:04,988           ############################
2025-06-01T07:37:04,988           # Package would be ignored #
2025-06-01T07:37:04,989           ############################
2025-06-01T07:37:04,989           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2025-06-01T07:37:04,990           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:04,990           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:04,991           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2025-06-01T07:37:04,991           to the `packages` configuration field.

2025-06-01T07:37:04,992           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:04,993           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:04,993           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:04,994           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:04,995           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:04,996           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2025-06-01T07:37:04,997           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2025-06-01T07:37:04,998           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:04,998           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:04,999           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,000           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,001           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,003           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,004                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,004                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,005                 directory, all directories are treated like packages.
2025-06-01T07:37:05,005           ********************************************************************************

2025-06-01T07:37:05,007   !!
2025-06-01T07:37:05,007     check.warn(importable)
2025-06-01T07:37:05,008   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2025-06-01T07:37:05,008   !!

2025-06-01T07:37:05,009           ********************************************************************************
2025-06-01T07:37:05,010           ############################
2025-06-01T07:37:05,011           # Package would be ignored #
2025-06-01T07:37:05,011           ############################
2025-06-01T07:37:05,012           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2025-06-01T07:37:05,013           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,014           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,015           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2025-06-01T07:37:05,016           to the `packages` configuration field.

2025-06-01T07:37:05,016           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,017           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,017           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,018           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,019           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,020           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2025-06-01T07:37:05,021           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2025-06-01T07:37:05,021           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,022           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,022           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,023           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,024           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,025           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,026                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,026                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,027                 directory, all directories are treated like packages.
2025-06-01T07:37:05,027           ********************************************************************************

2025-06-01T07:37:05,029   !!
2025-06-01T07:37:05,029     check.warn(importable)
2025-06-01T07:37:05,030   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2025-06-01T07:37:05,031   !!

2025-06-01T07:37:05,032           ********************************************************************************
2025-06-01T07:37:05,033           ############################
2025-06-01T07:37:05,033           # Package would be ignored #
2025-06-01T07:37:05,034           ############################
2025-06-01T07:37:05,035           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2025-06-01T07:37:05,035           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,037           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,037           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2025-06-01T07:37:05,038           to the `packages` configuration field.

2025-06-01T07:37:05,039           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,039           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,040           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,041           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,042           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,043           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2025-06-01T07:37:05,044           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2025-06-01T07:37:05,045           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,045           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,046           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,047           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,048           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,049           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,050                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,050                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,051                 directory, all directories are treated like packages.
2025-06-01T07:37:05,051           ********************************************************************************

2025-06-01T07:37:05,052   !!
2025-06-01T07:37:05,053     check.warn(importable)
2025-06-01T07:37:05,053   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2025-06-01T07:37:05,053   !!

2025-06-01T07:37:05,054           ********************************************************************************
2025-06-01T07:37:05,055           ############################
2025-06-01T07:37:05,055           # Package would be ignored #
2025-06-01T07:37:05,056           ############################
2025-06-01T07:37:05,056           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2025-06-01T07:37:05,057           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,058           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,058           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2025-06-01T07:37:05,059           to the `packages` configuration field.

2025-06-01T07:37:05,060           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,061           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,064           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,065           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,067           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,068           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2025-06-01T07:37:05,069           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2025-06-01T07:37:05,069           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,070           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,071           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,072           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,073           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,075           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,075                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,076                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,076                 directory, all directories are treated like packages.
2025-06-01T07:37:05,077           ********************************************************************************

2025-06-01T07:37:05,078   !!
2025-06-01T07:37:05,079     check.warn(importable)
2025-06-01T07:37:05,079   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.compile' is absent from the `packages` configuration.
2025-06-01T07:37:05,080   !!

2025-06-01T07:37:05,081           ********************************************************************************
2025-06-01T07:37:05,082           ############################
2025-06-01T07:37:05,083           # Package would be ignored #
2025-06-01T07:37:05,083           ############################
2025-06-01T07:37:05,083           Python recognizes 'deepspeed.ops.csrc.compile' as an importable package[^1],
2025-06-01T07:37:05,084           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,085           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,085           package, please make sure that 'deepspeed.ops.csrc.compile' is explicitly added
2025-06-01T07:37:05,086           to the `packages` configuration field.

2025-06-01T07:37:05,087           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,087           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,088           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,088           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,089           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,090           If you don't want 'deepspeed.ops.csrc.compile' to be distributed and are
2025-06-01T07:37:05,091           already explicitly excluding 'deepspeed.ops.csrc.compile' via
2025-06-01T07:37:05,091           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,092           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,092           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,093           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,094           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,096           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,097                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,097                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,098                 directory, all directories are treated like packages.
2025-06-01T07:37:05,098           ********************************************************************************

2025-06-01T07:37:05,100   !!
2025-06-01T07:37:05,100     check.warn(importable)
2025-06-01T07:37:05,101   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2025-06-01T07:37:05,102   !!

2025-06-01T07:37:05,103           ********************************************************************************
2025-06-01T07:37:05,103           ############################
2025-06-01T07:37:05,104           # Package would be ignored #
2025-06-01T07:37:05,105           ############################
2025-06-01T07:37:05,105           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2025-06-01T07:37:05,106           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,107           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,107           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2025-06-01T07:37:05,108           to the `packages` configuration field.

2025-06-01T07:37:05,109           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,110           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,111           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,112           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,113           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,115           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2025-06-01T07:37:05,115           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2025-06-01T07:37:05,116           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,116           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,117           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,118           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,119           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,120           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,120                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,121                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,121                 directory, all directories are treated like packages.
2025-06-01T07:37:05,122           ********************************************************************************

2025-06-01T07:37:05,123   !!
2025-06-01T07:37:05,123     check.warn(importable)
2025-06-01T07:37:05,124   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2025-06-01T07:37:05,124   !!

2025-06-01T07:37:05,125           ********************************************************************************
2025-06-01T07:37:05,126           ############################
2025-06-01T07:37:05,126           # Package would be ignored #
2025-06-01T07:37:05,127           ############################
2025-06-01T07:37:05,127           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2025-06-01T07:37:05,128           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,129           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,130           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2025-06-01T07:37:05,130           to the `packages` configuration field.

2025-06-01T07:37:05,132           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,132           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,133           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,134           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,136           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,137           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2025-06-01T07:37:05,137           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2025-06-01T07:37:05,138           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,139           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,139           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,140           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,141           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,143           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,144                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,144                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,145                 directory, all directories are treated like packages.
2025-06-01T07:37:05,146           ********************************************************************************

2025-06-01T07:37:05,147   !!
2025-06-01T07:37:05,147     check.warn(importable)
2025-06-01T07:37:05,148   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2025-06-01T07:37:05,148   !!

2025-06-01T07:37:05,149           ********************************************************************************
2025-06-01T07:37:05,149           ############################
2025-06-01T07:37:05,150           # Package would be ignored #
2025-06-01T07:37:05,150           ############################
2025-06-01T07:37:05,151           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2025-06-01T07:37:05,151           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,152           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,153           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2025-06-01T07:37:05,153           to the `packages` configuration field.

2025-06-01T07:37:05,154           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,155           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,155           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,156           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,157           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,159           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2025-06-01T07:37:05,160           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2025-06-01T07:37:05,160           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,161           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,162           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,164           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,166           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,169           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,171                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,172                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,173                 directory, all directories are treated like packages.
2025-06-01T07:37:05,174           ********************************************************************************

2025-06-01T07:37:05,177   !!
2025-06-01T07:37:05,178     check.warn(importable)
2025-06-01T07:37:05,179   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2025-06-01T07:37:05,180   !!

2025-06-01T07:37:05,181           ********************************************************************************
2025-06-01T07:37:05,182           ############################
2025-06-01T07:37:05,183           # Package would be ignored #
2025-06-01T07:37:05,184           ############################
2025-06-01T07:37:05,185           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2025-06-01T07:37:05,186           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,189           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,190           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2025-06-01T07:37:05,191           to the `packages` configuration field.

2025-06-01T07:37:05,193           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,193           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,195           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,196           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,197           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,198           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2025-06-01T07:37:05,198           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2025-06-01T07:37:05,199           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,199           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,200           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,201           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,202           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,204           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,204                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,205                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,205                 directory, all directories are treated like packages.
2025-06-01T07:37:05,206           ********************************************************************************

2025-06-01T07:37:05,207   !!
2025-06-01T07:37:05,208     check.warn(importable)
2025-06-01T07:37:05,208   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2025-06-01T07:37:05,209   !!

2025-06-01T07:37:05,210           ********************************************************************************
2025-06-01T07:37:05,211           ############################
2025-06-01T07:37:05,211           # Package would be ignored #
2025-06-01T07:37:05,212           ############################
2025-06-01T07:37:05,213           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2025-06-01T07:37:05,213           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,214           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,215           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2025-06-01T07:37:05,216           to the `packages` configuration field.

2025-06-01T07:37:05,217           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,217           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,218           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,219           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,220           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,221           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2025-06-01T07:37:05,222           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2025-06-01T07:37:05,222           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,223           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,223           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,225           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,226           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,227           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,227                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,228                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,228                 directory, all directories are treated like packages.
2025-06-01T07:37:05,229           ********************************************************************************

2025-06-01T07:37:05,230   !!
2025-06-01T07:37:05,230     check.warn(importable)
2025-06-01T07:37:05,230   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2025-06-01T07:37:05,231   !!

2025-06-01T07:37:05,232           ********************************************************************************
2025-06-01T07:37:05,232           ############################
2025-06-01T07:37:05,233           # Package would be ignored #
2025-06-01T07:37:05,233           ############################
2025-06-01T07:37:05,234           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2025-06-01T07:37:05,234           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,235           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,235           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2025-06-01T07:37:05,236           to the `packages` configuration field.

2025-06-01T07:37:05,237           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,238           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,238           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,239           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,240           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,242           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2025-06-01T07:37:05,242           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2025-06-01T07:37:05,243           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,244           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,244           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,245           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,246           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,248           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,248                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,249                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,250                 directory, all directories are treated like packages.
2025-06-01T07:37:05,250           ********************************************************************************

2025-06-01T07:37:05,251   !!
2025-06-01T07:37:05,252     check.warn(importable)
2025-06-01T07:37:05,253   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2025-06-01T07:37:05,253   !!

2025-06-01T07:37:05,254           ********************************************************************************
2025-06-01T07:37:05,255           ############################
2025-06-01T07:37:05,256           # Package would be ignored #
2025-06-01T07:37:05,256           ############################
2025-06-01T07:37:05,256           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2025-06-01T07:37:05,257           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,258           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,258           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2025-06-01T07:37:05,259           to the `packages` configuration field.

2025-06-01T07:37:05,259           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,260           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,260           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,261           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,262           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,263           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2025-06-01T07:37:05,264           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2025-06-01T07:37:05,264           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,265           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,265           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,267           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,268           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,270           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,270                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,271                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,271                 directory, all directories are treated like packages.
2025-06-01T07:37:05,272           ********************************************************************************

2025-06-01T07:37:05,273   !!
2025-06-01T07:37:05,274     check.warn(importable)
2025-06-01T07:37:05,274   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2025-06-01T07:37:05,275   !!

2025-06-01T07:37:05,276           ********************************************************************************
2025-06-01T07:37:05,276           ############################
2025-06-01T07:37:05,277           # Package would be ignored #
2025-06-01T07:37:05,277           ############################
2025-06-01T07:37:05,278           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2025-06-01T07:37:05,278           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,279           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,280           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2025-06-01T07:37:05,281           to the `packages` configuration field.

2025-06-01T07:37:05,282           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,282           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,283           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,284           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,285           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,285           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2025-06-01T07:37:05,286           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2025-06-01T07:37:05,286           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,286           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,287           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,288           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,288           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,290           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,290                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,291                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,291                 directory, all directories are treated like packages.
2025-06-01T07:37:05,292           ********************************************************************************

2025-06-01T07:37:05,293   !!
2025-06-01T07:37:05,293     check.warn(importable)
2025-06-01T07:37:05,294   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2025-06-01T07:37:05,294   !!

2025-06-01T07:37:05,295           ********************************************************************************
2025-06-01T07:37:05,296           ############################
2025-06-01T07:37:05,296           # Package would be ignored #
2025-06-01T07:37:05,297           ############################
2025-06-01T07:37:05,297           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2025-06-01T07:37:05,298           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,299           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,300           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2025-06-01T07:37:05,300           to the `packages` configuration field.

2025-06-01T07:37:05,302           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,302           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,303           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,304           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,305           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,306           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2025-06-01T07:37:05,306           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2025-06-01T07:37:05,307           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,307           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,308           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,309           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,310           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,312           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,313                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,313                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,314                 directory, all directories are treated like packages.
2025-06-01T07:37:05,314           ********************************************************************************

2025-06-01T07:37:05,315   !!
2025-06-01T07:37:05,315     check.warn(importable)
2025-06-01T07:37:05,316   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2025-06-01T07:37:05,316   !!

2025-06-01T07:37:05,317           ********************************************************************************
2025-06-01T07:37:05,318           ############################
2025-06-01T07:37:05,318           # Package would be ignored #
2025-06-01T07:37:05,319           ############################
2025-06-01T07:37:05,319           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2025-06-01T07:37:05,320           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,321           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,321           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2025-06-01T07:37:05,321           to the `packages` configuration field.

2025-06-01T07:37:05,322           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,323           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,324           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,325           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,326           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,327           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2025-06-01T07:37:05,328           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2025-06-01T07:37:05,328           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,329           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,330           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,331           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,333           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,335           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,335                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,336                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,337                 directory, all directories are treated like packages.
2025-06-01T07:37:05,337           ********************************************************************************

2025-06-01T07:37:05,338   !!
2025-06-01T07:37:05,339     check.warn(importable)
2025-06-01T07:37:05,340   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2025-06-01T07:37:05,341   !!

2025-06-01T07:37:05,342           ********************************************************************************
2025-06-01T07:37:05,343           ############################
2025-06-01T07:37:05,343           # Package would be ignored #
2025-06-01T07:37:05,344           ############################
2025-06-01T07:37:05,345           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2025-06-01T07:37:05,345           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,347           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,347           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2025-06-01T07:37:05,348           to the `packages` configuration field.

2025-06-01T07:37:05,349           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,349           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,349           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,350           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,351           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,352           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2025-06-01T07:37:05,353           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2025-06-01T07:37:05,353           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,354           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,354           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,355           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,356           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,357           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,358                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,358                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,359                 directory, all directories are treated like packages.
2025-06-01T07:37:05,359           ********************************************************************************

2025-06-01T07:37:05,361   !!
2025-06-01T07:37:05,361     check.warn(importable)
2025-06-01T07:37:05,362   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2025-06-01T07:37:05,362   !!

2025-06-01T07:37:05,363           ********************************************************************************
2025-06-01T07:37:05,364           ############################
2025-06-01T07:37:05,365           # Package would be ignored #
2025-06-01T07:37:05,365           ############################
2025-06-01T07:37:05,366           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2025-06-01T07:37:05,366           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,367           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,368           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2025-06-01T07:37:05,369           to the `packages` configuration field.

2025-06-01T07:37:05,370           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,370           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,371           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,372           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,374           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,375           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2025-06-01T07:37:05,375           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2025-06-01T07:37:05,376           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,377           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,377           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,378           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,379           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,381           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,381                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,382                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,382                 directory, all directories are treated like packages.
2025-06-01T07:37:05,383           ********************************************************************************

2025-06-01T07:37:05,384   !!
2025-06-01T07:37:05,384     check.warn(importable)
2025-06-01T07:37:05,385   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2025-06-01T07:37:05,385   !!

2025-06-01T07:37:05,386           ********************************************************************************
2025-06-01T07:37:05,387           ############################
2025-06-01T07:37:05,387           # Package would be ignored #
2025-06-01T07:37:05,388           ############################
2025-06-01T07:37:05,388           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2025-06-01T07:37:05,389           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,390           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,390           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2025-06-01T07:37:05,391           to the `packages` configuration field.

2025-06-01T07:37:05,392           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,393           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,393           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,394           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,395           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,396           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2025-06-01T07:37:05,397           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2025-06-01T07:37:05,398           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,398           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,399           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,400           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,401           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,403           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,403                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,404                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,405                 directory, all directories are treated like packages.
2025-06-01T07:37:05,405           ********************************************************************************

2025-06-01T07:37:05,406   !!
2025-06-01T07:37:05,407     check.warn(importable)
2025-06-01T07:37:05,408   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2025-06-01T07:37:05,408   !!

2025-06-01T07:37:05,409           ********************************************************************************
2025-06-01T07:37:05,410           ############################
2025-06-01T07:37:05,411           # Package would be ignored #
2025-06-01T07:37:05,411           ############################
2025-06-01T07:37:05,412           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2025-06-01T07:37:05,412           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,413           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,414           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2025-06-01T07:37:05,414           to the `packages` configuration field.

2025-06-01T07:37:05,415           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,415           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,416           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,417           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,418           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,419           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2025-06-01T07:37:05,419           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2025-06-01T07:37:05,420           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,421           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,421           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,422           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,423           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,425           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,425                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,426                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,426                 directory, all directories are treated like packages.
2025-06-01T07:37:05,427           ********************************************************************************

2025-06-01T07:37:05,428   !!
2025-06-01T07:37:05,428     check.warn(importable)
2025-06-01T07:37:05,429   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2025-06-01T07:37:05,430   !!

2025-06-01T07:37:05,431           ********************************************************************************
2025-06-01T07:37:05,431           ############################
2025-06-01T07:37:05,432           # Package would be ignored #
2025-06-01T07:37:05,432           ############################
2025-06-01T07:37:05,433           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2025-06-01T07:37:05,434           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,435           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,435           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2025-06-01T07:37:05,436           to the `packages` configuration field.

2025-06-01T07:37:05,437           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,438           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,438           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,439           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,441           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,442           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2025-06-01T07:37:05,443           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2025-06-01T07:37:05,443           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,444           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,444           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,445           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,446           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,448           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,448                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,449                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,449                 directory, all directories are treated like packages.
2025-06-01T07:37:05,449           ********************************************************************************

2025-06-01T07:37:05,451   !!
2025-06-01T07:37:05,451     check.warn(importable)
2025-06-01T07:37:05,451   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2025-06-01T07:37:05,452   !!

2025-06-01T07:37:05,453           ********************************************************************************
2025-06-01T07:37:05,454           ############################
2025-06-01T07:37:05,454           # Package would be ignored #
2025-06-01T07:37:05,455           ############################
2025-06-01T07:37:05,455           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2025-06-01T07:37:05,456           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,457           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,457           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2025-06-01T07:37:05,458           to the `packages` configuration field.

2025-06-01T07:37:05,459           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,459           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,460           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,461           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,462           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,463           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2025-06-01T07:37:05,464           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2025-06-01T07:37:05,464           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,465           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,465           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,466           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,468           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,469           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,470                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,470                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,471                 directory, all directories are treated like packages.
2025-06-01T07:37:05,472           ********************************************************************************

2025-06-01T07:37:05,473   !!
2025-06-01T07:37:05,473     check.warn(importable)
2025-06-01T07:37:05,474   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2025-06-01T07:37:05,474   !!

2025-06-01T07:37:05,476           ********************************************************************************
2025-06-01T07:37:05,476           ############################
2025-06-01T07:37:05,477           # Package would be ignored #
2025-06-01T07:37:05,477           ############################
2025-06-01T07:37:05,478           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2025-06-01T07:37:05,478           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,479           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,480           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2025-06-01T07:37:05,480           to the `packages` configuration field.

2025-06-01T07:37:05,481           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,482           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,482           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,484           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,485           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,486           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2025-06-01T07:37:05,487           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2025-06-01T07:37:05,487           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,488           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,488           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,490           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,491           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,493           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,493                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,494                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,494                 directory, all directories are treated like packages.
2025-06-01T07:37:05,495           ********************************************************************************

2025-06-01T07:37:05,496   !!
2025-06-01T07:37:05,497     check.warn(importable)
2025-06-01T07:37:05,497   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2025-06-01T07:37:05,498   !!

2025-06-01T07:37:05,499           ********************************************************************************
2025-06-01T07:37:05,499           ############################
2025-06-01T07:37:05,500           # Package would be ignored #
2025-06-01T07:37:05,501           ############################
2025-06-01T07:37:05,501           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2025-06-01T07:37:05,502           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,503           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,504           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2025-06-01T07:37:05,504           to the `packages` configuration field.

2025-06-01T07:37:05,506           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,506           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,507           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,508           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,509           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,510           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2025-06-01T07:37:05,511           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2025-06-01T07:37:05,511           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,512           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,512           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,513           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,514           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,516           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,516                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,517                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,518                 directory, all directories are treated like packages.
2025-06-01T07:37:05,518           ********************************************************************************

2025-06-01T07:37:05,519   !!
2025-06-01T07:37:05,520     check.warn(importable)
2025-06-01T07:37:05,521   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2025-06-01T07:37:05,521   !!

2025-06-01T07:37:05,522           ********************************************************************************
2025-06-01T07:37:05,523           ############################
2025-06-01T07:37:05,524           # Package would be ignored #
2025-06-01T07:37:05,524           ############################
2025-06-01T07:37:05,525           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2025-06-01T07:37:05,525           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,527           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,527           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2025-06-01T07:37:05,528           to the `packages` configuration field.

2025-06-01T07:37:05,529           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,530           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,530           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,531           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,533           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,534           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2025-06-01T07:37:05,534           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2025-06-01T07:37:05,535           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,536           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,536           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,537           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,539           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,540           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,541                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,541                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,541                 directory, all directories are treated like packages.
2025-06-01T07:37:05,542           ********************************************************************************

2025-06-01T07:37:05,543   !!
2025-06-01T07:37:05,543     check.warn(importable)
2025-06-01T07:37:05,544   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2025-06-01T07:37:05,544   !!

2025-06-01T07:37:05,545           ********************************************************************************
2025-06-01T07:37:05,546           ############################
2025-06-01T07:37:05,546           # Package would be ignored #
2025-06-01T07:37:05,547           ############################
2025-06-01T07:37:05,547           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2025-06-01T07:37:05,548           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,549           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,549           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2025-06-01T07:37:05,550           to the `packages` configuration field.

2025-06-01T07:37:05,551           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,551           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,552           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,553           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,554           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,555           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2025-06-01T07:37:05,556           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2025-06-01T07:37:05,556           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,557           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,558           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,559           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,560           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,561           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,562                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,563                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,563                 directory, all directories are treated like packages.
2025-06-01T07:37:05,564           ********************************************************************************

2025-06-01T07:37:05,565   !!
2025-06-01T07:37:05,565     check.warn(importable)
2025-06-01T07:37:05,566   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2025-06-01T07:37:05,566   !!

2025-06-01T07:37:05,568           ********************************************************************************
2025-06-01T07:37:05,568           ############################
2025-06-01T07:37:05,569           # Package would be ignored #
2025-06-01T07:37:05,570           ############################
2025-06-01T07:37:05,570           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2025-06-01T07:37:05,571           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,572           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,573           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2025-06-01T07:37:05,573           to the `packages` configuration field.

2025-06-01T07:37:05,574           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,575           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,576           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,577           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,578           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,579           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2025-06-01T07:37:05,579           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2025-06-01T07:37:05,580           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,580           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,581           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,582           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,583           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,584           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,585                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,586                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,586                 directory, all directories are treated like packages.
2025-06-01T07:37:05,587           ********************************************************************************

2025-06-01T07:37:05,589   !!
2025-06-01T07:37:05,589     check.warn(importable)
2025-06-01T07:37:05,590   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2025-06-01T07:37:05,590   !!

2025-06-01T07:37:05,592           ********************************************************************************
2025-06-01T07:37:05,592           ############################
2025-06-01T07:37:05,593           # Package would be ignored #
2025-06-01T07:37:05,593           ############################
2025-06-01T07:37:05,594           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2025-06-01T07:37:05,595           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,596           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,596           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2025-06-01T07:37:05,597           to the `packages` configuration field.

2025-06-01T07:37:05,599           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,599           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,600           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,603           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,605           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,608           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2025-06-01T07:37:05,609           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2025-06-01T07:37:05,610           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,611           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,611           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,612           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,614           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,615           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,616                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,616                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,617                 directory, all directories are treated like packages.
2025-06-01T07:37:05,617           ********************************************************************************

2025-06-01T07:37:05,618   !!
2025-06-01T07:37:05,619     check.warn(importable)
2025-06-01T07:37:05,620   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2025-06-01T07:37:05,620   !!

2025-06-01T07:37:05,622           ********************************************************************************
2025-06-01T07:37:05,622           ############################
2025-06-01T07:37:05,623           # Package would be ignored #
2025-06-01T07:37:05,623           ############################
2025-06-01T07:37:05,624           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2025-06-01T07:37:05,624           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,625           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,626           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2025-06-01T07:37:05,627           to the `packages` configuration field.

2025-06-01T07:37:05,628           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,629           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,629           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,630           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,632           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,634           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2025-06-01T07:37:05,634           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2025-06-01T07:37:05,635           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,635           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,636           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,637           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,639           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,641           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,642                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,642                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,643                 directory, all directories are treated like packages.
2025-06-01T07:37:05,643           ********************************************************************************

2025-06-01T07:37:05,645   !!
2025-06-01T07:37:05,645     check.warn(importable)
2025-06-01T07:37:05,646   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2025-06-01T07:37:05,646   !!

2025-06-01T07:37:05,647           ********************************************************************************
2025-06-01T07:37:05,647           ############################
2025-06-01T07:37:05,648           # Package would be ignored #
2025-06-01T07:37:05,648           ############################
2025-06-01T07:37:05,649           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2025-06-01T07:37:05,649           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,650           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,651           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2025-06-01T07:37:05,651           to the `packages` configuration field.

2025-06-01T07:37:05,652           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,653           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,653           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,654           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,655           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,656           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2025-06-01T07:37:05,657           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2025-06-01T07:37:05,657           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,658           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,659           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,660           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,661           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,662           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,663                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,663                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,664                 directory, all directories are treated like packages.
2025-06-01T07:37:05,665           ********************************************************************************

2025-06-01T07:37:05,666   !!
2025-06-01T07:37:05,667     check.warn(importable)
2025-06-01T07:37:05,667   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2025-06-01T07:37:05,668   !!

2025-06-01T07:37:05,669           ********************************************************************************
2025-06-01T07:37:05,669           ############################
2025-06-01T07:37:05,670           # Package would be ignored #
2025-06-01T07:37:05,671           ############################
2025-06-01T07:37:05,672           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2025-06-01T07:37:05,672           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,673           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,674           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2025-06-01T07:37:05,674           to the `packages` configuration field.

2025-06-01T07:37:05,676           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,676           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,677           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,678           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,679           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,680           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2025-06-01T07:37:05,680           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2025-06-01T07:37:05,681           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,681           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,682           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,682           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,683           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,685           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,685                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,686                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,687                 directory, all directories are treated like packages.
2025-06-01T07:37:05,687           ********************************************************************************

2025-06-01T07:37:05,688   !!
2025-06-01T07:37:05,689     check.warn(importable)
2025-06-01T07:37:05,689   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2025-06-01T07:37:05,690   !!

2025-06-01T07:37:05,691           ********************************************************************************
2025-06-01T07:37:05,692           ############################
2025-06-01T07:37:05,692           # Package would be ignored #
2025-06-01T07:37:05,693           ############################
2025-06-01T07:37:05,693           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2025-06-01T07:37:05,694           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,695           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,695           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2025-06-01T07:37:05,696           to the `packages` configuration field.

2025-06-01T07:37:05,697           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,698           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,698           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,699           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,700           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,702           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2025-06-01T07:37:05,702           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2025-06-01T07:37:05,703           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,703           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,704           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,705           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,706           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,707           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,708                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,709                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,709                 directory, all directories are treated like packages.
2025-06-01T07:37:05,710           ********************************************************************************

2025-06-01T07:37:05,711   !!
2025-06-01T07:37:05,711     check.warn(importable)
2025-06-01T07:37:05,711   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2025-06-01T07:37:05,712   !!

2025-06-01T07:37:05,713           ********************************************************************************
2025-06-01T07:37:05,713           ############################
2025-06-01T07:37:05,714           # Package would be ignored #
2025-06-01T07:37:05,714           ############################
2025-06-01T07:37:05,715           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2025-06-01T07:37:05,715           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,716           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,717           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2025-06-01T07:37:05,717           to the `packages` configuration field.

2025-06-01T07:37:05,718           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,719           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,719           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,720           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,721           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,722           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2025-06-01T07:37:05,723           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2025-06-01T07:37:05,723           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,724           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,724           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,725           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,726           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,728           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,729                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,729                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,730                 directory, all directories are treated like packages.
2025-06-01T07:37:05,730           ********************************************************************************

2025-06-01T07:37:05,731   !!
2025-06-01T07:37:05,732     check.warn(importable)
2025-06-01T07:37:05,732   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2025-06-01T07:37:05,733   !!

2025-06-01T07:37:05,734           ********************************************************************************
2025-06-01T07:37:05,735           ############################
2025-06-01T07:37:05,735           # Package would be ignored #
2025-06-01T07:37:05,736           ############################
2025-06-01T07:37:05,736           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2025-06-01T07:37:05,737           but it is absent from setuptools' `packages` configuration.

2025-06-01T07:37:05,739           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-01T07:37:05,739           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2025-06-01T07:37:05,739           to the `packages` configuration field.

2025-06-01T07:37:05,740           Alternatively, you can also rely on setuptools' discovery methods
2025-06-01T07:37:05,741           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-01T07:37:05,741           instead of `find_packages(...)`/`find:`).

2025-06-01T07:37:05,743           You can read more about "package discovery" on setuptools documentation page:

2025-06-01T07:37:05,744           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-01T07:37:05,745           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2025-06-01T07:37:05,745           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2025-06-01T07:37:05,746           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-01T07:37:05,746           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-01T07:37:05,747           combination with a more fine grained `package-data` configuration.

2025-06-01T07:37:05,748           You can read more about "package data files" on setuptools documentation page:

2025-06-01T07:37:05,749           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-01T07:37:05,750           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-01T07:37:05,751                 even if it does not contain any `.py` files.
2025-06-01T07:37:05,751                 On the other hand, currently there is no concept of package data
2025-06-01T07:37:05,752                 directory, all directories are treated like packages.
2025-06-01T07:37:05,753           ********************************************************************************

2025-06-01T07:37:05,754   !!
2025-06-01T07:37:05,754     check.warn(importable)
2025-06-01T07:37:05,755   creating build/lib/deepspeed/ops/csrc/adagrad
2025-06-01T07:37:05,755   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2025-06-01T07:37:05,756   creating build/lib/deepspeed/ops/csrc/adam
2025-06-01T07:37:05,756   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-01T07:37:05,757   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-01T07:37:05,758   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-01T07:37:05,758   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2025-06-01T07:37:05,759   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2025-06-01T07:37:05,759   creating build/lib/deepspeed/ops/csrc/aio/common
2025-06-01T07:37:05,760   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-01T07:37:05,760   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-01T07:37:05,761   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-01T07:37:05,762   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-01T07:37:05,762   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-01T07:37:05,763   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-01T07:37:05,763   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,764   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,764   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,765   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,766   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,766   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,767   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,767   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,768   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,768   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,769   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,770   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,770   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,771   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,771   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,772   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,773   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,773   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:05,774   creating build/lib/deepspeed/ops/csrc/aio/py_test
2025-06-01T07:37:05,774   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2025-06-01T07:37:05,775   creating build/lib/deepspeed/ops/csrc/compile
2025-06-01T07:37:05,775   copying deepspeed/ops/csrc/compile/deepcompile.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-01T07:37:05,776   copying deepspeed/ops/csrc/compile/init.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-01T07:37:05,776   copying deepspeed/ops/csrc/compile/util.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-01T07:37:05,777   copying deepspeed/ops/csrc/compile/z1.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-01T07:37:05,777   copying deepspeed/ops/csrc/compile/z1.h -> build/lib/deepspeed/ops/csrc/compile
2025-06-01T07:37:05,778   copying deepspeed/ops/csrc/compile/z2.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-01T07:37:05,779   copying deepspeed/ops/csrc/compile/z2.h -> build/lib/deepspeed/ops/csrc/compile
2025-06-01T07:37:05,779   copying deepspeed/ops/csrc/compile/z3.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-01T07:37:05,780   copying deepspeed/ops/csrc/compile/z3.h -> build/lib/deepspeed/ops/csrc/compile
2025-06-01T07:37:05,781   creating build/lib/deepspeed/ops/csrc/cpu/adam
2025-06-01T07:37:05,781   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2025-06-01T07:37:05,782   creating build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-01T07:37:05,782   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-01T07:37:05,783   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-01T07:37:05,783   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-01T07:37:05,784   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-01T07:37:05,785   creating build/lib/deepspeed/ops/csrc/cpu/lion
2025-06-01T07:37:05,785   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2025-06-01T07:37:05,786   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T07:37:05,786   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T07:37:05,787   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T07:37:05,787   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T07:37:05,788   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T07:37:05,788   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T07:37:05,789   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T07:37:05,789   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T07:37:05,790   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T07:37:05,791   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T07:37:05,791   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T07:37:05,792   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T07:37:05,792   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T07:37:05,793   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T07:37:05,793   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T07:37:05,794   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T07:37:05,795   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T07:37:05,795   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T07:37:05,796   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T07:37:05,796   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T07:37:05,797   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T07:37:05,797   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T07:37:05,798   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T07:37:05,799   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T07:37:05,799   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T07:37:05,800   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T07:37:05,800   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T07:37:05,801   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T07:37:05,801   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-01T07:37:05,802   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-01T07:37:05,802   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-01T07:37:05,803   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-01T07:37:05,803   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-01T07:37:05,804   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-01T07:37:05,805   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-01T07:37:05,805   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-01T07:37:05,806   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-01T07:37:05,806   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-01T07:37:05,807   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-01T07:37:05,807   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-01T07:37:05,808   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-01T07:37:05,808   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-01T07:37:05,809   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-01T07:37:05,809   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-01T07:37:05,810   creating build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,811   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,811   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,812   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,813   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,813   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,814   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,814   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,815   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,815   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,816   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,817   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,817   copying deepspeed/ops/csrc/includes/deepcompile.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,818   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,818   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,819   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,820   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,820   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,821   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,822   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,822   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,823   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,824   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,825   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,827   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,832   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,836   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,840   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,843   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,845   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,848   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-01T07:37:05,851   creating build/lib/deepspeed/ops/csrc/lamb
2025-06-01T07:37:05,852   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2025-06-01T07:37:05,855   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2025-06-01T07:37:05,859   creating build/lib/deepspeed/ops/csrc/lion
2025-06-01T07:37:05,860   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-01T07:37:05,863   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-01T07:37:05,865   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-01T07:37:05,868   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2025-06-01T07:37:05,871   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2025-06-01T07:37:05,873   creating build/lib/deepspeed/ops/csrc/quantization
2025-06-01T07:37:05,875   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-01T07:37:05,877   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-01T07:37:05,882   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2025-06-01T07:37:05,887   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-01T07:37:05,890   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-01T07:37:05,894   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-01T07:37:05,897   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-01T07:37:05,900   creating build/lib/deepspeed/ops/csrc/random_ltd
2025-06-01T07:37:05,901   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-01T07:37:05,904   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-01T07:37:05,907   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-01T07:37:05,911   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-01T07:37:05,913   creating build/lib/deepspeed/ops/csrc/sparse_attention
2025-06-01T07:37:05,914   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2025-06-01T07:37:05,917   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-01T07:37:05,919   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-01T07:37:05,922   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-01T07:37:05,925   creating build/lib/deepspeed/ops/csrc/spatial/includes
2025-06-01T07:37:05,926   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2025-06-01T07:37:05,929   creating build/lib/deepspeed/ops/csrc/transformer
2025-06-01T07:37:05,931   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-01T07:37:05,939   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-01T07:37:05,942   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2025-06-01T07:37:05,946   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-01T07:37:05,950   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-01T07:37:05,953   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-01T07:37:05,969   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-01T07:37:05,977   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-01T07:37:05,981   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:05,983   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:05,987   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:05,990   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:05,994   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:05,998   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:06,000   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:06,005   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:06,007   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:06,010   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:06,013   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:06,017   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-01T07:37:06,018   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-01T07:37:06,021   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-01T07:37:06,024   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-01T07:37:06,027   creating build/lib/deepspeed/ops/csrc/utils
2025-06-01T07:37:06,028   copying deepspeed/ops/csrc/utils/py_ds_utils.cpp -> build/lib/deepspeed/ops/csrc/utils
2025-06-01T07:37:06,031   copying deepspeed/ops/csrc/utils/tensor_cast.cpp -> build/lib/deepspeed/ops/csrc/utils
2025-06-01T07:37:06,033   copying deepspeed/ops/csrc/utils/tensor_cast.h -> build/lib/deepspeed/ops/csrc/utils
2025-06-01T07:37:06,035   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-06-01T07:37:06,037   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-06-01T07:37:06,040   creating build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-01T07:37:06,041   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-01T07:37:06,044   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-01T07:37:06,046   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-01T07:37:06,049   creating build/lib/deepspeed/ops/csrc/xpu/common
2025-06-01T07:37:06,051   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2025-06-01T07:37:06,053   creating build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-01T07:37:06,054   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-01T07:37:06,057   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-01T07:37:06,059   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-01T07:37:06,062   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-01T07:37:06,065   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-01T07:37:06,067   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2025-06-01T07:37:06,069   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2025-06-01T07:37:06,071   creating build/lib/deepspeed/autotuning/config_templates
2025-06-01T07:37:06,072   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-01T07:37:06,075   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-01T07:37:06,077   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-01T07:37:06,080   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-01T07:37:06,082   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-01T07:37:06,085   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-01T07:37:06,088   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-01T07:37:06,091   creating build/lib/deepspeed/inference/v2/kernels/includes
2025-06-01T07:37:06,092   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-01T07:37:06,095   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-01T07:37:06,098   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-01T07:37:06,101   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-01T07:37:06,105   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-01T07:37:06,108   creating build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-01T07:37:06,109   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-01T07:37:06,112   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-01T07:37:06,114   creating build/lib/deepspeed/inference/v2/ragged/includes
2025-06-01T07:37:06,115   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2025-06-01T07:37:06,118   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-01T07:37:06,121   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-01T07:37:06,123   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-01T07:37:06,124   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-01T07:37:06,127   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-01T07:37:06,129   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-01T07:37:06,130   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-01T07:37:06,133   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-01T07:37:06,134   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-01T07:37:06,137   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-01T07:37:06,139   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-01T07:37:06,142   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T07:37:06,145   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T07:37:06,148   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T07:37:06,151   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T07:37:06,153   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T07:37:06,156   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T07:37:06,159   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:06,160   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:06,163   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:06,167   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:06,169   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:06,172   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:06,175   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:06,178   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:06,180   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:06,183   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:06,186   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T07:37:06,188   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T07:37:06,191   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T07:37:06,194   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T07:37:06,196   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T07:37:06,199   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T07:37:06,202   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T07:37:06,205   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T07:37:06,207   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T07:37:06,210   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:37:06,213   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:37:06,215   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:37:06,219   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T07:37:06,222   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T07:37:06,224   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T07:37:06,227   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T07:37:06,230   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T07:37:06,232   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T07:37:06,235   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T07:37:06,237   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T07:37:06,240   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T07:37:06,243   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T07:37:06,245   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T07:37:06,248   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T07:37:06,250   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T07:37:06,253   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T07:37:06,255   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T07:37:06,258   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T07:37:06,261   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T07:37:06,264   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T07:37:06,266   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T07:37:06,269   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T07:37:06,271   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T07:37:06,274   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T07:37:06,277   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T07:37:06,279   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T07:37:06,282   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T07:37:06,285   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T07:37:06,287   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T07:37:06,290   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T07:37:06,292   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:37:06,295   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:37:06,298   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:37:06,300   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:37:06,304   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T07:37:06,306   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T07:37:06,309   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T07:37:06,312   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T07:37:06,377   running build_scripts
2025-06-01T07:37:06,378   creating build/scripts-3.11
2025-06-01T07:37:06,379   copying and adjusting bin/deepspeed -> build/scripts-3.11
2025-06-01T07:37:06,381   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2025-06-01T07:37:06,382   copying and adjusting bin/ds -> build/scripts-3.11
2025-06-01T07:37:06,384   copying bin/ds_ssh -> build/scripts-3.11
2025-06-01T07:37:06,386   copying and adjusting bin/ds_report -> build/scripts-3.11
2025-06-01T07:37:06,388   copying and adjusting bin/ds_bench -> build/scripts-3.11
2025-06-01T07:37:06,389   copying and adjusting bin/dsr -> build/scripts-3.11
2025-06-01T07:37:06,391   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2025-06-01T07:37:06,393   copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11
2025-06-01T07:37:06,394   copying and adjusting bin/ds_io -> build/scripts-3.11
2025-06-01T07:37:06,395   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2025-06-01T07:37:06,396   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2025-06-01T07:37:06,397   changing mode of build/scripts-3.11/ds from 644 to 755
2025-06-01T07:37:06,397   changing mode of build/scripts-3.11/ds_report from 644 to 755
2025-06-01T07:37:06,398   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2025-06-01T07:37:06,398   changing mode of build/scripts-3.11/dsr from 644 to 755
2025-06-01T07:37:06,399   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2025-06-01T07:37:06,399   changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755
2025-06-01T07:37:06,400   changing mode of build/scripts-3.11/ds_io from 644 to 755
2025-06-01T07:37:06,431   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2025-06-01T07:37:06,431   !!

2025-06-01T07:37:06,432           ********************************************************************************
2025-06-01T07:37:06,433           Please avoid running ``setup.py`` directly.
2025-06-01T07:37:06,434           Instead, use pypa/build, pypa/installer or other
2025-06-01T07:37:06,434           standards-based tools.

2025-06-01T07:37:06,435           By 2025-Oct-31, you need to update your project and remove deprecated calls
2025-06-01T07:37:06,436           or your builds will no longer be supported.

2025-06-01T07:37:06,437           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2025-06-01T07:37:06,437           ********************************************************************************

2025-06-01T07:37:06,438   !!
2025-06-01T07:37:06,439     self.initialize_options()
2025-06-01T07:37:06,460   installing to build/bdist.linux-armv7l/wheel
2025-06-01T07:37:06,461   running install
2025-06-01T07:37:06,485   running install_lib
2025-06-01T07:37:06,514   creating build/bdist.linux-armv7l/wheel
2025-06-01T07:37:06,517   creating build/bdist.linux-armv7l/wheel/deepspeed
2025-06-01T07:37:06,518   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2025-06-01T07:37:06,520   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-01T07:37:06,522   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-01T07:37:06,524   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-01T07:37:06,526   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-01T07:37:06,528   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-01T07:37:06,531   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2025-06-01T07:37:06,532   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-01T07:37:06,534   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-01T07:37:06,537   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2025-06-01T07:37:06,538   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-06-01T07:37:06,541   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-06-01T07:37:06,546   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-01T07:37:06,549   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2025-06-01T07:37:06,550   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T07:37:06,554   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T07:37:06,556   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T07:37:06,559   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2025-06-01T07:37:06,561   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2025-06-01T07:37:06,562   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-01T07:37:06,565   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-01T07:37:06,567   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-01T07:37:06,569   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-01T07:37:06,572   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-01T07:37:06,575   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-01T07:37:06,578   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-01T07:37:06,582   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,586   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,589   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,591   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,594   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,596   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,598   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,600   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,602   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,604   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,607   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,609   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,612   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,614   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,616   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,619   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,621   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,623   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,626   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-01T07:37:06,628   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T07:37:06,631   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T07:37:06,634   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T07:37:06,636   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T07:37:06,639   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T07:37:06,642   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T07:37:06,644   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T07:37:06,646   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T07:37:06,649   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T07:37:06,652   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-01T07:37:06,655   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2025-06-01T07:37:06,656   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,658   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,661   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,663   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,665   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,667   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,669   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,671   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,673   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,675   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,677   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,681   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,683   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,685   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,688   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,690   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,692   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,695   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-01T07:37:06,698   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2025-06-01T07:37:06,699   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-01T07:37:06,702   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-01T07:37:06,704   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-01T07:37:06,706   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-01T07:37:06,708   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-01T07:37:06,711   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-01T07:37:06,714   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2025-06-01T07:37:06,715   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T07:37:06,718   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T07:37:06,721   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T07:37:06,723   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T07:37:06,725   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T07:37:06,727   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T07:37:06,730   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T07:37:06,732   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T07:37:06,734   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T07:37:06,737   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-01T07:37:06,740   creating build/bdist.linux-armv7l/wheel/deepspeed/nvme
2025-06-01T07:37:06,741   copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T07:37:06,743   copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T07:37:06,746   copying build/lib/deepspeed/nvme/torch_fastio_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T07:37:06,748   copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T07:37:06,750   copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T07:37:06,752   copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T07:37:06,754   copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T07:37:06,756   copying build/lib/deepspeed/nvme/ds_aio_constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T07:37:06,758   copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T07:37:06,761   copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T07:37:06,763   copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T07:37:06,765   copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T07:37:06,766   copying build/lib/deepspeed/nvme/torch_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T07:37:06,768   copying build/lib/deepspeed/nvme/io_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T07:37:06,771   copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T07:37:06,773   copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-01T07:37:06,775   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2025-06-01T07:37:06,776   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-01T07:37:06,779   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-01T07:37:06,782   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-01T07:37:06,784   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-01T07:37:06,787   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-01T07:37:06,790   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-01T07:37:06,793   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-01T07:37:06,795   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-01T07:37:06,799   creating build/bdist.linux-armv7l/wheel/deepspeed/io
2025-06-01T07:37:06,800   copying build/lib/deepspeed/io/single_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-01T07:37:06,802   copying build/lib/deepspeed/io/base_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-01T07:37:06,804   copying build/lib/deepspeed/io/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-01T07:37:06,806   copying build/lib/deepspeed/io/mock_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-01T07:37:06,808   copying build/lib/deepspeed/io/fast_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-01T07:37:06,811   copying build/lib/deepspeed/io/double_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-01T07:37:06,813   copying build/lib/deepspeed/io/py_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-01T07:37:06,815   copying build/lib/deepspeed/io/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-01T07:37:06,817   copying build/lib/deepspeed/io/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-01T07:37:06,819   copying build/lib/deepspeed/io/base_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2025-06-01T07:37:06,821   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-01T07:37:06,825   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2025-06-01T07:37:06,827   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2025-06-01T07:37:06,828   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-06-01T07:37:06,831   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-06-01T07:37:06,834   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2025-06-01T07:37:06,835   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-06-01T07:37:06,837   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-06-01T07:37:06,841   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2025-06-01T07:37:06,842   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2025-06-01T07:37:06,845   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2025-06-01T07:37:06,846   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-01T07:37:06,848   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-01T07:37:06,850   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-01T07:37:06,853   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-01T07:37:06,856   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2025-06-01T07:37:06,857   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-06-01T07:37:06,859   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-06-01T07:37:06,862   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2025-06-01T07:37:06,864   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2025-06-01T07:37:06,865   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-01T07:37:06,868   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-01T07:37:06,870   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-01T07:37:06,872   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-01T07:37:06,875   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2025-06-01T07:37:06,876   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-06-01T07:37:06,878   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-06-01T07:37:06,882   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2025-06-01T07:37:06,883   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T07:37:06,886   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T07:37:06,888   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T07:37:06,890   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T07:37:06,893   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T07:37:06,896   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,897   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,900   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,902   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,904   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,906   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,908   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,910   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,912   copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,914   copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,916   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,918   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,921   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,923   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,925   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,927   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,929   copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,931   copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,934   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,935   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,937   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,939   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,941   copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,944   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-01T07:37:06,946   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T07:37:06,948   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T07:37:06,950   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T07:37:06,952   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T07:37:06,955   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-01T07:37:06,958   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2025-06-01T07:37:06,959   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T07:37:06,963   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T07:37:06,966   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T07:37:06,968   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T07:37:06,970   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T07:37:06,972   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T07:37:06,975   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T07:37:06,977   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T07:37:06,979   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T07:37:06,982   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-01T07:37:06,984   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2025-06-01T07:37:06,985   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-01T07:37:06,988   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-01T07:37:06,989   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-01T07:37:06,991   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-01T07:37:06,994   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2025-06-01T07:37:06,996   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-06-01T07:37:06,998   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-06-01T07:37:07,000   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/compile
2025-06-01T07:37:07,001   copying build/lib/deepspeed/ops/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/compile
2025-06-01T07:37:07,004   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2025-06-01T07:37:07,005   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-06-01T07:37:07,007   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-06-01T07:37:07,010   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2025-06-01T07:37:07,012   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2025-06-01T07:37:07,014   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T07:37:07,015   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T07:37:07,020   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-01T07:37:07,021   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-01T07:37:07,023   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-01T07:37:07,026   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T07:37:07,028   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T07:37:07,031   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T07:37:07,032   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T07:37:07,035   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T07:37:07,037   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T07:37:07,040   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T07:37:07,043   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T07:37:07,048   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T07:37:07,051   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-01T07:37:07,055   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T07:37:07,056   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T07:37:07,059   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T07:37:07,062   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T07:37:07,065   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-01T07:37:07,068   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T07:37:07,073   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T07:37:07,076   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-01T07:37:07,080   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T07:37:07,081   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T07:37:07,084   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T07:37:07,086   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T07:37:07,090   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T07:37:07,095   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T07:37:07,100   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T07:37:07,102   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-01T07:37:07,105   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2025-06-01T07:37:07,107   copying build/lib/deepspeed/ops/csrc/utils/py_ds_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2025-06-01T07:37:07,108   copying build/lib/deepspeed/ops/csrc/utils/tensor_cast.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2025-06-01T07:37:07,110   copying build/lib/deepspeed/ops/csrc/utils/tensor_cast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2025-06-01T07:37:07,113   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2025-06-01T07:37:07,114   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2025-06-01T07:37:07,117   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2025-06-01T07:37:07,119   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2025-06-01T07:37:07,120   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-01T07:37:07,123   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-01T07:37:07,125   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-01T07:37:07,127   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-01T07:37:07,129   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-01T07:37:07,131   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-01T07:37:07,134   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,135   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,137   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,140   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,143   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,145   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,148   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,150   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,152   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,155   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,157   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,159   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,161   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,163   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,165   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,167   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,169   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,171   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-01T07:37:07,173   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2025-06-01T07:37:07,174   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2025-06-01T07:37:07,177   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2025-06-01T07:37:07,178   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-06-01T07:37:07,182   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-01T07:37:07,183   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-06-01T07:37:07,186   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-06-01T07:37:07,188   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-06-01T07:37:07,191   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2025-06-01T07:37:07,192   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-01T07:37:07,195   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-01T07:37:07,198   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-01T07:37:07,200   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-01T07:37:07,203   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2025-06-01T07:37:07,204   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-01T07:37:07,207   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-01T07:37:07,209   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-01T07:37:07,212   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-01T07:37:07,214   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-01T07:37:07,217   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2025-06-01T07:37:07,218   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-01T07:37:07,222   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-01T07:37:07,225   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-01T07:37:07,228   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-01T07:37:07,230   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-01T07:37:07,234   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2025-06-01T07:37:07,236   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:07,237   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:07,240   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:07,242   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:07,245   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:07,248   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:07,251   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:07,255   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:07,258   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:07,261   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:07,264   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-01T07:37:07,267   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2025-06-01T07:37:07,268   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-01T07:37:07,271   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-01T07:37:07,274   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-01T07:37:07,277   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-01T07:37:07,280   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-01T07:37:07,284   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-01T07:37:07,288   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2025-06-01T07:37:07,290   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2025-06-01T07:37:07,291   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-06-01T07:37:07,294   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-06-01T07:37:07,296   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2025-06-01T07:37:07,297   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2025-06-01T07:37:07,300   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2025-06-01T07:37:07,302   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-01T07:37:07,304   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-01T07:37:07,307   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-01T07:37:07,310   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-01T07:37:07,312   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-01T07:37:07,315   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/compile
2025-06-01T07:37:07,316   copying build/lib/deepspeed/ops/csrc/compile/deepcompile.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-01T07:37:07,319   copying build/lib/deepspeed/ops/csrc/compile/z3.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-01T07:37:07,321   copying build/lib/deepspeed/ops/csrc/compile/z2.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-01T07:37:07,323   copying build/lib/deepspeed/ops/csrc/compile/util.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-01T07:37:07,326   copying build/lib/deepspeed/ops/csrc/compile/z3.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-01T07:37:07,328   copying build/lib/deepspeed/ops/csrc/compile/init.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-01T07:37:07,331   copying build/lib/deepspeed/ops/csrc/compile/z1.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-01T07:37:07,333   copying build/lib/deepspeed/ops/csrc/compile/z1.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-01T07:37:07,335   copying build/lib/deepspeed/ops/csrc/compile/z2.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-01T07:37:07,338   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2025-06-01T07:37:07,340   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2025-06-01T07:37:07,341   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2025-06-01T07:37:07,344   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2025-06-01T07:37:07,346   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2025-06-01T07:37:07,349   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2025-06-01T07:37:07,350   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-01T07:37:07,353   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-01T07:37:07,355   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-01T07:37:07,358   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2025-06-01T07:37:07,359   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-01T07:37:07,362   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-01T07:37:07,364   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-01T07:37:07,366   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-01T07:37:07,369   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-01T07:37:07,371   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2025-06-01T07:37:07,373   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2025-06-01T07:37:07,375   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2025-06-01T07:37:07,376   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-06-01T07:37:07,380   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-06-01T07:37:07,382   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2025-06-01T07:37:07,384   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2025-06-01T07:37:07,387   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2025-06-01T07:37:07,388   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2025-06-01T07:37:07,390   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2025-06-01T07:37:07,392   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2025-06-01T07:37:07,394   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2025-06-01T07:37:07,396   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2025-06-01T07:37:07,397   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-01T07:37:07,399   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-01T07:37:07,403   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-01T07:37:07,405   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-01T07:37:07,409   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2025-06-01T07:37:07,410   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,414   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,416   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,419   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,422   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,424   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,426   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,429   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,431   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,434   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,436   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,438   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,441   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,443   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,445   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,447   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,449   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,451   copying build/lib/deepspeed/ops/csrc/includes/deepcompile.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,454   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,457   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,459   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,461   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,463   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,466   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,468   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,471   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,473   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,475   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,478   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,480   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-01T07:37:07,484   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2025-06-01T07:37:07,485   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-01T07:37:07,488   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-01T07:37:07,490   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-01T07:37:07,492   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-01T07:37:07,495   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-01T07:37:07,498   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-01T07:37:07,501   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-01T07:37:07,504   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2025-06-01T07:37:07,506   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2025-06-01T07:37:07,507   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-01T07:37:07,510   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-01T07:37:07,512   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-01T07:37:07,514   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-01T07:37:07,516   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-01T07:37:07,519   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-01T07:37:07,522   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2025-06-01T07:37:07,523   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-01T07:37:07,526   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-01T07:37:07,528   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-01T07:37:07,531   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-01T07:37:07,534   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2025-06-01T07:37:07,536   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-01T07:37:07,538   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-01T07:37:07,540   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-01T07:37:07,543   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-01T07:37:07,545   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-01T07:37:07,547   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-01T07:37:07,550   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-01T07:37:07,554   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2025-06-01T07:37:07,555   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,557   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,559   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,561   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,563   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,565   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,567   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,569   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,571   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,573   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,575   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu
2025-06-01T07:37:07,576   copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-01T07:37:07,578   copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-01T07:37:07,580   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-01T07:37:07,582   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-01T07:37:07,584   copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-01T07:37:07,586   copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-01T07:37:07,588   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,591   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2025-06-01T07:37:07,592   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-01T07:37:07,594   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-01T07:37:07,596   copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-01T07:37:07,599   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-01T07:37:07,601   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-01T07:37:07,603   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-01T07:37:07,605   copying build/lib/deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-01T07:37:07,607   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,609   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,611   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,614   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,616   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2025-06-01T07:37:07,617   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T07:37:07,620   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T07:37:07,622   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T07:37:07,624   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T07:37:07,626   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T07:37:07,628   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T07:37:07,630   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T07:37:07,633   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T07:37:07,635   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T07:37:07,637   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-01T07:37:07,639   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,643   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2025-06-01T07:37:07,644   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T07:37:07,647   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T07:37:07,649   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T07:37:07,651   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T07:37:07,653   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T07:37:07,655   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T07:37:07,657   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T07:37:07,659   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T07:37:07,661   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-01T07:37:07,663   copying build/lib/deepspeed/ops/op_builder/dc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,666   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/sdaa
2025-06-01T07:37:07,667   copying build/lib/deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-01T07:37:07,669   copying build/lib/deepspeed/ops/op_builder/sdaa/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-01T07:37:07,671   copying build/lib/deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-01T07:37:07,673   copying build/lib/deepspeed/ops/op_builder/sdaa/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-01T07:37:07,675   copying build/lib/deepspeed/ops/op_builder/sdaa/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-01T07:37:07,678   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2025-06-01T07:37:07,679   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-01T07:37:07,681   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-01T07:37:07,683   copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-01T07:37:07,685   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-01T07:37:07,687   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-01T07:37:07,689   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-01T07:37:07,691   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-01T07:37:07,693   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,696   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,698   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,701   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,703   copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,705   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,707   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,710   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,712   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-01T07:37:07,715   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2025-06-01T07:37:07,716   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2025-06-01T07:37:07,718   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2025-06-01T07:37:07,720   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2025-06-01T07:37:07,722   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2025-06-01T07:37:07,724   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2025-06-01T07:37:07,725   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-06-01T07:37:07,727   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-06-01T07:37:07,729   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2025-06-01T07:37:07,733   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2025-06-01T07:37:07,734   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-01T07:37:07,737   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-01T07:37:07,740   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-01T07:37:07,743   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2025-06-01T07:37:07,744   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T07:37:07,747   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T07:37:07,749   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T07:37:07,751   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T07:37:07,754   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T07:37:07,756   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T07:37:07,759   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T07:37:07,761   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T07:37:07,763   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T07:37:07,765   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-01T07:37:07,768   creating build/bdist.linux-armv7l/wheel/deepspeed/compile
2025-06-01T07:37:07,769   copying build/lib/deepspeed/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T07:37:07,771   copying build/lib/deepspeed/compile/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T07:37:07,774   creating build/bdist.linux-armv7l/wheel/deepspeed/compile/passes
2025-06-01T07:37:07,776   copying build/lib/deepspeed/compile/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-01T07:37:07,778   copying build/lib/deepspeed/compile/passes/zero1_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-01T07:37:07,781   copying build/lib/deepspeed/compile/passes/offload_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-01T07:37:07,783   copying build/lib/deepspeed/compile/passes/offload_adam_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-01T07:37:07,787   copying build/lib/deepspeed/compile/passes/zero3_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-01T07:37:07,789   copying build/lib/deepspeed/compile/passes/selective_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-01T07:37:07,792   copying build/lib/deepspeed/compile/passes/offload_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-01T07:37:07,794   copying build/lib/deepspeed/compile/passes/prefetch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-01T07:37:07,796   copying build/lib/deepspeed/compile/list_schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T07:37:07,799   copying build/lib/deepspeed/compile/partitioner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T07:37:07,801   copying build/lib/deepspeed/compile/patch_fake_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T07:37:07,803   creating build/bdist.linux-armv7l/wheel/deepspeed/compile/profilers
2025-06-01T07:37:07,804   copying build/lib/deepspeed/compile/profilers/comm_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-01T07:37:07,807   copying build/lib/deepspeed/compile/profilers/graph_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-01T07:37:07,810   copying build/lib/deepspeed/compile/profilers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-01T07:37:07,812   copying build/lib/deepspeed/compile/inductor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T07:37:07,815   copying build/lib/deepspeed/compile/graph_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T07:37:07,817   copying build/lib/deepspeed/compile/input_storage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T07:37:07,819   copying build/lib/deepspeed/compile/patch_compiled_func.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T07:37:07,821   copying build/lib/deepspeed/compile/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T07:37:07,824   copying build/lib/deepspeed/compile/util.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T07:37:07,827   copying build/lib/deepspeed/compile/init_z1.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T07:37:07,830   copying build/lib/deepspeed/compile/init_z3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T07:37:07,832   copying build/lib/deepspeed/compile/fx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-01T07:37:07,835   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-01T07:37:07,838   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2025-06-01T07:37:07,839   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-01T07:37:07,842   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-01T07:37:07,845   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-01T07:37:07,848   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-01T07:37:07,851   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-01T07:37:07,853   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-01T07:37:07,856   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-01T07:37:07,858   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-01T07:37:07,861   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2025-06-01T07:37:07,863   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-01T07:37:07,866   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-01T07:37:07,868   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-01T07:37:07,871   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-01T07:37:07,875   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2025-06-01T07:37:07,877   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-01T07:37:07,879   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-01T07:37:07,882   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-01T07:37:07,884   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-01T07:37:07,886   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-01T07:37:07,889   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-01T07:37:07,893   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2025-06-01T07:37:07,894   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-01T07:37:07,896   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-01T07:37:07,899   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-01T07:37:07,901   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-01T07:37:07,904   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-01T07:37:07,906   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-01T07:37:07,910   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-01T07:37:07,914   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2025-06-01T07:37:07,915   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-01T07:37:07,918   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-01T07:37:07,921   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-01T07:37:07,926   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2025-06-01T07:37:07,928   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T07:37:07,934   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T07:37:07,939   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T07:37:07,942   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T07:37:07,945   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T07:37:07,949   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T07:37:07,952   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T07:37:07,954   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T07:37:07,957   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-01T07:37:07,960   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2025-06-01T07:37:07,962   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-01T07:37:07,964   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-01T07:37:07,967   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-01T07:37:07,970   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-01T07:37:07,973   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-01T07:37:07,975   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-01T07:37:07,979   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2025-06-01T07:37:07,981   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-01T07:37:07,983   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-01T07:37:07,987   copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-01T07:37:07,991   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-01T07:37:07,994   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2025-06-01T07:37:07,995   copying build/lib/deepspeed/accelerator/sdaa_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T07:37:07,998   copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T07:37:08,001   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T07:37:08,003   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T07:37:08,006   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T07:37:08,009   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T07:37:08,011   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T07:37:08,015   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T07:37:08,018   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T07:37:08,022   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T07:37:08,025   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-01T07:37:08,028   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-01T07:37:08,031   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2025-06-01T07:37:08,033   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-01T07:37:08,035   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-01T07:37:08,039   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2025-06-01T07:37:08,041   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-01T07:37:08,043   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-01T07:37:08,046   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-01T07:37:08,049   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-01T07:37:08,052   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-01T07:37:08,055   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2025-06-01T07:37:08,056   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T07:37:08,059   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2025-06-01T07:37:08,061   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-01T07:37:08,063   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-01T07:37:08,065   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-01T07:37:08,068   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-01T07:37:08,071   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T07:37:08,073   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2025-06-01T07:37:08,075   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-06-01T07:37:08,077   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-06-01T07:37:08,080   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2025-06-01T07:37:08,081   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-06-01T07:37:08,084   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-06-01T07:37:08,086   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T07:37:08,088   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T07:37:08,091   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T07:37:08,093   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T07:37:08,095   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-01T07:37:08,099   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T07:37:08,100   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T07:37:08,103   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T07:37:08,106   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T07:37:08,110   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T07:37:08,114   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:08,115   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:08,118   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:08,121   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:08,124   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:08,126   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:08,129   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:08,131   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:08,134   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:08,136   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-01T07:37:08,139   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T07:37:08,142   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-01T07:37:08,146   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T07:37:08,147   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T07:37:08,150   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T07:37:08,153   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T07:37:08,155   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T07:37:08,158   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-01T07:37:08,161   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T07:37:08,162   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T07:37:08,165   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T07:37:08,168   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T07:37:08,170   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T07:37:08,173   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T07:37:08,175   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T07:37:08,177   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-01T07:37:08,181   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T07:37:08,182   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T07:37:08,185   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T07:37:08,187   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T07:37:08,190   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T07:37:08,192   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-01T07:37:08,195   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:37:08,196   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:37:08,199   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:37:08,202   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:37:08,206   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:37:08,209   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:37:08,211   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:37:08,214   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:37:08,216   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-01T07:37:08,219   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2025-06-01T07:37:08,221   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-01T07:37:08,225   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-01T07:37:08,228   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-01T07:37:08,231   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-01T07:37:08,234   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-01T07:37:08,236   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-01T07:37:08,238   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-06-01T07:37:08,240   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-06-01T07:37:08,243   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-01T07:37:08,244   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-01T07:37:08,247   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T07:37:08,248   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T07:37:08,251   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T07:37:08,253   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T07:37:08,256   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T07:37:08,258   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-01T07:37:08,262   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T07:37:08,263   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T07:37:08,266   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T07:37:08,268   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T07:37:08,271   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T07:37:08,273   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T07:37:08,276   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-01T07:37:08,279   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2025-06-01T07:37:08,281   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T07:37:08,283   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T07:37:08,286   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T07:37:08,289   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T07:37:08,292   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T07:37:08,294   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T07:37:08,296   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-01T07:37:08,299   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-06-01T07:37:08,301   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-01T07:37:08,303   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-01T07:37:08,305   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-01T07:37:08,308   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-01T07:37:08,311   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T07:37:08,312   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T07:37:08,315   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T07:37:08,317   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T07:37:08,319   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-01T07:37:08,322   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-06-01T07:37:08,325   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-01T07:37:08,326   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-01T07:37:08,329   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T07:37:08,333   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T07:37:08,335   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T07:37:08,338   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T07:37:08,340   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T07:37:08,342   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T07:37:08,345   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-01T07:37:08,348   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T07:37:08,349   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T07:37:08,352   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T07:37:08,354   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T07:37:08,357   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T07:37:08,359   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T07:37:08,362   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-01T07:37:08,365   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T07:37:08,366   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T07:37:08,369   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T07:37:08,372   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T07:37:08,375   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T07:37:08,378   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T07:37:08,380   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-01T07:37:08,383   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T07:37:08,385   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T07:37:08,387   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T07:37:08,390   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T07:37:08,392   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T07:37:08,395   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T07:37:08,397   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-01T07:37:08,400   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:37:08,402   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:37:08,404   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:37:08,406   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:37:08,409   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:37:08,411   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:37:08,413   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:37:08,417   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:37:08,419   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-01T07:37:08,422   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T07:37:08,423   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T07:37:08,426   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T07:37:08,428   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T07:37:08,431   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T07:37:08,433   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T07:37:08,435   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-01T07:37:08,438   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2025-06-01T07:37:08,439   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-01T07:37:08,443   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2025-06-01T07:37:08,444   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-01T07:37:08,447   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-01T07:37:08,449   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-01T07:37:08,450   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-01T07:37:08,453   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-01T07:37:08,455   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-01T07:37:08,458   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:37:08,459   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:37:08,461   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:37:08,464   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:37:08,466   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:37:08,469   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:37:08,472   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:37:08,475   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:37:08,477   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:37:08,479   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-01T07:37:08,482   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2025-06-01T07:37:08,483   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-01T07:37:08,486   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-01T07:37:08,488   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-01T07:37:08,490   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-01T07:37:08,494   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T07:37:08,495   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T07:37:08,497   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T07:37:08,499   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T07:37:08,501   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-01T07:37:08,504   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-01T07:37:08,507   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2025-06-01T07:37:08,508   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-01T07:37:08,510   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-01T07:37:08,512   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-01T07:37:08,514   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-01T07:37:08,517   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2025-06-01T07:37:08,519   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-01T07:37:08,521   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-01T07:37:08,523   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-01T07:37:08,525   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-01T07:37:08,527   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-01T07:37:08,531   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T07:37:08,532   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T07:37:08,534   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T07:37:08,536   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T07:37:08,538   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-01T07:37:08,541   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-01T07:37:08,543   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-01T07:37:08,547   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:37:08,548   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:37:08,551   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:37:08,553   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:37:08,555   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:37:08,557   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:37:08,560   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:37:08,562   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:37:08,564   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:37:08,566   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-01T07:37:08,569   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T07:37:08,570   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T07:37:08,573   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T07:37:08,575   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T07:37:08,577   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-01T07:37:08,580   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2025-06-01T07:37:08,581   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-01T07:37:08,583   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-01T07:37:08,586   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-01T07:37:08,587   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-01T07:37:08,591   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T07:37:08,592   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T07:37:08,594   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T07:37:08,596   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T07:37:08,598   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-01T07:37:08,601   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2025-06-01T07:37:08,602   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-01T07:37:08,605   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-01T07:37:08,607   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-01T07:37:08,609   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-01T07:37:08,612   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T07:37:08,615   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2025-06-01T07:37:08,616   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-01T07:37:08,618   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-01T07:37:08,621   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-01T07:37:08,624   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2025-06-01T07:37:08,626   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-01T07:37:08,628   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-01T07:37:08,631   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-01T07:37:08,634   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-01T07:37:08,637   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-01T07:37:08,639   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-01T07:37:08,642   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-01T07:37:08,645   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-01T07:37:08,647   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2025-06-01T07:37:08,649   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-01T07:37:08,651   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-01T07:37:08,653   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-01T07:37:08,656   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-01T07:37:08,658   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-01T07:37:08,660   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-01T07:37:08,662   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-01T07:37:08,664   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-01T07:37:08,668   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2025-06-01T07:37:08,669   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2025-06-01T07:37:08,671   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-01T07:37:08,674   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-01T07:37:08,676   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-01T07:37:08,678   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2025-06-01T07:37:08,681   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2025-06-01T07:37:08,682   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-06-01T07:37:08,684   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-06-01T07:37:08,687   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2025-06-01T07:37:08,688   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-06-01T07:37:08,691   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-06-01T07:37:08,694   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2025-06-01T07:37:08,695   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-06-01T07:37:08,697   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-06-01T07:37:08,701   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-01T07:37:08,702   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-06-01T07:37:08,704   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-06-01T07:37:08,706   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-01T07:37:08,708   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-01T07:37:08,710   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-01T07:37:08,712   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-01T07:37:08,715   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2025-06-01T07:37:08,716   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-06-01T07:37:08,719   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-06-01T07:37:08,722   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T07:37:08,725   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T07:37:08,727   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T07:37:08,729   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T07:37:08,732   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T07:37:08,734   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-01T07:37:08,737   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2025-06-01T07:37:08,738   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-01T07:37:08,741   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-01T07:37:08,743   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-01T07:37:08,746   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2025-06-01T07:37:08,747   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-06-01T07:37:08,750   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-06-01T07:37:08,752   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-01T07:37:08,756   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2025-06-01T07:37:08,757   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2025-06-01T07:37:08,759   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-01T07:37:08,762   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-01T07:37:08,764   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-01T07:37:08,767   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-01T07:37:08,771   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-01T07:37:08,773   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2025-06-01T07:37:08,775   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-01T07:37:08,778   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-01T07:37:08,780   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-01T07:37:08,782   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-01T07:37:08,784   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-01T07:37:08,787   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-01T07:37:08,790   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2025-06-01T07:37:08,792   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:08,795   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino
2025-06-01T07:37:08,796   copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-01T07:37:08,798   copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-01T07:37:08,801   copying build/lib/deepspeed/runtime/domino/async_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-01T07:37:08,804   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2025-06-01T07:37:08,805   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-01T07:37:08,807   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-01T07:37:08,811   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2025-06-01T07:37:08,812   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-01T07:37:08,815   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-01T07:37:08,818   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-01T07:37:08,821   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-01T07:37:08,823   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-01T07:37:08,825   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-01T07:37:08,829   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T07:37:08,830   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T07:37:08,832   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T07:37:08,835   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T07:37:08,838   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T07:37:08,841   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T07:37:08,843   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-01T07:37:08,847   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-01T07:37:08,850   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/tensor_parallel
2025-06-01T07:37:08,851   copying build/lib/deepspeed/runtime/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-01T07:37:08,853   copying build/lib/deepspeed/runtime/tensor_parallel/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-01T07:37:08,856   copying build/lib/deepspeed/runtime/tensor_parallel/tp_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-01T07:37:08,858   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:08,861   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2025-06-01T07:37:08,862   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-06-01T07:37:08,864   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-06-01T07:37:08,867   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/model_checkpointing
2025-06-01T07:37:08,868   copying build/lib/deepspeed/runtime/model_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2025-06-01T07:37:08,871   copying build/lib/deepspeed/runtime/model_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2025-06-01T07:37:08,873   copying build/lib/deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2025-06-01T07:37:08,876   copying build/lib/deepspeed/runtime/model_checkpointing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2025-06-01T07:37:08,878   copying build/lib/deepspeed/runtime/model_checkpointing/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2025-06-01T07:37:08,880   copying build/lib/deepspeed/runtime/model_checkpointing/writer_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2025-06-01T07:37:08,883   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:08,885   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2025-06-01T07:37:08,886   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-01T07:37:08,888   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-01T07:37:08,892   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-01T07:37:08,894   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-01T07:37:08,897   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-01T07:37:08,900   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-01T07:37:08,904   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:08,907   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:08,911   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:08,915   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2025-06-01T07:37:08,916   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T07:37:08,918   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T07:37:08,921   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T07:37:08,924   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T07:37:08,927   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T07:37:08,929   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T07:37:08,931   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T07:37:08,933   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T07:37:08,936   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-01T07:37:08,939   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2025-06-01T07:37:08,940   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T07:37:08,943   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T07:37:08,945   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T07:37:08,947   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T07:37:08,950   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T07:37:08,952   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T07:37:08,957   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T07:37:08,960   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T07:37:08,963   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T07:37:08,965   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T07:37:08,968   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T07:37:08,970   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T07:37:08,974   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T07:37:08,977   copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T07:37:08,979   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T07:37:08,984   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T07:37:08,987   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-01T07:37:08,990   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:08,993   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/sequence_parallel
2025-06-01T07:37:08,994   copying build/lib/deepspeed/runtime/sequence_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel
2025-06-01T07:37:08,996   copying build/lib/deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel
2025-06-01T07:37:08,999   copying build/lib/deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel
2025-06-01T07:37:09,002   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:09,004   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:09,007   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:09,009   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:09,012   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:09,015   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2025-06-01T07:37:09,016   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-01T07:37:09,019   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-01T07:37:09,021   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-01T07:37:09,024   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-01T07:37:09,026   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-01T07:37:09,029   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-01T07:37:09,031   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:09,035   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2025-06-01T07:37:09,036   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-01T07:37:09,038   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-01T07:37:09,041   copying build/lib/deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-01T07:37:09,043   copying build/lib/deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-01T07:37:09,045   copying build/lib/deepspeed/runtime/checkpoint_engine/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-01T07:37:09,047   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-01T07:37:09,049   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-01T07:37:09,052   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:09,054   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:09,057   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:09,061   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2025-06-01T07:37:09,062   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-01T07:37:09,064   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-01T07:37:09,068   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2025-06-01T07:37:09,069   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-01T07:37:09,071   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-01T07:37:09,074   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-01T07:37:09,077   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-01T07:37:09,080   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-01T07:37:09,083   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-01T07:37:09,086   copying build/lib/deepspeed/runtime/torch_autocast.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:09,089   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2025-06-01T07:37:09,090   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-01T07:37:09,092   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-01T07:37:09,095   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-01T07:37:09,099   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:09,102   copying build/lib/deepspeed/runtime/precision_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:09,104   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-01T07:37:09,110   running install_egg_info
2025-06-01T07:37:09,148   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.17.2-py3.11.egg-info
2025-06-01T07:37:09,163   running install_scripts
2025-06-01T07:37:09,165   creating build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts
2025-06-01T07:37:09,166   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts
2025-06-01T07:37:09,168   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts
2025-06-01T07:37:09,170   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts
2025-06-01T07:37:09,172   copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts
2025-06-01T07:37:09,174   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts
2025-06-01T07:37:09,176   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts
2025-06-01T07:37:09,178   copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts
2025-06-01T07:37:09,179   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts
2025-06-01T07:37:09,181   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts
2025-06-01T07:37:09,183   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts
2025-06-01T07:37:09,185   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts/ds_ssh to 755
2025-06-01T07:37:09,185   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts/ds to 755
2025-06-01T07:37:09,186   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts/deepspeed.pt to 755
2025-06-01T07:37:09,186   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts/ds_nvme_tune to 755
2025-06-01T07:37:09,187   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts/deepspeed to 755
2025-06-01T07:37:09,188   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts/ds_bench to 755
2025-06-01T07:37:09,188   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts/ds_io to 755
2025-06-01T07:37:09,189   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts/ds_report to 755
2025-06-01T07:37:09,189   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts/ds_elastic to 755
2025-06-01T07:37:09,190   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.data/scripts/dsr to 755
2025-06-01T07:37:09,204   creating build/bdist.linux-armv7l/wheel/deepspeed-0.17.2.dist-info/WHEEL
2025-06-01T07:37:09,206   creating '/tmp/pip-wheel-agjf22ir/deepspeed-0.17.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2025-06-01T07:37:09,211   adding 'deepspeed/__init__.py'
2025-06-01T07:37:09,213   adding 'deepspeed/constants.py'
2025-06-01T07:37:09,215   adding 'deepspeed/env_report.py'
2025-06-01T07:37:09,217   adding 'deepspeed/git_version_info.py'
2025-06-01T07:37:09,218   adding 'deepspeed/git_version_info_installed.py'
2025-06-01T07:37:09,221   adding 'deepspeed/accelerator/__init__.py'
2025-06-01T07:37:09,222   adding 'deepspeed/accelerator/abstract_accelerator.py'
2025-06-01T07:37:09,225   adding 'deepspeed/accelerator/cpu_accelerator.py'
2025-06-01T07:37:09,227   adding 'deepspeed/accelerator/cuda_accelerator.py'
2025-06-01T07:37:09,229   adding 'deepspeed/accelerator/hpu_accelerator.py'
2025-06-01T07:37:09,231   adding 'deepspeed/accelerator/mlu_accelerator.py'
2025-06-01T07:37:09,233   adding 'deepspeed/accelerator/mps_accelerator.py'
2025-06-01T07:37:09,234   adding 'deepspeed/accelerator/npu_accelerator.py'
2025-06-01T07:37:09,236   adding 'deepspeed/accelerator/real_accelerator.py'
2025-06-01T07:37:09,238   adding 'deepspeed/accelerator/sdaa_accelerator.py'
2025-06-01T07:37:09,240   adding 'deepspeed/accelerator/xpu_accelerator.py'
2025-06-01T07:37:09,242   adding 'deepspeed/autotuning/__init__.py'
2025-06-01T07:37:09,247   adding 'deepspeed/autotuning/autotuner.py'
2025-06-01T07:37:09,249   adding 'deepspeed/autotuning/config.py'
2025-06-01T07:37:09,250   adding 'deepspeed/autotuning/constants.py'
2025-06-01T07:37:09,253   adding 'deepspeed/autotuning/scheduler.py'
2025-06-01T07:37:09,255   adding 'deepspeed/autotuning/utils.py'
2025-06-01T07:37:09,257   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2025-06-01T07:37:09,258   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2025-06-01T07:37:09,259   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2025-06-01T07:37:09,260   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2025-06-01T07:37:09,262   adding 'deepspeed/autotuning/tuner/__init__.py'
2025-06-01T07:37:09,263   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2025-06-01T07:37:09,264   adding 'deepspeed/autotuning/tuner/cost_model.py'
2025-06-01T07:37:09,265   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2025-06-01T07:37:09,267   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2025-06-01T07:37:09,268   adding 'deepspeed/autotuning/tuner/utils.py'
2025-06-01T07:37:09,270   adding 'deepspeed/checkpoint/__init__.py'
2025-06-01T07:37:09,272   adding 'deepspeed/checkpoint/constants.py'
2025-06-01T07:37:09,274   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2025-06-01T07:37:09,277   adding 'deepspeed/checkpoint/ds_to_universal.py'
2025-06-01T07:37:09,278   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2025-06-01T07:37:09,280   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2025-06-01T07:37:09,282   adding 'deepspeed/checkpoint/reshape_utils.py'
2025-06-01T07:37:09,283   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2025-06-01T07:37:09,285   adding 'deepspeed/checkpoint/utils.py'
2025-06-01T07:37:09,286   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2025-06-01T07:37:09,288   adding 'deepspeed/comm/__init__.py'
2025-06-01T07:37:09,290   adding 'deepspeed/comm/backend.py'
2025-06-01T07:37:09,291   adding 'deepspeed/comm/ccl.py'
2025-06-01T07:37:09,296   adding 'deepspeed/comm/comm.py'
2025-06-01T07:37:09,297   adding 'deepspeed/comm/config.py'
2025-06-01T07:37:09,298   adding 'deepspeed/comm/constants.py'
2025-06-01T07:37:09,299   adding 'deepspeed/comm/reduce_op.py'
2025-06-01T07:37:09,302   adding 'deepspeed/comm/torch.py'
2025-06-01T07:37:09,303   adding 'deepspeed/comm/utils.py'
2025-06-01T07:37:09,305   adding 'deepspeed/compile/__init__.py'
2025-06-01T07:37:09,308   adding 'deepspeed/compile/backend.py'
2025-06-01T07:37:09,309   adding 'deepspeed/compile/config.py'
2025-06-01T07:37:09,311   adding 'deepspeed/compile/fx.py'
2025-06-01T07:37:09,312   adding 'deepspeed/compile/graph_param.py'
2025-06-01T07:37:09,314   adding 'deepspeed/compile/inductor.py'
2025-06-01T07:37:09,315   adding 'deepspeed/compile/init_z1.py'
2025-06-01T07:37:09,317   adding 'deepspeed/compile/init_z3.py'
2025-06-01T07:37:09,318   adding 'deepspeed/compile/input_storage.py'
2025-06-01T07:37:09,321   adding 'deepspeed/compile/list_schedule.py'
2025-06-01T07:37:09,322   adding 'deepspeed/compile/partitioner.py'
2025-06-01T07:37:09,324   adding 'deepspeed/compile/patch_compiled_func.py'
2025-06-01T07:37:09,325   adding 'deepspeed/compile/patch_fake_tensor.py'
2025-06-01T07:37:09,328   adding 'deepspeed/compile/util.py'
2025-06-01T07:37:09,330   adding 'deepspeed/compile/passes/__init__.py'
2025-06-01T07:37:09,331   adding 'deepspeed/compile/passes/offload_activation.py'
2025-06-01T07:37:09,334   adding 'deepspeed/compile/passes/offload_adam_states.py'
2025-06-01T07:37:09,335   adding 'deepspeed/compile/passes/offload_parameters.py'
2025-06-01T07:37:09,337   adding 'deepspeed/compile/passes/prefetch.py'
2025-06-01T07:37:09,339   adding 'deepspeed/compile/passes/selective_gather.py'
2025-06-01T07:37:09,340   adding 'deepspeed/compile/passes/zero1_compile.py'
2025-06-01T07:37:09,342   adding 'deepspeed/compile/passes/zero3_compile.py'
2025-06-01T07:37:09,344   adding 'deepspeed/compile/profilers/__init__.py'
2025-06-01T07:37:09,345   adding 'deepspeed/compile/profilers/comm_profile.py'
2025-06-01T07:37:09,348   adding 'deepspeed/compile/profilers/graph_profile.py'
2025-06-01T07:37:09,349   adding 'deepspeed/compression/__init__.py'
2025-06-01T07:37:09,353   adding 'deepspeed/compression/basic_layer.py'
2025-06-01T07:37:09,355   adding 'deepspeed/compression/compress.py'
2025-06-01T07:37:09,358   adding 'deepspeed/compression/config.py'
2025-06-01T07:37:09,359   adding 'deepspeed/compression/constants.py'
2025-06-01T07:37:09,362   adding 'deepspeed/compression/helper.py'
2025-06-01T07:37:09,363   adding 'deepspeed/compression/scheduler.py'
2025-06-01T07:37:09,365   adding 'deepspeed/compression/utils.py'
2025-06-01T07:37:09,367   adding 'deepspeed/elasticity/__init__.py'
2025-06-01T07:37:09,368   adding 'deepspeed/elasticity/config.py'
2025-06-01T07:37:09,370   adding 'deepspeed/elasticity/constants.py'
2025-06-01T07:37:09,371   adding 'deepspeed/elasticity/elastic_agent.py'
2025-06-01T07:37:09,374   adding 'deepspeed/elasticity/elasticity.py'
2025-06-01T07:37:09,375   adding 'deepspeed/elasticity/utils.py'
2025-06-01T07:37:09,377   adding 'deepspeed/inference/__init__.py'
2025-06-01T07:37:09,379   adding 'deepspeed/inference/config.py'
2025-06-01T07:37:09,383   adding 'deepspeed/inference/engine.py'
2025-06-01T07:37:09,385   adding 'deepspeed/inference/quantization/__init__.py'
2025-06-01T07:37:09,386   adding 'deepspeed/inference/quantization/layers.py'
2025-06-01T07:37:09,388   adding 'deepspeed/inference/quantization/quantization.py'
2025-06-01T07:37:09,389   adding 'deepspeed/inference/quantization/quantization_context.py'
2025-06-01T07:37:09,391   adding 'deepspeed/inference/quantization/utils.py'
2025-06-01T07:37:09,393   adding 'deepspeed/inference/v2/__init__.py'
2025-06-01T07:37:09,394   adding 'deepspeed/inference/v2/allocator.py'
2025-06-01T07:37:09,395   adding 'deepspeed/inference/v2/config_v2.py'
2025-06-01T07:37:09,397   adding 'deepspeed/inference/v2/engine_factory.py'
2025-06-01T07:37:09,399   adding 'deepspeed/inference/v2/engine_v2.py'
2025-06-01T07:37:09,400   adding 'deepspeed/inference/v2/inference_parameter.py'
2025-06-01T07:37:09,402   adding 'deepspeed/inference/v2/inference_utils.py'
2025-06-01T07:37:09,403   adding 'deepspeed/inference/v2/logging.py'
2025-06-01T07:37:09,404   adding 'deepspeed/inference/v2/scheduling_utils.py'
2025-06-01T07:37:09,406   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2025-06-01T07:37:09,407   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2025-06-01T07:37:09,409   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2025-06-01T07:37:09,410   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2025-06-01T07:37:09,412   adding 'deepspeed/inference/v2/kernels/__init__.py'
2025-06-01T07:37:09,413   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2025-06-01T07:37:09,415   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2025-06-01T07:37:09,416   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2025-06-01T07:37:09,418   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2025-06-01T07:37:09,419   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2025-06-01T07:37:09,420   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2025-06-01T07:37:09,422   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2025-06-01T07:37:09,423   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2025-06-01T07:37:09,425   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2025-06-01T07:37:09,427   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2025-06-01T07:37:09,428   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2025-06-01T07:37:09,430   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2025-06-01T07:37:09,432   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2025-06-01T07:37:09,434   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2025-06-01T07:37:09,435   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2025-06-01T07:37:09,436   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2025-06-01T07:37:09,438   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2025-06-01T07:37:09,439   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2025-06-01T07:37:09,441   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2025-06-01T07:37:09,443   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2025-06-01T07:37:09,445   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2025-06-01T07:37:09,446   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2025-06-01T07:37:09,448   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2025-06-01T07:37:09,450   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2025-06-01T07:37:09,452   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2025-06-01T07:37:09,453   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2025-06-01T07:37:09,455   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2025-06-01T07:37:09,457   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2025-06-01T07:37:09,459   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2025-06-01T07:37:09,460   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2025-06-01T07:37:09,462   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2025-06-01T07:37:09,464   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2025-06-01T07:37:09,465   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2025-06-01T07:37:09,467   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2025-06-01T07:37:09,468   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2025-06-01T07:37:09,470   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2025-06-01T07:37:09,472   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2025-06-01T07:37:09,473   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2025-06-01T07:37:09,474   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2025-06-01T07:37:09,475   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2025-06-01T07:37:09,477   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2025-06-01T07:37:09,478   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2025-06-01T07:37:09,480   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2025-06-01T07:37:09,482   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2025-06-01T07:37:09,483   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2025-06-01T07:37:09,484   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2025-06-01T07:37:09,486   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2025-06-01T07:37:09,488   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2025-06-01T07:37:09,489   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2025-06-01T07:37:09,491   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2025-06-01T07:37:09,492   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2025-06-01T07:37:09,493   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2025-06-01T07:37:09,495   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2025-06-01T07:37:09,496   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2025-06-01T07:37:09,498   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2025-06-01T07:37:09,499   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2025-06-01T07:37:09,501   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2025-06-01T07:37:09,502   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2025-06-01T07:37:09,504   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2025-06-01T07:37:09,505   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2025-06-01T07:37:09,507   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2025-06-01T07:37:09,509   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2025-06-01T07:37:09,510   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2025-06-01T07:37:09,512   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2025-06-01T07:37:09,515   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2025-06-01T07:37:09,517   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2025-06-01T07:37:09,519   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2025-06-01T07:37:09,521   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2025-06-01T07:37:09,523   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2025-06-01T07:37:09,524   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2025-06-01T07:37:09,525   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2025-06-01T07:37:09,526   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2025-06-01T07:37:09,528   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2025-06-01T07:37:09,530   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2025-06-01T07:37:09,531   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2025-06-01T07:37:09,532   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2025-06-01T07:37:09,534   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2025-06-01T07:37:09,535   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2025-06-01T07:37:09,537   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2025-06-01T07:37:09,539   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2025-06-01T07:37:09,540   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2025-06-01T07:37:09,541   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2025-06-01T07:37:09,543   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2025-06-01T07:37:09,544   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2025-06-01T07:37:09,546   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2025-06-01T07:37:09,548   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2025-06-01T07:37:09,550   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2025-06-01T07:37:09,551   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2025-06-01T07:37:09,552   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2025-06-01T07:37:09,554   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2025-06-01T07:37:09,556   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2025-06-01T07:37:09,558   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2025-06-01T07:37:09,559   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2025-06-01T07:37:09,561   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2025-06-01T07:37:09,562   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2025-06-01T07:37:09,564   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2025-06-01T07:37:09,565   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2025-06-01T07:37:09,566   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2025-06-01T07:37:09,568   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2025-06-01T07:37:09,569   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2025-06-01T07:37:09,571   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2025-06-01T07:37:09,572   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2025-06-01T07:37:09,573   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2025-06-01T07:37:09,575   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2025-06-01T07:37:09,576   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2025-06-01T07:37:09,578   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2025-06-01T07:37:09,579   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2025-06-01T07:37:09,581   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2025-06-01T07:37:09,582   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2025-06-01T07:37:09,583   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2025-06-01T07:37:09,585   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2025-06-01T07:37:09,587   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2025-06-01T07:37:09,588   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2025-06-01T07:37:09,589   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2025-06-01T07:37:09,591   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2025-06-01T07:37:09,592   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2025-06-01T07:37:09,594   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2025-06-01T07:37:09,595   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2025-06-01T07:37:09,596   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2025-06-01T07:37:09,598   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2025-06-01T07:37:09,600   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2025-06-01T07:37:09,602   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2025-06-01T07:37:09,604   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2025-06-01T07:37:09,606   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2025-06-01T07:37:09,609   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2025-06-01T07:37:09,611   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2025-06-01T07:37:09,613   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2025-06-01T07:37:09,615   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2025-06-01T07:37:09,617   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2025-06-01T07:37:09,618   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2025-06-01T07:37:09,620   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2025-06-01T07:37:09,621   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2025-06-01T07:37:09,622   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2025-06-01T07:37:09,624   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2025-06-01T07:37:09,625   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2025-06-01T07:37:09,626   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2025-06-01T07:37:09,628   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2025-06-01T07:37:09,629   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2025-06-01T07:37:09,631   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2025-06-01T07:37:09,632   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2025-06-01T07:37:09,634   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2025-06-01T07:37:09,635   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2025-06-01T07:37:09,637   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2025-06-01T07:37:09,638   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2025-06-01T07:37:09,640   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2025-06-01T07:37:09,641   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2025-06-01T07:37:09,643   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2025-06-01T07:37:09,644   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2025-06-01T07:37:09,646   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2025-06-01T07:37:09,648   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2025-06-01T07:37:09,650   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2025-06-01T07:37:09,651   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2025-06-01T07:37:09,653   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2025-06-01T07:37:09,654   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2025-06-01T07:37:09,656   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2025-06-01T07:37:09,658   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2025-06-01T07:37:09,660   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2025-06-01T07:37:09,661   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2025-06-01T07:37:09,663   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2025-06-01T07:37:09,665   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2025-06-01T07:37:09,666   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2025-06-01T07:37:09,668   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2025-06-01T07:37:09,670   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2025-06-01T07:37:09,671   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2025-06-01T07:37:09,673   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2025-06-01T07:37:09,674   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2025-06-01T07:37:09,676   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2025-06-01T07:37:09,677   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2025-06-01T07:37:09,679   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2025-06-01T07:37:09,681   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2025-06-01T07:37:09,682   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2025-06-01T07:37:09,684   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2025-06-01T07:37:09,685   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2025-06-01T07:37:09,687   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2025-06-01T07:37:09,689   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2025-06-01T07:37:09,690   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2025-06-01T07:37:09,692   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2025-06-01T07:37:09,693   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2025-06-01T07:37:09,695   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2025-06-01T07:37:09,696   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2025-06-01T07:37:09,697   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2025-06-01T07:37:09,699   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2025-06-01T07:37:09,700   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2025-06-01T07:37:09,702   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2025-06-01T07:37:09,703   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2025-06-01T07:37:09,705   adding 'deepspeed/inference/v2/modules/__init__.py'
2025-06-01T07:37:09,706   adding 'deepspeed/inference/v2/modules/ds_module.py'
2025-06-01T07:37:09,708   adding 'deepspeed/inference/v2/modules/heuristics.py'
2025-06-01T07:37:09,709   adding 'deepspeed/inference/v2/modules/module_registry.py'
2025-06-01T07:37:09,711   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2025-06-01T07:37:09,713   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2025-06-01T07:37:09,714   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2025-06-01T07:37:09,715   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2025-06-01T07:37:09,717   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2025-06-01T07:37:09,718   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2025-06-01T07:37:09,719   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2025-06-01T07:37:09,721   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2025-06-01T07:37:09,723   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2025-06-01T07:37:09,725   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2025-06-01T07:37:09,727   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2025-06-01T07:37:09,728   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2025-06-01T07:37:09,730   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2025-06-01T07:37:09,731   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2025-06-01T07:37:09,733   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2025-06-01T07:37:09,735   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2025-06-01T07:37:09,737   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2025-06-01T07:37:09,739   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2025-06-01T07:37:09,740   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2025-06-01T07:37:09,742   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2025-06-01T07:37:09,743   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2025-06-01T07:37:09,745   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2025-06-01T07:37:09,746   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2025-06-01T07:37:09,748   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2025-06-01T07:37:09,750   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2025-06-01T07:37:09,751   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2025-06-01T07:37:09,753   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2025-06-01T07:37:09,754   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2025-06-01T07:37:09,755   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2025-06-01T07:37:09,757   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2025-06-01T07:37:09,758   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2025-06-01T07:37:09,759   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2025-06-01T07:37:09,761   adding 'deepspeed/inference/v2/ragged/__init__.py'
2025-06-01T07:37:09,763   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2025-06-01T07:37:09,765   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2025-06-01T07:37:09,766   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2025-06-01T07:37:09,768   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2025-06-01T07:37:09,770   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2025-06-01T07:37:09,772   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2025-06-01T07:37:09,774   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2025-06-01T07:37:09,775   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2025-06-01T07:37:09,777   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2025-06-01T07:37:09,779   adding 'deepspeed/io/__init__.py'
2025-06-01T07:37:09,781   adding 'deepspeed/io/base_file_writer.py'
2025-06-01T07:37:09,782   adding 'deepspeed/io/base_io_buffer.py'
2025-06-01T07:37:09,783   adding 'deepspeed/io/constants.py'
2025-06-01T07:37:09,785   adding 'deepspeed/io/double_io_buffer.py'
2025-06-01T07:37:09,786   adding 'deepspeed/io/fast_file_writer.py'
2025-06-01T07:37:09,788   adding 'deepspeed/io/mock_file_writer.py'
2025-06-01T07:37:09,789   adding 'deepspeed/io/py_file_writer.py'
2025-06-01T07:37:09,790   adding 'deepspeed/io/single_io_buffer.py'
2025-06-01T07:37:09,792   adding 'deepspeed/io/utils.py'
2025-06-01T07:37:09,794   adding 'deepspeed/launcher/__init__.py'
2025-06-01T07:37:09,795   adding 'deepspeed/launcher/constants.py'
2025-06-01T07:37:09,797   adding 'deepspeed/launcher/launch.py'
2025-06-01T07:37:09,799   adding 'deepspeed/launcher/launcher_helper.py'
2025-06-01T07:37:09,801   adding 'deepspeed/launcher/multinode_runner.py'
2025-06-01T07:37:09,805   adding 'deepspeed/launcher/runner.py'
2025-06-01T07:37:09,807   adding 'deepspeed/linear/__init__.py'
2025-06-01T07:37:09,808   adding 'deepspeed/linear/config.py'
2025-06-01T07:37:09,810   adding 'deepspeed/linear/context_manager.py'
2025-06-01T07:37:09,812   adding 'deepspeed/linear/optimized_linear.py'
2025-06-01T07:37:09,813   adding 'deepspeed/linear/quantization.py'
2025-06-01T07:37:09,815   adding 'deepspeed/model_implementations/__init__.py'
2025-06-01T07:37:09,817   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2025-06-01T07:37:09,818   adding 'deepspeed/model_implementations/diffusers/unet.py'
2025-06-01T07:37:09,820   adding 'deepspeed/model_implementations/diffusers/vae.py'
2025-06-01T07:37:09,822   adding 'deepspeed/model_implementations/features/__init__.py'
2025-06-01T07:37:09,823   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2025-06-01T07:37:09,825   adding 'deepspeed/model_implementations/transformers/__init__.py'
2025-06-01T07:37:09,826   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2025-06-01T07:37:09,828   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2025-06-01T07:37:09,829   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2025-06-01T07:37:09,830   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2025-06-01T07:37:09,832   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2025-06-01T07:37:09,833   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2025-06-01T07:37:09,834   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2025-06-01T07:37:09,835   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2025-06-01T07:37:09,837   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2025-06-01T07:37:09,839   adding 'deepspeed/module_inject/__init__.py'
2025-06-01T07:37:09,842   adding 'deepspeed/module_inject/auto_tp.py'
2025-06-01T07:37:09,844   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2025-06-01T07:37:09,845   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2025-06-01T07:37:09,847   adding 'deepspeed/module_inject/inject.py'
2025-06-01T07:37:09,851   adding 'deepspeed/module_inject/layers.py'
2025-06-01T07:37:09,853   adding 'deepspeed/module_inject/load_checkpoint.py'
2025-06-01T07:37:09,854   adding 'deepspeed/module_inject/module_quantize.py'
2025-06-01T07:37:09,856   adding 'deepspeed/module_inject/policy.py'
2025-06-01T07:37:09,861   adding 'deepspeed/module_inject/replace_module.py'
2025-06-01T07:37:09,862   adding 'deepspeed/module_inject/replace_policy.py'
2025-06-01T07:37:09,864   adding 'deepspeed/module_inject/tp_shard.py'
2025-06-01T07:37:09,865   adding 'deepspeed/module_inject/utils.py'
2025-06-01T07:37:09,867   adding 'deepspeed/module_inject/containers/__init__.py'
2025-06-01T07:37:09,869   adding 'deepspeed/module_inject/containers/base.py'
2025-06-01T07:37:09,870   adding 'deepspeed/module_inject/containers/base_moe.py'
2025-06-01T07:37:09,872   adding 'deepspeed/module_inject/containers/bert.py'
2025-06-01T07:37:09,873   adding 'deepspeed/module_inject/containers/bloom.py'
2025-06-01T07:37:09,875   adding 'deepspeed/module_inject/containers/clip.py'
2025-06-01T07:37:09,876   adding 'deepspeed/module_inject/containers/distil_bert.py'
2025-06-01T07:37:09,877   adding 'deepspeed/module_inject/containers/gpt2.py'
2025-06-01T07:37:09,879   adding 'deepspeed/module_inject/containers/gptj.py'
2025-06-01T07:37:09,880   adding 'deepspeed/module_inject/containers/gptneo.py'
2025-06-01T07:37:09,882   adding 'deepspeed/module_inject/containers/gptneox.py'
2025-06-01T07:37:09,884   adding 'deepspeed/module_inject/containers/internlm.py'
2025-06-01T07:37:09,885   adding 'deepspeed/module_inject/containers/llama.py'
2025-06-01T07:37:09,887   adding 'deepspeed/module_inject/containers/llama2.py'
2025-06-01T07:37:09,888   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2025-06-01T07:37:09,890   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2025-06-01T07:37:09,891   adding 'deepspeed/module_inject/containers/opt.py'
2025-06-01T07:37:09,893   adding 'deepspeed/module_inject/containers/unet.py'
2025-06-01T07:37:09,894   adding 'deepspeed/module_inject/containers/vae.py'
2025-06-01T07:37:09,896   adding 'deepspeed/module_inject/containers/features/__init__.py'
2025-06-01T07:37:09,898   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2025-06-01T07:37:09,899   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2025-06-01T07:37:09,901   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2025-06-01T07:37:09,902   adding 'deepspeed/module_inject/containers/features/megatron.py'
2025-06-01T07:37:09,904   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2025-06-01T07:37:09,905   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2025-06-01T07:37:09,907   adding 'deepspeed/moe/__init__.py'
2025-06-01T07:37:09,909   adding 'deepspeed/moe/experts.py'
2025-06-01T07:37:09,910   adding 'deepspeed/moe/layer.py'
2025-06-01T07:37:09,912   adding 'deepspeed/moe/mappings.py'
2025-06-01T07:37:09,915   adding 'deepspeed/moe/sharded_moe.py'
2025-06-01T07:37:09,917   adding 'deepspeed/moe/utils.py'
2025-06-01T07:37:09,919   adding 'deepspeed/monitor/__init__.py'
2025-06-01T07:37:09,921   adding 'deepspeed/monitor/comet.py'
2025-06-01T07:37:09,922   adding 'deepspeed/monitor/config.py'
2025-06-01T07:37:09,924   adding 'deepspeed/monitor/csv_monitor.py'
2025-06-01T07:37:09,925   adding 'deepspeed/monitor/monitor.py'
2025-06-01T07:37:09,926   adding 'deepspeed/monitor/tensorboard.py'
2025-06-01T07:37:09,927   adding 'deepspeed/monitor/utils.py'
2025-06-01T07:37:09,929   adding 'deepspeed/monitor/wandb.py'
2025-06-01T07:37:09,930   adding 'deepspeed/nebula/__init__.py'
2025-06-01T07:37:09,932   adding 'deepspeed/nebula/config.py'
2025-06-01T07:37:09,933   adding 'deepspeed/nebula/constants.py'
2025-06-01T07:37:09,935   adding 'deepspeed/nvme/__init__.py'
2025-06-01T07:37:09,937   adding 'deepspeed/nvme/ds_aio_args.py'
2025-06-01T07:37:09,938   adding 'deepspeed/nvme/ds_aio_basic.py'
2025-06-01T07:37:09,939   adding 'deepspeed/nvme/ds_aio_constants.py'
2025-06-01T07:37:09,941   adding 'deepspeed/nvme/ds_aio_handle.py'
2025-06-01T07:37:09,942   adding 'deepspeed/nvme/ds_aio_job.py'
2025-06-01T07:37:09,944   adding 'deepspeed/nvme/io_engine.py'
2025-06-01T07:37:09,945   adding 'deepspeed/nvme/parse_nvme_stats.py'
2025-06-01T07:37:09,947   adding 'deepspeed/nvme/perf_generate_param.py'
2025-06-01T07:37:09,949   adding 'deepspeed/nvme/perf_run_sweep.py'
2025-06-01T07:37:09,950   adding 'deepspeed/nvme/perf_sweep_utils.py'
2025-06-01T07:37:09,951   adding 'deepspeed/nvme/test_ds_aio.py'
2025-06-01T07:37:09,953   adding 'deepspeed/nvme/test_ds_aio_utils.py'
2025-06-01T07:37:09,954   adding 'deepspeed/nvme/torch_fastio_engine.py'
2025-06-01T07:37:09,955   adding 'deepspeed/nvme/torch_io.py'
2025-06-01T07:37:09,957   adding 'deepspeed/nvme/validate_async_io.py'
2025-06-01T07:37:09,958   adding 'deepspeed/ops/__init__.py'
2025-06-01T07:37:09,960   adding 'deepspeed/ops/adagrad/__init__.py'
2025-06-01T07:37:09,962   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2025-06-01T07:37:09,964   adding 'deepspeed/ops/adam/__init__.py'
2025-06-01T07:37:09,965   adding 'deepspeed/ops/adam/cpu_adam.py'
2025-06-01T07:37:09,967   adding 'deepspeed/ops/adam/fused_adam.py'
2025-06-01T07:37:09,969   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2025-06-01T07:37:09,970   adding 'deepspeed/ops/aio/__init__.py'
2025-06-01T07:37:09,972   adding 'deepspeed/ops/compile/__init__.py'
2025-06-01T07:37:09,975   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2025-06-01T07:37:09,976   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2025-06-01T07:37:09,978   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2025-06-01T07:37:09,979   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2025-06-01T07:37:09,981   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2025-06-01T07:37:09,983   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2025-06-01T07:37:09,986   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2025-06-01T07:37:09,988   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2025-06-01T07:37:09,989   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2025-06-01T07:37:09,990   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2025-06-01T07:37:09,992   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2025-06-01T07:37:09,993   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2025-06-01T07:37:09,995   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2025-06-01T07:37:09,996   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2025-06-01T07:37:09,998   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2025-06-01T07:37:09,999   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2025-06-01T07:37:10,001   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2025-06-01T07:37:10,002   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2025-06-01T07:37:10,004   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2025-06-01T07:37:10,005   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2025-06-01T07:37:10,006   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2025-06-01T07:37:10,008   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2025-06-01T07:37:10,009   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2025-06-01T07:37:10,010   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2025-06-01T07:37:10,011   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2025-06-01T07:37:10,013   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2025-06-01T07:37:10,014   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2025-06-01T07:37:10,016   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2025-06-01T07:37:10,017   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2025-06-01T07:37:10,019   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2025-06-01T07:37:10,021   adding 'deepspeed/ops/csrc/compile/deepcompile.cpp'
2025-06-01T07:37:10,023   adding 'deepspeed/ops/csrc/compile/init.cpp'
2025-06-01T07:37:10,024   adding 'deepspeed/ops/csrc/compile/util.cpp'
2025-06-01T07:37:10,026   adding 'deepspeed/ops/csrc/compile/z1.cpp'
2025-06-01T07:37:10,027   adding 'deepspeed/ops/csrc/compile/z1.h'
2025-06-01T07:37:10,028   adding 'deepspeed/ops/csrc/compile/z2.cpp'
2025-06-01T07:37:10,030   adding 'deepspeed/ops/csrc/compile/z2.h'
2025-06-01T07:37:10,032   adding 'deepspeed/ops/csrc/compile/z3.cpp'
2025-06-01T07:37:10,033   adding 'deepspeed/ops/csrc/compile/z3.h'
2025-06-01T07:37:10,036   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2025-06-01T07:37:10,038   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2025-06-01T07:37:10,042   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2025-06-01T07:37:10,043   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2025-06-01T07:37:10,045   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2025-06-01T07:37:10,047   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2025-06-01T07:37:10,049   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2025-06-01T07:37:10,051   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2025-06-01T07:37:10,053   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2025-06-01T07:37:10,054   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2025-06-01T07:37:10,063   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2025-06-01T07:37:10,069   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2025-06-01T07:37:10,071   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2025-06-01T07:37:10,074   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2025-06-01T07:37:10,076   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2025-06-01T07:37:10,077   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2025-06-01T07:37:10,080   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2025-06-01T07:37:10,081   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2025-06-01T07:37:10,084   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2025-06-01T07:37:10,087   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2025-06-01T07:37:10,089   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2025-06-01T07:37:10,091   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2025-06-01T07:37:10,099   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2025-06-01T07:37:10,102   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2025-06-01T07:37:10,104   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2025-06-01T07:37:10,108   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2025-06-01T07:37:10,112   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2025-06-01T07:37:10,116   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2025-06-01T07:37:10,117   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2025-06-01T07:37:10,119   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2025-06-01T07:37:10,121   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2025-06-01T07:37:10,123   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2025-06-01T07:37:10,125   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2025-06-01T07:37:10,127   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2025-06-01T07:37:10,129   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2025-06-01T07:37:10,130   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2025-06-01T07:37:10,133   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2025-06-01T07:37:10,134   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2025-06-01T07:37:10,136   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2025-06-01T07:37:10,137   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2025-06-01T07:37:10,138   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2025-06-01T07:37:10,140   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2025-06-01T07:37:10,142   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2025-06-01T07:37:10,144   adding 'deepspeed/ops/csrc/includes/Timer.h'
2025-06-01T07:37:10,145   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2025-06-01T07:37:10,146   adding 'deepspeed/ops/csrc/includes/compat.h'
2025-06-01T07:37:10,148   adding 'deepspeed/ops/csrc/includes/context.h'
2025-06-01T07:37:10,149   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2025-06-01T07:37:10,151   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2025-06-01T07:37:10,153   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2025-06-01T07:37:10,154   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2025-06-01T07:37:10,156   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2025-06-01T07:37:10,158   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2025-06-01T07:37:10,160   adding 'deepspeed/ops/csrc/includes/deepcompile.h'
2025-06-01T07:37:10,162   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2025-06-01T07:37:10,164   adding 'deepspeed/ops/csrc/includes/dropout.h'
2025-06-01T07:37:10,165   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2025-06-01T07:37:10,167   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2025-06-01T07:37:10,168   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2025-06-01T07:37:10,169   adding 'deepspeed/ops/csrc/includes/gelu.h'
2025-06-01T07:37:10,171   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2025-06-01T07:37:10,172   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2025-06-01T07:37:10,175   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2025-06-01T07:37:10,177   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2025-06-01T07:37:10,178   adding 'deepspeed/ops/csrc/includes/quantization.h'
2025-06-01T07:37:10,180   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2025-06-01T07:37:10,182   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2025-06-01T07:37:10,185   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2025-06-01T07:37:10,187   adding 'deepspeed/ops/csrc/includes/simd.h'
2025-06-01T07:37:10,188   adding 'deepspeed/ops/csrc/includes/softmax.h'
2025-06-01T07:37:10,190   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2025-06-01T07:37:10,191   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2025-06-01T07:37:10,193   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2025-06-01T07:37:10,196   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2025-06-01T07:37:10,198   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2025-06-01T07:37:10,199   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2025-06-01T07:37:10,201   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2025-06-01T07:37:10,202   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2025-06-01T07:37:10,204   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2025-06-01T07:37:10,206   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2025-06-01T07:37:10,209   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2025-06-01T07:37:10,211   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2025-06-01T07:37:10,213   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2025-06-01T07:37:10,215   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2025-06-01T07:37:10,216   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2025-06-01T07:37:10,219   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2025-06-01T07:37:10,221   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2025-06-01T07:37:10,222   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2025-06-01T07:37:10,224   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2025-06-01T07:37:10,225   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2025-06-01T07:37:10,227   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2025-06-01T07:37:10,230   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2025-06-01T07:37:10,231   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2025-06-01T07:37:10,233   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2025-06-01T07:37:10,235   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2025-06-01T07:37:10,238   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2025-06-01T07:37:10,242   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2025-06-01T07:37:10,244   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2025-06-01T07:37:10,246   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2025-06-01T07:37:10,250   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2025-06-01T07:37:10,253   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2025-06-01T07:37:10,256   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2025-06-01T07:37:10,258   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2025-06-01T07:37:10,260   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2025-06-01T07:37:10,263   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2025-06-01T07:37:10,265   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2025-06-01T07:37:10,267   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2025-06-01T07:37:10,273   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2025-06-01T07:37:10,275   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2025-06-01T07:37:10,277   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2025-06-01T07:37:10,279   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2025-06-01T07:37:10,282   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2025-06-01T07:37:10,285   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2025-06-01T07:37:10,287   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2025-06-01T07:37:10,289   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2025-06-01T07:37:10,291   adding 'deepspeed/ops/csrc/utils/py_ds_utils.cpp'
2025-06-01T07:37:10,292   adding 'deepspeed/ops/csrc/utils/tensor_cast.cpp'
2025-06-01T07:37:10,293   adding 'deepspeed/ops/csrc/utils/tensor_cast.h'
2025-06-01T07:37:10,296   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2025-06-01T07:37:10,297   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2025-06-01T07:37:10,299   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2025-06-01T07:37:10,301   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2025-06-01T07:37:10,303   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2025-06-01T07:37:10,305   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2025-06-01T07:37:10,306   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2025-06-01T07:37:10,308   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2025-06-01T07:37:10,309   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2025-06-01T07:37:10,311   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2025-06-01T07:37:10,313   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2025-06-01T07:37:10,315   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2025-06-01T07:37:10,316   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2025-06-01T07:37:10,318   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2025-06-01T07:37:10,319   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2025-06-01T07:37:10,321   adding 'deepspeed/ops/fp_quantizer/fp8_gemm_triton.py'
2025-06-01T07:37:10,323   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2025-06-01T07:37:10,324   adding 'deepspeed/ops/gds/__init__.py'
2025-06-01T07:37:10,326   adding 'deepspeed/ops/lamb/__init__.py'
2025-06-01T07:37:10,328   adding 'deepspeed/ops/lamb/fused_lamb.py'
2025-06-01T07:37:10,330   adding 'deepspeed/ops/lion/__init__.py'
2025-06-01T07:37:10,331   adding 'deepspeed/ops/lion/cpu_lion.py'
2025-06-01T07:37:10,333   adding 'deepspeed/ops/lion/fused_lion.py'
2025-06-01T07:37:10,334   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2025-06-01T07:37:10,336   adding 'deepspeed/ops/op_builder/__init__.py'
2025-06-01T07:37:10,338   adding 'deepspeed/ops/op_builder/all_ops.py'
2025-06-01T07:37:10,339   adding 'deepspeed/ops/op_builder/async_io.py'
2025-06-01T07:37:10,343   adding 'deepspeed/ops/op_builder/builder.py'
2025-06-01T07:37:10,345   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2025-06-01T07:37:10,346   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2025-06-01T07:37:10,347   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2025-06-01T07:37:10,349   adding 'deepspeed/ops/op_builder/dc.py'
2025-06-01T07:37:10,350   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2025-06-01T07:37:10,351   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2025-06-01T07:37:10,353   adding 'deepspeed/ops/op_builder/fused_adam.py'
2025-06-01T07:37:10,354   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2025-06-01T07:37:10,355   adding 'deepspeed/ops/op_builder/fused_lion.py'
2025-06-01T07:37:10,357   adding 'deepspeed/ops/op_builder/gds.py'
2025-06-01T07:37:10,358   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2025-06-01T07:37:10,359   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2025-06-01T07:37:10,361   adding 'deepspeed/ops/op_builder/quantizer.py'
2025-06-01T07:37:10,362   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2025-06-01T07:37:10,364   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2025-06-01T07:37:10,365   adding 'deepspeed/ops/op_builder/random_ltd.py'
2025-06-01T07:37:10,367   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2025-06-01T07:37:10,368   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2025-06-01T07:37:10,370   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2025-06-01T07:37:10,371   adding 'deepspeed/ops/op_builder/transformer.py'
2025-06-01T07:37:10,373   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2025-06-01T07:37:10,374   adding 'deepspeed/ops/op_builder/utils.py'
2025-06-01T07:37:10,376   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2025-06-01T07:37:10,378   adding 'deepspeed/ops/op_builder/cpu/async_io.py'
2025-06-01T07:37:10,379   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2025-06-01T07:37:10,381   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2025-06-01T07:37:10,382   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2025-06-01T07:37:10,384   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2025-06-01T07:37:10,385   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2025-06-01T07:37:10,387   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2025-06-01T07:37:10,388   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2025-06-01T07:37:10,390   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2025-06-01T07:37:10,391   adding 'deepspeed/ops/op_builder/hpu/fp_quantizer.py'
2025-06-01T07:37:10,393   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2025-06-01T07:37:10,394   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2025-06-01T07:37:10,395   adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py'
2025-06-01T07:37:10,397   adding 'deepspeed/ops/op_builder/mlu/__init__.py'
2025-06-01T07:37:10,399   adding 'deepspeed/ops/op_builder/mlu/builder.py'
2025-06-01T07:37:10,400   adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py'
2025-06-01T07:37:10,401   adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py'
2025-06-01T07:37:10,402   adding 'deepspeed/ops/op_builder/mlu/fused_adam.py'
2025-06-01T07:37:10,403   adding 'deepspeed/ops/op_builder/mlu/no_impl.py'
2025-06-01T07:37:10,405   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2025-06-01T07:37:10,407   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2025-06-01T07:37:10,408   adding 'deepspeed/ops/op_builder/npu/builder.py'
2025-06-01T07:37:10,409   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2025-06-01T07:37:10,410   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2025-06-01T07:37:10,412   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2025-06-01T07:37:10,413   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2025-06-01T07:37:10,415   adding 'deepspeed/ops/op_builder/npu/inference.py'
2025-06-01T07:37:10,416   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2025-06-01T07:37:10,418   adding 'deepspeed/ops/op_builder/sdaa/__init__.py'
2025-06-01T07:37:10,419   adding 'deepspeed/ops/op_builder/sdaa/builder.py'
2025-06-01T07:37:10,421   adding 'deepspeed/ops/op_builder/sdaa/cpu_adam.py'
2025-06-01T07:37:10,422   adding 'deepspeed/ops/op_builder/sdaa/fused_adam.py'
2025-06-01T07:37:10,424   adding 'deepspeed/ops/op_builder/sdaa/no_impl.py'
2025-06-01T07:37:10,425   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2025-06-01T07:37:10,427   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2025-06-01T07:37:10,428   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2025-06-01T07:37:10,430   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2025-06-01T07:37:10,431   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2025-06-01T07:37:10,432   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2025-06-01T07:37:10,434   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2025-06-01T07:37:10,435   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2025-06-01T07:37:10,436   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2025-06-01T07:37:10,438   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2025-06-01T07:37:10,439   adding 'deepspeed/ops/quantizer/__init__.py'
2025-06-01T07:37:10,441   adding 'deepspeed/ops/quantizer/quantizer.py'
2025-06-01T07:37:10,442   adding 'deepspeed/ops/random_ltd/__init__.py'
2025-06-01T07:37:10,444   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2025-06-01T07:37:10,446   adding 'deepspeed/ops/sparse_attention/__init__.py'
2025-06-01T07:37:10,447   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2025-06-01T07:37:10,452   adding 'deepspeed/ops/sparse_attention/matmul.py'
2025-06-01T07:37:10,454   adding 'deepspeed/ops/sparse_attention/softmax.py'
2025-06-01T07:37:10,456   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2025-06-01T07:37:10,458   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2025-06-01T07:37:10,461   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2025-06-01T07:37:10,463   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2025-06-01T07:37:10,465   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2025-06-01T07:37:10,466   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2025-06-01T07:37:10,468   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2025-06-01T07:37:10,470   adding 'deepspeed/ops/transformer/__init__.py'
2025-06-01T07:37:10,473   adding 'deepspeed/ops/transformer/transformer.py'
2025-06-01T07:37:10,474   adding 'deepspeed/ops/transformer/inference/__init__.py'
2025-06-01T07:37:10,476   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2025-06-01T07:37:10,477   adding 'deepspeed/ops/transformer/inference/config.py'
2025-06-01T07:37:10,479   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2025-06-01T07:37:10,481   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2025-06-01T07:37:10,482   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2025-06-01T07:37:10,484   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2025-06-01T07:37:10,486   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2025-06-01T07:37:10,488   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2025-06-01T07:37:10,490   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2025-06-01T07:37:10,492   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2025-06-01T07:37:10,493   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2025-06-01T07:37:10,495   adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py'
2025-06-01T07:37:10,496   adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py'
2025-06-01T07:37:10,497   adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py'
2025-06-01T07:37:10,499   adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py'
2025-06-01T07:37:10,500   adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py'
2025-06-01T07:37:10,501   adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py'
2025-06-01T07:37:10,502   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2025-06-01T07:37:10,504   adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py'
2025-06-01T07:37:10,505   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2025-06-01T07:37:10,506   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2025-06-01T07:37:10,508   adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py'
2025-06-01T07:37:10,509   adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py'
2025-06-01T07:37:10,510   adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py'
2025-06-01T07:37:10,512   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2025-06-01T07:37:10,513   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2025-06-01T07:37:10,514   adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py'
2025-06-01T07:37:10,516   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2025-06-01T07:37:10,517   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2025-06-01T07:37:10,519   adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py'
2025-06-01T07:37:10,520   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2025-06-01T07:37:10,522   adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py'
2025-06-01T07:37:10,524   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2025-06-01T07:37:10,526   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2025-06-01T07:37:10,528   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2025-06-01T07:37:10,529   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2025-06-01T07:37:10,532   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2025-06-01T07:37:10,533   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2025-06-01T07:37:10,535   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2025-06-01T07:37:10,536   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2025-06-01T07:37:10,538   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2025-06-01T07:37:10,540   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2025-06-01T07:37:10,542   adding 'deepspeed/pipe/__init__.py'
2025-06-01T07:37:10,543   adding 'deepspeed/profiling/__init__.py'
2025-06-01T07:37:10,545   adding 'deepspeed/profiling/config.py'
2025-06-01T07:37:10,546   adding 'deepspeed/profiling/constants.py'
2025-06-01T07:37:10,548   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2025-06-01T07:37:10,554   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2025-06-01T07:37:10,556   adding 'deepspeed/runtime/__init__.py'
2025-06-01T07:37:10,558   adding 'deepspeed/runtime/base_optimizer.py'
2025-06-01T07:37:10,561   adding 'deepspeed/runtime/bf16_optimizer.py'
2025-06-01T07:37:10,562   adding 'deepspeed/runtime/compiler.py'
2025-06-01T07:37:10,566   adding 'deepspeed/runtime/config.py'
2025-06-01T07:37:10,569   adding 'deepspeed/runtime/config_utils.py'
2025-06-01T07:37:10,571   adding 'deepspeed/runtime/constants.py'
2025-06-01T07:37:10,573   adding 'deepspeed/runtime/dataloader.py'
2025-06-01T07:37:10,574   adding 'deepspeed/runtime/eigenvalue.py'
2025-06-01T07:37:10,596   adding 'deepspeed/runtime/engine.py'
2025-06-01T07:37:10,600   adding 'deepspeed/runtime/hybrid_engine.py'
2025-06-01T07:37:10,604   adding 'deepspeed/runtime/lr_schedules.py'
2025-06-01T07:37:10,606   adding 'deepspeed/runtime/precision_config.py'
2025-06-01T07:37:10,607   adding 'deepspeed/runtime/progressive_layer_drop.py'
2025-06-01T07:37:10,609   adding 'deepspeed/runtime/quantize.py'
2025-06-01T07:37:10,610   adding 'deepspeed/runtime/sparse_tensor.py'
2025-06-01T07:37:10,612   adding 'deepspeed/runtime/state_dict_factory.py'
2025-06-01T07:37:10,614   adding 'deepspeed/runtime/torch_autocast.py'
2025-06-01T07:37:10,619   adding 'deepspeed/runtime/utils.py'
2025-06-01T07:37:10,621   adding 'deepspeed/runtime/weight_quantizer.py'
2025-06-01T07:37:10,623   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2025-06-01T07:37:10,628   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2025-06-01T07:37:10,630   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2025-06-01T07:37:10,632   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2025-06-01T07:37:10,633   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2025-06-01T07:37:10,635   adding 'deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py'
2025-06-01T07:37:10,636   adding 'deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py'
2025-06-01T07:37:10,638   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2025-06-01T07:37:10,639   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2025-06-01T07:37:10,641   adding 'deepspeed/runtime/checkpoint_engine/utils.py'
2025-06-01T07:37:10,642   adding 'deepspeed/runtime/comm/__init__.py'
2025-06-01T07:37:10,644   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2025-06-01T07:37:10,646   adding 'deepspeed/runtime/comm/compressed.py'
2025-06-01T07:37:10,648   adding 'deepspeed/runtime/comm/hccl.py'
2025-06-01T07:37:10,649   adding 'deepspeed/runtime/comm/mpi.py'
2025-06-01T07:37:10,651   adding 'deepspeed/runtime/comm/nccl.py'
2025-06-01T07:37:10,653   adding 'deepspeed/runtime/compression/__init__.py'
2025-06-01T07:37:10,654   adding 'deepspeed/runtime/compression/cupy.py'
2025-06-01T07:37:10,656   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2025-06-01T07:37:10,657   adding 'deepspeed/runtime/data_pipeline/config.py'
2025-06-01T07:37:10,659   adding 'deepspeed/runtime/data_pipeline/constants.py'
2025-06-01T07:37:10,661   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2025-06-01T07:37:10,662   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2025-06-01T07:37:10,664   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2025-06-01T07:37:10,665   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2025-06-01T07:37:10,667   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2025-06-01T07:37:10,668   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2025-06-01T07:37:10,670   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2025-06-01T07:37:10,676   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2025-06-01T07:37:10,678   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2025-06-01T07:37:10,681   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2025-06-01T07:37:10,683   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2025-06-01T07:37:10,686   adding 'deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py'
2025-06-01T07:37:10,688   adding 'deepspeed/runtime/domino/__init__.py'
2025-06-01T07:37:10,689   adding 'deepspeed/runtime/domino/async_linear.py'
2025-06-01T07:37:10,692   adding 'deepspeed/runtime/domino/transformer.py'
2025-06-01T07:37:10,694   adding 'deepspeed/runtime/fp16/__init__.py'
2025-06-01T07:37:10,696   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2025-06-01T07:37:10,699   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2025-06-01T07:37:10,701   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2025-06-01T07:37:10,703   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2025-06-01T07:37:10,705   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2025-06-01T07:37:10,708   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2025-06-01T07:37:10,711   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2025-06-01T07:37:10,712   adding 'deepspeed/runtime/model_checkpointing/__init__.py'
2025-06-01T07:37:10,714   adding 'deepspeed/runtime/model_checkpointing/config.py'
2025-06-01T07:37:10,715   adding 'deepspeed/runtime/model_checkpointing/constants.py'
2025-06-01T07:37:10,717   adding 'deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py'
2025-06-01T07:37:10,718   adding 'deepspeed/runtime/model_checkpointing/utils.py'
2025-06-01T07:37:10,720   adding 'deepspeed/runtime/model_checkpointing/writer_factory.py'
2025-06-01T07:37:10,722   adding 'deepspeed/runtime/pipe/__init__.py'
2025-06-01T07:37:10,729   adding 'deepspeed/runtime/pipe/engine.py'
2025-06-01T07:37:10,733   adding 'deepspeed/runtime/pipe/module.py'
2025-06-01T07:37:10,735   adding 'deepspeed/runtime/pipe/p2p.py'
2025-06-01T07:37:10,737   adding 'deepspeed/runtime/pipe/schedule.py'
2025-06-01T07:37:10,740   adding 'deepspeed/runtime/pipe/topology.py'
2025-06-01T07:37:10,741   adding 'deepspeed/runtime/sequence_parallel/__init__.py'
2025-06-01T07:37:10,743   adding 'deepspeed/runtime/sequence_parallel/parallel_state_sp.py'
2025-06-01T07:37:10,750   adding 'deepspeed/runtime/sequence_parallel/ulysses_sp.py'
2025-06-01T07:37:10,752   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2025-06-01T07:37:10,753   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2025-06-01T07:37:10,755   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2025-06-01T07:37:10,756   adding 'deepspeed/runtime/swap_tensor/constants.py'
2025-06-01T07:37:10,759   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2025-06-01T07:37:10,761   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2025-06-01T07:37:10,763   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2025-06-01T07:37:10,765   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2025-06-01T07:37:10,767   adding 'deepspeed/runtime/swap_tensor/utils.py'
2025-06-01T07:37:10,769   adding 'deepspeed/runtime/tensor_parallel/__init__.py'
2025-06-01T07:37:10,770   adding 'deepspeed/runtime/tensor_parallel/config.py'
2025-06-01T07:37:10,772   adding 'deepspeed/runtime/tensor_parallel/tp_manager.py'
2025-06-01T07:37:10,774   adding 'deepspeed/runtime/zero/__init__.py'
2025-06-01T07:37:10,776   adding 'deepspeed/runtime/zero/config.py'
2025-06-01T07:37:10,778   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2025-06-01T07:37:10,780   adding 'deepspeed/runtime/zero/linear.py'
2025-06-01T07:37:10,783   adding 'deepspeed/runtime/zero/mics.py'
2025-06-01T07:37:10,785   adding 'deepspeed/runtime/zero/mics_utils.py'
2025-06-01T07:37:10,786   adding 'deepspeed/runtime/zero/offload_config.py'
2025-06-01T07:37:10,788   adding 'deepspeed/runtime/zero/offload_states.py'
2025-06-01T07:37:10,791   adding 'deepspeed/runtime/zero/parameter_offload.py'
2025-06-01T07:37:10,805   adding 'deepspeed/runtime/zero/partition_parameters.py'
2025-06-01T07:37:10,809   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2025-06-01T07:37:10,811   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2025-06-01T07:37:10,827   adding 'deepspeed/runtime/zero/stage3.py'
2025-06-01T07:37:10,843   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2025-06-01T07:37:10,845   adding 'deepspeed/runtime/zero/test.py'
2025-06-01T07:37:10,847   adding 'deepspeed/runtime/zero/tiling.py'
2025-06-01T07:37:10,848   adding 'deepspeed/runtime/zero/utils.py'
2025-06-01T07:37:10,850   adding 'deepspeed/sequence/__init__.py'
2025-06-01T07:37:10,851   adding 'deepspeed/sequence/cross_entropy.py'
2025-06-01T07:37:10,856   adding 'deepspeed/sequence/fpdt_layer.py'
2025-06-01T07:37:10,859   adding 'deepspeed/sequence/layer.py'
2025-06-01T07:37:10,860   adding 'deepspeed/utils/__init__.py'
2025-06-01T07:37:10,862   adding 'deepspeed/utils/bwc.py'
2025-06-01T07:37:10,863   adding 'deepspeed/utils/comms_logging.py'
2025-06-01T07:37:10,865   adding 'deepspeed/utils/config.py'
2025-06-01T07:37:10,866   adding 'deepspeed/utils/debug.py'
2025-06-01T07:37:10,867   adding 'deepspeed/utils/exceptions.py'
2025-06-01T07:37:10,870   adding 'deepspeed/utils/groups.py'
2025-06-01T07:37:10,872   adding 'deepspeed/utils/init_on_device.py'
2025-06-01T07:37:10,873   adding 'deepspeed/utils/logging.py'
2025-06-01T07:37:10,875   adding 'deepspeed/utils/mixed_precision_linkage.py'
2025-06-01T07:37:10,876   adding 'deepspeed/utils/numa.py'
2025-06-01T07:37:10,877   adding 'deepspeed/utils/nvtx.py'
2025-06-01T07:37:10,880   adding 'deepspeed/utils/tensor_fragment.py'
2025-06-01T07:37:10,882   adding 'deepspeed/utils/timer.py'
2025-06-01T07:37:10,883   adding 'deepspeed/utils/torch.py'
2025-06-01T07:37:10,884   adding 'deepspeed/utils/types.py'
2025-06-01T07:37:10,886   adding 'deepspeed/utils/z3_leaf_module.py'
2025-06-01T07:37:10,889   adding 'deepspeed/utils/zero_to_fp32.py'
2025-06-01T07:37:10,892   adding 'deepspeed-0.17.2.data/scripts/deepspeed'
2025-06-01T07:37:10,893   adding 'deepspeed-0.17.2.data/scripts/deepspeed.pt'
2025-06-01T07:37:10,894   adding 'deepspeed-0.17.2.data/scripts/ds'
2025-06-01T07:37:10,895   adding 'deepspeed-0.17.2.data/scripts/ds_bench'
2025-06-01T07:37:10,897   adding 'deepspeed-0.17.2.data/scripts/ds_elastic'
2025-06-01T07:37:10,898   adding 'deepspeed-0.17.2.data/scripts/ds_io'
2025-06-01T07:37:10,899   adding 'deepspeed-0.17.2.data/scripts/ds_nvme_tune'
2025-06-01T07:37:10,900   adding 'deepspeed-0.17.2.data/scripts/ds_report'
2025-06-01T07:37:10,902   adding 'deepspeed-0.17.2.data/scripts/ds_ssh'
2025-06-01T07:37:10,903   adding 'deepspeed-0.17.2.data/scripts/dsr'
2025-06-01T07:37:10,906   adding 'deepspeed-0.17.2.dist-info/licenses/LICENSE'
2025-06-01T07:37:10,911   adding 'deepspeed-0.17.2.dist-info/METADATA'
2025-06-01T07:37:10,913   adding 'deepspeed-0.17.2.dist-info/WHEEL'
2025-06-01T07:37:10,914   adding 'deepspeed-0.17.2.dist-info/entry_points.txt'
2025-06-01T07:37:10,915   adding 'deepspeed-0.17.2.dist-info/top_level.txt'
2025-06-01T07:37:10,933   adding 'deepspeed-0.17.2.dist-info/RECORD'
2025-06-01T07:37:10,967   removing build/bdist.linux-armv7l/wheel
2025-06-01T07:37:11,255   deepspeed build time = 14.210031270980835 secs
2025-06-01T07:37:11,383   Building wheel for deepspeed (setup.py): finished with status 'done'
2025-06-01T07:37:11,406   Created wheel for deepspeed: filename=deepspeed-0.17.2-py3-none-any.whl size=1699841 sha256=009db2687461691ee6dd5edfc2ed43c0196c6413460b1975e27cba0386a9057e
2025-06-01T07:37:11,408   Stored in directory: /tmp/pip-ephem-wheel-cache-tkgv8vqd/wheels/9b/f1/3d/2854f784c6d04f0450ba02a8fe19399e2fbad4fd6c4758e525
2025-06-01T07:37:11,456 Successfully built deepspeed
2025-06-01T07:37:11,505 Removed build tracker: '/tmp/pip-build-tracker-46libh5f'