2025-06-10T04:16:37,611 Created temporary directory: /tmp/pip-build-tracker-f4lzw6lh
2025-06-10T04:16:37,612 Initialized build tracking at /tmp/pip-build-tracker-f4lzw6lh
2025-06-10T04:16:37,613 Created build tracker: /tmp/pip-build-tracker-f4lzw6lh
2025-06-10T04:16:37,613 Entered build tracker: /tmp/pip-build-tracker-f4lzw6lh
2025-06-10T04:16:37,614 Created temporary directory: /tmp/pip-wheel-hlllc2wm
2025-06-10T04:16:37,618 Created temporary directory: /tmp/pip-ephem-wheel-cache-6f4sv_77
2025-06-10T04:16:37,671 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2025-06-10T04:16:37,674 2 location(s) to search for versions of deepspeed:
2025-06-10T04:16:37,674 * https://pypi.org/simple/deepspeed/
2025-06-10T04:16:37,674 * https://www.piwheels.org/simple/deepspeed/
2025-06-10T04:16:37,674 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2025-06-10T04:16:37,675 Getting page https://pypi.org/simple/deepspeed/
2025-06-10T04:16:37,677 Found index url https://pypi.org/simple/
2025-06-10T04:16:37,907 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2025-06-10T04:16:37,921   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-10T04:16:37,922   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2025-06-10T04:16:37,923   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-10T04:16:37,923   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2025-06-10T04:16:37,924   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-10T04:16:37,925   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2025-06-10T04:16:37,926   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-10T04:16:37,926   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2025-06-10T04:16:37,927   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-10T04:16:37,928   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2025-06-10T04:16:37,929   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2025-06-10T04:16:37,929   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2025-06-10T04:16:37,930   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2025-06-10T04:16:37,931   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2025-06-10T04:16:37,932   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2025-06-10T04:16:37,932   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2025-06-10T04:16:37,933   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2025-06-10T04:16:37,934   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2025-06-10T04:16:37,934   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2025-06-10T04:16:37,935   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2025-06-10T04:16:37,936   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2025-06-10T04:16:37,936   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2025-06-10T04:16:37,937   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2025-06-10T04:16:37,938   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2025-06-10T04:16:37,938   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2025-06-10T04:16:37,939   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2025-06-10T04:16:37,940   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2025-06-10T04:16:37,941   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2025-06-10T04:16:37,941   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2025-06-10T04:16:37,942   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2025-06-10T04:16:37,943   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2025-06-10T04:16:37,944   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2025-06-10T04:16:37,945   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2025-06-10T04:16:37,945   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2025-06-10T04:16:37,946   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2025-06-10T04:16:37,946   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2025-06-10T04:16:37,947   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2025-06-10T04:16:37,947   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2025-06-10T04:16:37,948   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2025-06-10T04:16:37,949   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2025-06-10T04:16:37,950   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2025-06-10T04:16:37,950   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2025-06-10T04:16:37,951   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2025-06-10T04:16:37,952   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2025-06-10T04:16:37,953   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2025-06-10T04:16:37,953   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2025-06-10T04:16:37,954   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2025-06-10T04:16:37,955   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2025-06-10T04:16:37,956   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2025-06-10T04:16:37,957   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2025-06-10T04:16:37,958   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2025-06-10T04:16:37,958   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2025-06-10T04:16:37,959   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2025-06-10T04:16:37,960   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2025-06-10T04:16:37,960   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2025-06-10T04:16:37,961   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2025-06-10T04:16:37,961   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2025-06-10T04:16:37,962   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2025-06-10T04:16:37,963   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2025-06-10T04:16:37,964   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2025-06-10T04:16:37,964   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2025-06-10T04:16:37,965   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2025-06-10T04:16:37,966   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2025-06-10T04:16:37,967   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2025-06-10T04:16:37,967   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2025-06-10T04:16:37,968   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2025-06-10T04:16:37,969   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2025-06-10T04:16:37,970   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2025-06-10T04:16:37,971   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2025-06-10T04:16:37,971   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2025-06-10T04:16:37,972   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2025-06-10T04:16:37,972   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2025-06-10T04:16:37,973   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2025-06-10T04:16:37,973   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2025-06-10T04:16:37,974   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2025-06-10T04:16:37,975   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2025-06-10T04:16:37,975   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2025-06-10T04:16:37,976   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2025-06-10T04:16:37,977   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2025-06-10T04:16:37,978   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2025-06-10T04:16:37,978   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2025-06-10T04:16:37,979   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2025-06-10T04:16:37,980   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2025-06-10T04:16:37,980   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2025-06-10T04:16:37,981   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2025-06-10T04:16:37,982   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2025-06-10T04:16:37,983   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2025-06-10T04:16:37,984   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2025-06-10T04:16:37,984   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2025-06-10T04:16:37,985   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2025-06-10T04:16:37,985   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2025-06-10T04:16:37,986   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2025-06-10T04:16:37,987   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2025-06-10T04:16:37,987   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2025-06-10T04:16:37,988   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2025-06-10T04:16:37,988   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2025-06-10T04:16:37,989   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-10T04:16:37,990   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2025-06-10T04:16:37,991   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-10T04:16:37,991   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2025-06-10T04:16:37,992   Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1
2025-06-10T04:16:37,993   Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2
2025-06-10T04:16:37,993   Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3
2025-06-10T04:16:37,994   Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4
2025-06-10T04:16:37,995   Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0
2025-06-10T04:16:37,996   Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1
2025-06-10T04:16:37,996   Found link https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.2
2025-06-10T04:16:37,997   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/52/23/cfe2166f06f1817b73b8695addd2fded55f4189322bcf181cfb7feaba550/deepspeed-0.16.3-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-10T04:16:37,997   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/ce/92/853de2a32b3f9c0945e0c9e145eddac98e570c1faebcd58aa85e6dcd89ba/deepspeed-0.16.3-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-10T04:16:37,998   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/55/8f/57ee424e114478a667c604b2f3f05bbc1addc0afc089b9ab6a64b233063d/deepspeed-0.16.3-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-10T04:16:37,998   Found link https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.3
2025-06-10T04:16:37,999   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/3d/65/1a6394f5d6dee851e9ea59e385f6d6428e3bfe36f83c06e0336e14dcfd11/deepspeed-0.16.4-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-10T04:16:38,000   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a3/aa/bb67b63cc25c5e29e4ca3f8b155e0faf74d5a33acf2ec67e249206a36b0f/deepspeed-0.16.4-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-10T04:16:38,000   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d4/59/fd251661b78b049eed7ee46f0d8d51c69ae7fbb710716a1ebcc796a6b0fd/deepspeed-0.16.4-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-10T04:16:38,001   Found link https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.4
2025-06-10T04:16:38,002   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/15/b0/be6cc74fd1e23da20d6c34db923858a8ae5017d39a13dedc188a935c646a/deepspeed-0.16.5-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-10T04:16:38,002   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/0b/78/9a87d137f83f53dd57f425ac174723c746c53029bf6cdce22eb9e805e3f0/deepspeed-0.16.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-10T04:16:38,003   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/80/f8/a9b1fca237fe8ea25f866956778280d0b735350f29fb6f4e0b548aa02a5f/deepspeed-0.16.5-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-10T04:16:38,004   Found link https://files.pythonhosted.org/packages/0d/88/96569b2acb3219c9c72068f9b952c59beffe366e7d1edd9e922e5c68f08b/deepspeed-0.16.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.5
2025-06-10T04:16:38,004   Found link https://files.pythonhosted.org/packages/cb/a3/1d758fcbcdb3f5ecf4e71907e293f17bae8a9f448b112e65c6195e90c2d3/deepspeed-0.16.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.6
2025-06-10T04:16:38,005   Found link https://files.pythonhosted.org/packages/06/b3/a3903de5c5b707170c5c27e1a40f4ef613f14d241bd84d8b151a2a8786f6/deepspeed-0.16.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.7
2025-06-10T04:16:38,006   Found link https://files.pythonhosted.org/packages/e1/27/f857569546dc97f64169df1cc35d1ec5161766c4a0ec32f2af5d39614a51/deepspeed-0.16.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.8
2025-06-10T04:16:38,007   Found link https://files.pythonhosted.org/packages/4f/5c/7542904cddfaa50a9a7ae6770349d468773359f5af1718865452cea8729d/deepspeed-0.16.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.9
2025-06-10T04:16:38,007   Found link https://files.pythonhosted.org/packages/1e/35/eef570f4da4a39d0e7f2e72757295fdba3718a8eca60d8d6dcfeb9e6f26d/deepspeed-0.17.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.0
2025-06-10T04:16:38,008   Found link https://files.pythonhosted.org/packages/38/10/a7f63e086c1e1c12e290c98363c748ef5ddd6313fde739d2aeccd5ed0cd4/deepspeed-0.17.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.1
2025-06-10T04:16:38,008   Found link https://files.pythonhosted.org/packages/8c/45/1ddcf8f8500d90fad9f3396bfb1295462d46a747ddcbfafcd7714d46827e/deepspeed-0.17.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.2
2025-06-10T04:16:38,009   Found link https://files.pythonhosted.org/packages/9e/6b/89faa30a38405cd2d7a81790b262673ca4c8e8ec97c2f8c433da04d7a002/deepspeed-0.17.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.3
2025-06-10T04:16:38,010   Found link https://files.pythonhosted.org/packages/84/b3/02d000bfd0d6f0ba3f5dac487e4151b3e9b4b3ee71336882102dc9ad79ad/deepspeed-0.17.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.4
2025-06-10T04:16:38,010 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2025-06-10T04:16:38,011 Getting page https://www.piwheels.org/simple/deepspeed/
2025-06-10T04:16:38,013 Found index url https://www.piwheels.org/simple/
2025-06-10T04:16:38,180 WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-10T04:16:38,837 WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-10T04:16:40,011 WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-10T04:16:42,167 WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-10T04:16:46,332 WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-10T04:16:46,499 Could not fetch URL https://www.piwheels.org/simple/deepspeed/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='www.piwheels.org', port=443): Max retries exceeded with url: /simple/deepspeed/ (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))) - skipping
2025-06-10T04:16:46,500 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2025-06-10T04:16:46,501 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2025-06-10T04:16:46,531 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2025-06-10T04:16:46,533 Collecting deepspeed==0.17.0
2025-06-10T04:16:46,536   Created temporary directory: /tmp/pip-unpack-zn7i2yj5
2025-06-10T04:16:46,765   Downloading deepspeed-0.17.0.tar.gz (1.5 MB)
2025-06-10T04:16:49,362   Added deepspeed==0.17.0 from https://files.pythonhosted.org/packages/1e/35/eef570f4da4a39d0e7f2e72757295fdba3718a8eca60d8d6dcfeb9e6f26d/deepspeed-0.17.0.tar.gz to build tracker '/tmp/pip-build-tracker-f4lzw6lh'
2025-06-10T04:16:49,365   Running setup.py (path:/tmp/pip-wheel-hlllc2wm/deepspeed_65dc1e3e98764689bf3a557809c728bc/setup.py) egg_info for package deepspeed
2025-06-10T04:16:49,365   Created temporary directory: /tmp/pip-pip-egg-info-_8vzvfyw
2025-06-10T04:16:49,366   Preparing metadata (setup.py): started
2025-06-10T04:16:49,367   Running command python setup.py egg_info
2025-06-10T04:16:50,427   fatal: not a git repository (or any of the parent directories): .git
2025-06-10T04:16:50,908   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-06-10T04:16:50,909    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-06-10T04:16:50,909   DS_BUILD_OPS=0
2025-06-10T04:16:50,910   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-06-10T04:16:50,910   version=0.17.0, git_hash=unknown, git_branch=unknown
2025-06-10T04:16:50,911   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-06-10T04:16:50,912   ext_modules=[]
2025-06-10T04:16:50,912   running egg_info
2025-06-10T04:16:50,938   creating /tmp/pip-pip-egg-info-_8vzvfyw/deepspeed.egg-info
2025-06-10T04:16:50,939   writing /tmp/pip-pip-egg-info-_8vzvfyw/deepspeed.egg-info/PKG-INFO
2025-06-10T04:16:50,976   writing dependency_links to /tmp/pip-pip-egg-info-_8vzvfyw/deepspeed.egg-info/dependency_links.txt
2025-06-10T04:16:50,978   writing entry points to /tmp/pip-pip-egg-info-_8vzvfyw/deepspeed.egg-info/entry_points.txt
2025-06-10T04:16:50,998   writing requirements to /tmp/pip-pip-egg-info-_8vzvfyw/deepspeed.egg-info/requires.txt
2025-06-10T04:16:51,000   writing top-level names to /tmp/pip-pip-egg-info-_8vzvfyw/deepspeed.egg-info/top_level.txt
2025-06-10T04:16:51,001   writing manifest file '/tmp/pip-pip-egg-info-_8vzvfyw/deepspeed.egg-info/SOURCES.txt'
2025-06-10T04:16:51,269   reading manifest file '/tmp/pip-pip-egg-info-_8vzvfyw/deepspeed.egg-info/SOURCES.txt'
2025-06-10T04:16:51,271   reading manifest template 'MANIFEST.in'
2025-06-10T04:16:51,273   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-06-10T04:16:51,274   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-06-10T04:16:53,144   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-06-10T04:16:54,201   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-06-10T04:16:54,906   warning: no files found matching '*.tr' under directory 'csrc'
2025-06-10T04:16:55,039   warning: no files found matching '*.cc' under directory 'csrc'
2025-06-10T04:16:55,093   warning: no files found matching '*.py' under directory 'benchmarks'
2025-06-10T04:16:55,100   adding license file 'LICENSE'
2025-06-10T04:16:55,141   writing manifest file '/tmp/pip-pip-egg-info-_8vzvfyw/deepspeed.egg-info/SOURCES.txt'
2025-06-10T04:16:55,144   deepspeed build time = 4.71325945854187 secs
2025-06-10T04:16:55,267   Preparing metadata (setup.py): finished with status 'done'
2025-06-10T04:16:55,274   Source in /tmp/pip-wheel-hlllc2wm/deepspeed_65dc1e3e98764689bf3a557809c728bc has version 0.17.0, which satisfies requirement deepspeed==0.17.0 from https://files.pythonhosted.org/packages/1e/35/eef570f4da4a39d0e7f2e72757295fdba3718a8eca60d8d6dcfeb9e6f26d/deepspeed-0.17.0.tar.gz
2025-06-10T04:16:55,275   Removed deepspeed==0.17.0 from https://files.pythonhosted.org/packages/1e/35/eef570f4da4a39d0e7f2e72757295fdba3718a8eca60d8d6dcfeb9e6f26d/deepspeed-0.17.0.tar.gz from build tracker '/tmp/pip-build-tracker-f4lzw6lh'
2025-06-10T04:16:55,351 Created temporary directory: /tmp/pip-unpack-6fxmpy7y
2025-06-10T04:16:55,352 Created temporary directory: /tmp/pip-unpack-z05vmq06
2025-06-10T04:16:55,353 Building wheels for collected packages: deepspeed
2025-06-10T04:16:55,357   Created temporary directory: /tmp/pip-wheel-nm_qnhmg
2025-06-10T04:16:55,358   DEPRECATION: Building 'deepspeed' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'deepspeed'. Discussion can be found at https://github.com/pypa/pip/issues/6334
2025-06-10T04:16:55,359   Building wheel for deepspeed (setup.py): started
2025-06-10T04:16:55,360   Destination directory: /tmp/pip-wheel-nm_qnhmg
2025-06-10T04:16:55,361   Running command python setup.py bdist_wheel
2025-06-10T04:16:55,863   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-06-10T04:16:55,867    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-06-10T04:16:56,001   DS_BUILD_OPS=0
2025-06-10T04:16:56,120   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-06-10T04:16:56,141   fatal: not a git repository (or any of the parent directories): .git
2025-06-10T04:16:56,142   version=0.17.0, git_hash=unknown, git_branch=unknown
2025-06-10T04:16:56,143   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-06-10T04:16:56,144   ext_modules=[]
2025-06-10T04:16:56,557   running bdist_wheel
2025-06-10T04:16:56,693   running build
2025-06-10T04:16:56,693   running build_py
2025-06-10T04:16:56,724   creating build/lib/deepspeed
2025-06-10T04:16:56,726   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2025-06-10T04:16:56,728   copying deepspeed/constants.py -> build/lib/deepspeed
2025-06-10T04:16:56,730   copying deepspeed/env_report.py -> build/lib/deepspeed
2025-06-10T04:16:56,733   copying deepspeed/__init__.py -> build/lib/deepspeed
2025-06-10T04:16:56,735   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2025-06-10T04:16:56,738   creating build/lib/deepspeed/inference
2025-06-10T04:16:56,739   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2025-06-10T04:16:56,742   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2025-06-10T04:16:56,743   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2025-06-10T04:16:56,746   creating build/lib/deepspeed/launcher
2025-06-10T04:16:56,747   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2025-06-10T04:16:56,750   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2025-06-10T04:16:56,753   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2025-06-10T04:16:56,755   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2025-06-10T04:16:56,757   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2025-06-10T04:16:56,760   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2025-06-10T04:16:56,762   creating build/lib/deepspeed/autotuning
2025-06-10T04:16:56,763   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2025-06-10T04:16:56,765   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2025-06-10T04:16:56,769   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2025-06-10T04:16:56,771   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2025-06-10T04:16:56,772   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2025-06-10T04:16:56,775   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2025-06-10T04:16:56,778   creating build/lib/deepspeed/moe
2025-06-10T04:16:56,779   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2025-06-10T04:16:56,781   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2025-06-10T04:16:56,783   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2025-06-10T04:16:56,786   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2025-06-10T04:16:56,787   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2025-06-10T04:16:56,789   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2025-06-10T04:16:56,792   creating build/lib/deepspeed/elasticity
2025-06-10T04:16:56,793   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2025-06-10T04:16:56,795   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2025-06-10T04:16:56,798   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2025-06-10T04:16:56,799   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2025-06-10T04:16:56,801   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2025-06-10T04:16:56,804   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2025-06-10T04:16:56,807   creating build/lib/deepspeed/nvme
2025-06-10T04:16:56,808   copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme
2025-06-10T04:16:56,810   copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme
2025-06-10T04:16:56,812   copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme
2025-06-10T04:16:56,814   copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme
2025-06-10T04:16:56,816   copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme
2025-06-10T04:16:56,818   copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme
2025-06-10T04:16:56,820   copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme
2025-06-10T04:16:56,822   copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme
2025-06-10T04:16:56,824   copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme
2025-06-10T04:16:56,826   copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme
2025-06-10T04:16:56,828   copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme
2025-06-10T04:16:56,831   copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme
2025-06-10T04:16:56,833   creating build/lib/deepspeed/accelerator
2025-06-10T04:16:56,835   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-10T04:16:56,837   copying deepspeed/accelerator/sdaa_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-10T04:16:56,840   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-10T04:16:56,842   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-10T04:16:56,845   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-10T04:16:56,847   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-10T04:16:56,849   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-10T04:16:56,852   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2025-06-10T04:16:56,854   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-10T04:16:56,856   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-10T04:16:56,858   copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-10T04:16:56,862   creating build/lib/deepspeed/runtime
2025-06-10T04:16:56,863   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,866   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,868   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,870   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,872   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,885   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,887   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,890   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,892   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,896   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,900   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,904   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,907   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,911   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,913   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,915   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,918   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,920   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2025-06-10T04:16:56,923   creating build/lib/deepspeed/ops
2025-06-10T04:16:56,924   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2025-06-10T04:16:56,927   creating build/lib/deepspeed/module_inject
2025-06-10T04:16:56,928   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2025-06-10T04:16:56,930   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2025-06-10T04:16:56,932   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2025-06-10T04:16:56,934   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2025-06-10T04:16:56,937   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2025-06-10T04:16:56,940   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2025-06-10T04:16:56,943   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2025-06-10T04:16:56,945   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2025-06-10T04:16:56,947   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2025-06-10T04:16:56,950   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2025-06-10T04:16:56,952   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2025-06-10T04:16:56,955   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2025-06-10T04:16:56,958   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2025-06-10T04:16:56,961   creating build/lib/deepspeed/utils
2025-06-10T04:16:56,962   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2025-06-10T04:16:56,964   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2025-06-10T04:16:56,967   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2025-06-10T04:16:56,969   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2025-06-10T04:16:56,972   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2025-06-10T04:16:56,974   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2025-06-10T04:16:56,977   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2025-06-10T04:16:56,979   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2025-06-10T04:16:56,982   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2025-06-10T04:16:56,985   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2025-06-10T04:16:56,988   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2025-06-10T04:16:56,990   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2025-06-10T04:16:56,994   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2025-06-10T04:16:56,997   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2025-06-10T04:16:56,999   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2025-06-10T04:16:57,001   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2025-06-10T04:16:57,004   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2025-06-10T04:16:57,006   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2025-06-10T04:16:57,009   creating build/lib/deepspeed/checkpoint
2025-06-10T04:16:57,010   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2025-06-10T04:16:57,012   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2025-06-10T04:16:57,014   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-10T04:16:57,017   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2025-06-10T04:16:57,019   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2025-06-10T04:16:57,021   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2025-06-10T04:16:57,023   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-10T04:16:57,025   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-10T04:16:57,028   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2025-06-10T04:16:57,030   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2025-06-10T04:16:57,033   creating build/lib/deepspeed/compile
2025-06-10T04:16:57,035   copying deepspeed/compile/init_z1.py -> build/lib/deepspeed/compile
2025-06-10T04:16:57,037   copying deepspeed/compile/backend.py -> build/lib/deepspeed/compile
2025-06-10T04:16:57,039   copying deepspeed/compile/util.py -> build/lib/deepspeed/compile
2025-06-10T04:16:57,042   copying deepspeed/compile/graph_param.py -> build/lib/deepspeed/compile
2025-06-10T04:16:57,044   copying deepspeed/compile/patch_compiled_func.py -> build/lib/deepspeed/compile
2025-06-10T04:16:57,046   copying deepspeed/compile/__init__.py -> build/lib/deepspeed/compile
2025-06-10T04:16:57,047   copying deepspeed/compile/config.py -> build/lib/deepspeed/compile
2025-06-10T04:16:57,049   copying deepspeed/compile/inductor.py -> build/lib/deepspeed/compile
2025-06-10T04:16:57,052   copying deepspeed/compile/list_schedule.py -> build/lib/deepspeed/compile
2025-06-10T04:16:57,054   copying deepspeed/compile/patch_fake_tensor.py -> build/lib/deepspeed/compile
2025-06-10T04:16:57,056   copying deepspeed/compile/init_z3.py -> build/lib/deepspeed/compile
2025-06-10T04:16:57,058   copying deepspeed/compile/partitioner.py -> build/lib/deepspeed/compile
2025-06-10T04:16:57,060   copying deepspeed/compile/fx.py -> build/lib/deepspeed/compile
2025-06-10T04:16:57,063   creating build/lib/deepspeed/compression
2025-06-10T04:16:57,065   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2025-06-10T04:16:57,067   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2025-06-10T04:16:57,069   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2025-06-10T04:16:57,072   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2025-06-10T04:16:57,074   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2025-06-10T04:16:57,076   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2025-06-10T04:16:57,078   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2025-06-10T04:16:57,081   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2025-06-10T04:16:57,084   creating build/lib/deepspeed/monitor
2025-06-10T04:16:57,085   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2025-06-10T04:16:57,087   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2025-06-10T04:16:57,089   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2025-06-10T04:16:57,091   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2025-06-10T04:16:57,093   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2025-06-10T04:16:57,094   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2025-06-10T04:16:57,096   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2025-06-10T04:16:57,099   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2025-06-10T04:16:57,101   creating build/lib/deepspeed/linear
2025-06-10T04:16:57,102   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2025-06-10T04:16:57,105   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2025-06-10T04:16:57,107   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2025-06-10T04:16:57,109   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2025-06-10T04:16:57,111   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2025-06-10T04:16:57,113   creating build/lib/deepspeed/model_implementations
2025-06-10T04:16:57,114   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2025-06-10T04:16:57,117   creating build/lib/deepspeed/profiling
2025-06-10T04:16:57,118   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2025-06-10T04:16:57,120   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2025-06-10T04:16:57,121   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2025-06-10T04:16:57,124   creating build/lib/deepspeed/nebula
2025-06-10T04:16:57,125   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2025-06-10T04:16:57,127   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2025-06-10T04:16:57,129   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2025-06-10T04:16:57,131   creating build/lib/deepspeed/pipe
2025-06-10T04:16:57,132   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2025-06-10T04:16:57,135   creating build/lib/deepspeed/sequence
2025-06-10T04:16:57,136   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2025-06-10T04:16:57,138   copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence
2025-06-10T04:16:57,141   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2025-06-10T04:16:57,144   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2025-06-10T04:16:57,146   creating build/lib/deepspeed/comm
2025-06-10T04:16:57,147   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2025-06-10T04:16:57,150   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2025-06-10T04:16:57,152   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2025-06-10T04:16:57,154   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2025-06-10T04:16:57,157   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2025-06-10T04:16:57,159   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2025-06-10T04:16:57,161   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2025-06-10T04:16:57,162   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2025-06-10T04:16:57,165   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2025-06-10T04:16:57,167   creating build/lib/deepspeed/inference/v2
2025-06-10T04:16:57,168   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2025-06-10T04:16:57,170   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2025-06-10T04:16:57,172   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2025-06-10T04:16:57,175   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2025-06-10T04:16:57,176   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2025-06-10T04:16:57,179   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2025-06-10T04:16:57,180   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2025-06-10T04:16:57,182   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2025-06-10T04:16:57,184   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2025-06-10T04:16:57,186   creating build/lib/deepspeed/inference/quantization
2025-06-10T04:16:57,187   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2025-06-10T04:16:57,190   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2025-06-10T04:16:57,192   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2025-06-10T04:16:57,195   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2025-06-10T04:16:57,197   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2025-06-10T04:16:57,199   creating build/lib/deepspeed/inference/v2/modules
2025-06-10T04:16:57,200   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2025-06-10T04:16:57,202   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2025-06-10T04:16:57,204   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2025-06-10T04:16:57,206   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2025-06-10T04:16:57,209   creating build/lib/deepspeed/inference/v2/checkpoint
2025-06-10T04:16:57,210   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-10T04:16:57,212   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-10T04:16:57,214   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-10T04:16:57,216   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-10T04:16:57,218   creating build/lib/deepspeed/inference/v2/kernels
2025-06-10T04:16:57,219   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2025-06-10T04:16:57,221   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2025-06-10T04:16:57,224   creating build/lib/deepspeed/inference/v2/model_implementations
2025-06-10T04:16:57,225   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-10T04:16:57,228   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-10T04:16:57,230   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-10T04:16:57,233   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-10T04:16:57,235   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-10T04:16:57,237   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-10T04:16:57,239   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-10T04:16:57,242   creating build/lib/deepspeed/inference/v2/ragged
2025-06-10T04:16:57,243   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-10T04:16:57,246   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-10T04:16:57,248   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-10T04:16:57,250   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-10T04:16:57,252   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-10T04:16:57,254   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-10T04:16:57,257   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-10T04:16:57,260   creating build/lib/deepspeed/inference/v2/modules/implementations
2025-06-10T04:16:57,261   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2025-06-10T04:16:57,263   creating build/lib/deepspeed/inference/v2/modules/configs
2025-06-10T04:16:57,264   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-10T04:16:57,267   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-10T04:16:57,269   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-10T04:16:57,271   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-10T04:16:57,273   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-10T04:16:57,275   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-10T04:16:57,277   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-10T04:16:57,279   creating build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-10T04:16:57,280   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-10T04:16:57,283   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-10T04:16:57,285   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-10T04:16:57,287   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-10T04:16:57,289   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-10T04:16:57,291   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-10T04:16:57,293   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-10T04:16:57,295   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-10T04:16:57,298   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-10T04:16:57,299   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-10T04:16:57,301   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-10T04:16:57,303   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-10T04:16:57,305   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-10T04:16:57,306   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-10T04:16:57,309   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-10T04:16:57,311   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-10T04:16:57,312   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-10T04:16:57,315   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-10T04:16:57,317   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-10T04:16:57,319   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-10T04:16:57,321   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-10T04:16:57,323   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-10T04:16:57,325   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-10T04:16:57,327   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-10T04:16:57,329   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-10T04:16:57,331   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-10T04:16:57,333   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-10T04:16:57,335   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-10T04:16:57,337   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-10T04:16:57,338   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-10T04:16:57,341   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-10T04:16:57,344   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-10T04:16:57,345   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-10T04:16:57,347   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-10T04:16:57,348   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-10T04:16:57,351   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-10T04:16:57,352   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-10T04:16:57,355   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-10T04:16:57,356   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-10T04:16:57,358   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-10T04:16:57,360   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-10T04:16:57,361   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-10T04:16:57,363   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-10T04:16:57,366   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-10T04:16:57,367   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-10T04:16:57,369   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-10T04:16:57,371   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-10T04:16:57,372   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-10T04:16:57,374   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-10T04:16:57,377   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-10T04:16:57,378   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-10T04:16:57,380   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-10T04:16:57,382   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-10T04:16:57,383   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-10T04:16:57,386   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-10T04:16:57,388   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:16:57,389   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:16:57,391   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:16:57,394   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:16:57,396   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:16:57,398   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-10T04:16:57,400   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-10T04:16:57,402   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-10T04:16:57,405   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-10T04:16:57,406   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-10T04:16:57,408   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-10T04:16:57,410   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-10T04:16:57,412   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-10T04:16:57,414   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:16:57,415   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:16:57,417   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:16:57,419   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:16:57,421   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:16:57,423   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:16:57,426   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-10T04:16:57,427   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-10T04:16:57,429   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-10T04:16:57,432   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-10T04:16:57,433   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-10T04:16:57,435   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-10T04:16:57,437   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-10T04:16:57,438   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-10T04:16:57,441   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-10T04:16:57,443   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-10T04:16:57,444   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-10T04:16:57,446   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-10T04:16:57,449   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-10T04:16:57,450   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-10T04:16:57,452   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-10T04:16:57,454   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-10T04:16:57,456   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-10T04:16:57,458   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-10T04:16:57,460   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-10T04:16:57,463   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-10T04:16:57,464   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-10T04:16:57,466   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-10T04:16:57,468   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-10T04:16:57,470   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-10T04:16:57,472   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-10T04:16:57,473   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-10T04:16:57,476   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-10T04:16:57,478   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-10T04:16:57,480   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-10T04:16:57,483   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-10T04:16:57,484   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-10T04:16:57,486   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-10T04:16:57,488   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-10T04:16:57,490   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-10T04:16:57,493   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-10T04:16:57,494   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-10T04:16:57,497   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-10T04:16:57,499   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-10T04:16:57,501   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-10T04:16:57,503   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-10T04:16:57,505   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-10T04:16:57,507   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-10T04:16:57,509   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-10T04:16:57,511   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-10T04:16:57,515   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:16:57,516   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:16:57,518   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:16:57,520   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:16:57,522   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:16:57,524   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:16:57,526   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:16:57,528   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:16:57,531   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:16:57,533   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:16:57,536   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-10T04:16:57,537   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-10T04:16:57,539   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-10T04:16:57,541   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-10T04:16:57,543   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-10T04:16:57,546   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:16:57,547   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:16:57,549   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:16:57,551   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:16:57,553   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:16:57,556   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:16:57,558   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:16:57,560   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:16:57,562   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:16:57,564   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:16:57,566   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-10T04:16:57,568   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-10T04:16:57,570   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-10T04:16:57,572   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-10T04:16:57,574   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-10T04:16:57,577   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-10T04:16:57,578   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-10T04:16:57,580   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-10T04:16:57,582   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-10T04:16:57,584   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-10T04:16:57,587   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-10T04:16:57,588   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-10T04:16:57,590   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-10T04:16:57,592   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-10T04:16:57,594   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-10T04:16:57,597   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-10T04:16:57,598   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-10T04:16:57,601   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-10T04:16:57,602   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-10T04:16:57,604   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-10T04:16:57,607   creating build/lib/deepspeed/autotuning/tuner
2025-06-10T04:16:57,608   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2025-06-10T04:16:57,610   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-10T04:16:57,612   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-10T04:16:57,615   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2025-06-10T04:16:57,617   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2025-06-10T04:16:57,618   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-10T04:16:57,621   creating build/lib/deepspeed/runtime/checkpoint_engine
2025-06-10T04:16:57,623   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-10T04:16:57,625   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-10T04:16:57,627   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-10T04:16:57,629   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-10T04:16:57,631   creating build/lib/deepspeed/runtime/fp16
2025-06-10T04:16:57,632   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-06-10T04:16:57,635   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2025-06-10T04:16:57,637   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2025-06-10T04:16:57,639   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-06-10T04:16:57,642   creating build/lib/deepspeed/runtime/sequence_parallel
2025-06-10T04:16:57,643   copying deepspeed/runtime/sequence_parallel/__init__.py -> build/lib/deepspeed/runtime/sequence_parallel
2025-06-10T04:16:57,645   copying deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/lib/deepspeed/runtime/sequence_parallel
2025-06-10T04:16:57,649   copying deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/lib/deepspeed/runtime/sequence_parallel
2025-06-10T04:16:57,652   creating build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,653   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,655   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,658   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,660   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,663   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,665   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,667   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,669   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,674   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,676   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,679   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,682   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,687   copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,689   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,694   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,697   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,699   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2025-06-10T04:16:57,701   creating build/lib/deepspeed/runtime/swap_tensor
2025-06-10T04:16:57,703   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-10T04:16:57,706   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-10T04:16:57,709   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-10T04:16:57,711   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-10T04:16:57,714   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-10T04:16:57,716   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-10T04:16:57,718   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-10T04:16:57,720   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-10T04:16:57,722   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-10T04:16:57,725   creating build/lib/deepspeed/runtime/domino
2025-06-10T04:16:57,726   copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino
2025-06-10T04:16:57,729   copying deepspeed/runtime/domino/async_linear.py -> build/lib/deepspeed/runtime/domino
2025-06-10T04:16:57,732   copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino
2025-06-10T04:16:57,734   creating build/lib/deepspeed/runtime/activation_checkpointing
2025-06-10T04:16:57,735   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-10T04:16:57,737   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-10T04:16:57,739   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-10T04:16:57,743   creating build/lib/deepspeed/runtime/data_pipeline
2025-06-10T04:16:57,744   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-10T04:16:57,747   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-10T04:16:57,749   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-10T04:16:57,751   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-10T04:16:57,754   creating build/lib/deepspeed/runtime/compression
2025-06-10T04:16:57,755   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2025-06-10T04:16:57,757   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2025-06-10T04:16:57,760   creating build/lib/deepspeed/runtime/pipe
2025-06-10T04:16:57,761   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2025-06-10T04:16:57,764   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2025-06-10T04:16:57,766   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2025-06-10T04:16:57,770   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2025-06-10T04:16:57,772   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2025-06-10T04:16:57,774   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2025-06-10T04:16:57,778   creating build/lib/deepspeed/runtime/tensor_parallel
2025-06-10T04:16:57,779   copying deepspeed/runtime/tensor_parallel/tp_manager.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-10T04:16:57,781   copying deepspeed/runtime/tensor_parallel/__init__.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-10T04:16:57,783   copying deepspeed/runtime/tensor_parallel/config.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-10T04:16:57,785   creating build/lib/deepspeed/runtime/comm
2025-06-10T04:16:57,787   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2025-06-10T04:16:57,789   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2025-06-10T04:16:57,792   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2025-06-10T04:16:57,794   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2025-06-10T04:16:57,797   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2025-06-10T04:16:57,799   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2025-06-10T04:16:57,802   creating build/lib/deepspeed/runtime/fp16/onebit
2025-06-10T04:16:57,803   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-10T04:16:57,806   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-10T04:16:57,808   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-10T04:16:57,810   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-10T04:16:57,813   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-10T04:16:57,815   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-10T04:16:57,817   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-10T04:16:57,818   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-10T04:16:57,820   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-10T04:16:57,823   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-10T04:16:57,826   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-10T04:16:57,827   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-10T04:16:57,829   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-10T04:16:57,832   copying deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-10T04:16:57,835   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-10T04:16:57,837   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-10T04:16:57,840   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-10T04:16:57,843   creating build/lib/deepspeed/ops/lamb
2025-06-10T04:16:57,844   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2025-06-10T04:16:57,846   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2025-06-10T04:16:57,849   creating build/lib/deepspeed/ops/deepspeed4science
2025-06-10T04:16:57,850   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2025-06-10T04:16:57,853   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2025-06-10T04:16:57,856   creating build/lib/deepspeed/ops/aio
2025-06-10T04:16:57,856   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2025-06-10T04:16:57,859   creating build/lib/deepspeed/ops/gds
2025-06-10T04:16:57,860   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2025-06-10T04:16:57,863   creating build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,865   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,867   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,869   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,871   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,873   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,876   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,877   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,879   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,882   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,884   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,886   copying deepspeed/ops/op_builder/dc.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,888   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,890   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,892   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,894   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,896   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,898   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,901   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,903   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,905   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,908   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,910   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,912   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,914   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,916   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2025-06-10T04:16:57,918   creating build/lib/deepspeed/ops/compile
2025-06-10T04:16:57,919   copying deepspeed/ops/compile/__init__.py -> build/lib/deepspeed/ops/compile
2025-06-10T04:16:57,922   creating build/lib/deepspeed/ops/random_ltd
2025-06-10T04:16:57,923   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2025-06-10T04:16:57,925   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2025-06-10T04:16:57,928   creating build/lib/deepspeed/ops/adam
2025-06-10T04:16:57,929   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2025-06-10T04:16:57,932   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2025-06-10T04:16:57,934   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2025-06-10T04:16:57,936   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2025-06-10T04:16:57,939   creating build/lib/deepspeed/ops/adagrad
2025-06-10T04:16:57,940   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2025-06-10T04:16:57,942   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2025-06-10T04:16:57,945   creating build/lib/deepspeed/ops/sparse_attention
2025-06-10T04:16:57,946   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-10T04:16:57,949   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-10T04:16:57,952   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-10T04:16:57,954   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-10T04:16:57,956   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-10T04:16:57,959   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-10T04:16:57,962   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-10T04:16:57,965   creating build/lib/deepspeed/ops/fp_quantizer
2025-06-10T04:16:57,966   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-10T04:16:57,968   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-10T04:16:57,970   copying deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-10T04:16:57,972   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-10T04:16:57,975   creating build/lib/deepspeed/ops/lion
2025-06-10T04:16:57,976   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2025-06-10T04:16:57,978   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2025-06-10T04:16:57,980   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2025-06-10T04:16:57,982   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2025-06-10T04:16:57,985   creating build/lib/deepspeed/ops/transformer
2025-06-10T04:16:57,986   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2025-06-10T04:16:57,989   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2025-06-10T04:16:57,991   creating build/lib/deepspeed/ops/quantizer
2025-06-10T04:16:57,992   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2025-06-10T04:16:57,994   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2025-06-10T04:16:57,997   creating build/lib/deepspeed/ops/op_builder/hpu
2025-06-10T04:16:57,998   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-10T04:16:58,000   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-10T04:16:58,002   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-10T04:16:58,004   copying deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-10T04:16:58,006   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-10T04:16:58,008   copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-10T04:16:58,010   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-10T04:16:58,013   creating build/lib/deepspeed/ops/op_builder/mlu
2025-06-10T04:16:58,014   copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-10T04:16:58,016   copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-10T04:16:58,018   copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-10T04:16:58,020   copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-10T04:16:58,023   copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-10T04:16:58,025   copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-10T04:16:58,028   creating build/lib/deepspeed/ops/op_builder/xpu
2025-06-10T04:16:58,029   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-10T04:16:58,031   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-10T04:16:58,033   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-10T04:16:58,035   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-10T04:16:58,037   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-10T04:16:58,040   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-10T04:16:58,041   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-10T04:16:58,043   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-10T04:16:58,046   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-10T04:16:58,048   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-10T04:16:58,050   creating build/lib/deepspeed/ops/op_builder/sdaa
2025-06-10T04:16:58,051   copying deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-10T04:16:58,054   copying deepspeed/ops/op_builder/sdaa/no_impl.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-10T04:16:58,055   copying deepspeed/ops/op_builder/sdaa/__init__.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-10T04:16:58,058   copying deepspeed/ops/op_builder/sdaa/builder.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-10T04:16:58,060   copying deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-10T04:16:58,062   creating build/lib/deepspeed/ops/op_builder/cpu
2025-06-10T04:16:58,063   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-10T04:16:58,066   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-10T04:16:58,068   copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-10T04:16:58,070   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-10T04:16:58,072   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-10T04:16:58,074   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-10T04:16:58,076   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-10T04:16:58,079   creating build/lib/deepspeed/ops/op_builder/npu
2025-06-10T04:16:58,080   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-10T04:16:58,082   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-10T04:16:58,084   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-10T04:16:58,086   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-10T04:16:58,089   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-10T04:16:58,091   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-10T04:16:58,093   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-10T04:16:58,095   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-10T04:16:58,097   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-10T04:16:58,100   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-10T04:16:58,101   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-10T04:16:58,104   creating build/lib/deepspeed/ops/transformer/inference
2025-06-10T04:16:58,105   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-10T04:16:58,108   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-10T04:16:58,110   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-10T04:16:58,113   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-10T04:16:58,115   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-10T04:16:58,117   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-10T04:16:58,120   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-10T04:16:58,122   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-10T04:16:58,124   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-10T04:16:58,126   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-10T04:16:58,130   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,132   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,134   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,137   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,140   copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,142   copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,144   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,146   copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,149   copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,151   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,153   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,155   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,157   copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,159   copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,161   copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,163   copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,165   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,168   copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,171   copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,174   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,176   copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,178   copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,180   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,183   copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:16:58,186   creating build/lib/deepspeed/ops/transformer/inference/triton
2025-06-10T04:16:58,187   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-10T04:16:58,190   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-10T04:16:58,192   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-10T04:16:58,195   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-10T04:16:58,197   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-10T04:16:58,199   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-10T04:16:58,201   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-10T04:16:58,204   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-10T04:16:58,206   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-10T04:16:58,209   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-10T04:16:58,212   creating build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,213   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,216   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,218   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,221   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,223   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,225   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,228   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,231   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,234   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,236   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,239   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,241   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,244   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,246   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,248   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,251   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,254   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,256   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,258   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2025-06-10T04:16:58,261   creating build/lib/deepspeed/module_inject/containers/features
2025-06-10T04:16:58,262   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-10T04:16:58,264   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-10T04:16:58,267   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-10T04:16:58,269   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-10T04:16:58,271   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-10T04:16:58,273   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-10T04:16:58,275   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-10T04:16:58,279   creating build/lib/deepspeed/compile/passes
2025-06-10T04:16:58,280   copying deepspeed/compile/passes/offload_adam_states.py -> build/lib/deepspeed/compile/passes
2025-06-10T04:16:58,283   copying deepspeed/compile/passes/offload_parameters.py -> build/lib/deepspeed/compile/passes
2025-06-10T04:16:58,285   copying deepspeed/compile/passes/zero1_compile.py -> build/lib/deepspeed/compile/passes
2025-06-10T04:16:58,287   copying deepspeed/compile/passes/__init__.py -> build/lib/deepspeed/compile/passes
2025-06-10T04:16:58,289   copying deepspeed/compile/passes/zero3_compile.py -> build/lib/deepspeed/compile/passes
2025-06-10T04:16:58,291   copying deepspeed/compile/passes/prefetch.py -> build/lib/deepspeed/compile/passes
2025-06-10T04:16:58,294   copying deepspeed/compile/passes/offload_activation.py -> build/lib/deepspeed/compile/passes
2025-06-10T04:16:58,296   copying deepspeed/compile/passes/selective_gather.py -> build/lib/deepspeed/compile/passes
2025-06-10T04:16:58,299   creating build/lib/deepspeed/compile/profilers
2025-06-10T04:16:58,300   copying deepspeed/compile/profilers/graph_profile.py -> build/lib/deepspeed/compile/profilers
2025-06-10T04:16:58,303   copying deepspeed/compile/profilers/comm_profile.py -> build/lib/deepspeed/compile/profilers
2025-06-10T04:16:58,305   copying deepspeed/compile/profilers/__init__.py -> build/lib/deepspeed/compile/profilers
2025-06-10T04:16:58,308   creating build/lib/deepspeed/model_implementations/transformers
2025-06-10T04:16:58,309   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-10T04:16:58,311   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-10T04:16:58,313   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-10T04:16:58,315   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-10T04:16:58,317   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-10T04:16:58,319   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-10T04:16:58,321   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-10T04:16:58,324   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-10T04:16:58,326   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-10T04:16:58,328   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-10T04:16:58,330   creating build/lib/deepspeed/model_implementations/diffusers
2025-06-10T04:16:58,331   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-10T04:16:58,333   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-10T04:16:58,335   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-10T04:16:58,338   creating build/lib/deepspeed/model_implementations/features
2025-06-10T04:16:58,339   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2025-06-10T04:16:58,341   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2025-06-10T04:16:58,343   creating build/lib/deepspeed/profiling/flops_profiler
2025-06-10T04:16:58,345   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2025-06-10T04:16:58,348   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2025-06-10T04:16:58,350   running egg_info
2025-06-10T04:16:58,379   writing deepspeed.egg-info/PKG-INFO
2025-06-10T04:16:58,414   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2025-06-10T04:16:58,415   writing entry points to deepspeed.egg-info/entry_points.txt
2025-06-10T04:16:58,435   writing requirements to deepspeed.egg-info/requires.txt
2025-06-10T04:16:58,437   writing top-level names to deepspeed.egg-info/top_level.txt
2025-06-10T04:16:58,581   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-06-10T04:16:58,670   reading manifest template 'MANIFEST.in'
2025-06-10T04:16:58,671   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-06-10T04:16:58,672   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-06-10T04:17:00,420   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-06-10T04:17:01,457   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-06-10T04:17:02,123   warning: no files found matching '*.tr' under directory 'csrc'
2025-06-10T04:17:02,251   warning: no files found matching '*.cc' under directory 'csrc'
2025-06-10T04:17:02,300   warning: no files found matching '*.py' under directory 'benchmarks'
2025-06-10T04:17:02,306   adding license file 'LICENSE'
2025-06-10T04:17:02,359   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-06-10T04:17:02,368   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2025-06-10T04:17:02,368   !!

2025-06-10T04:17:02,369           ********************************************************************************
2025-06-10T04:17:02,370           ############################
2025-06-10T04:17:02,371           # Package would be ignored #
2025-06-10T04:17:02,371           ############################
2025-06-10T04:17:02,372           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2025-06-10T04:17:02,373           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,374           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,374           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2025-06-10T04:17:02,375           to the `packages` configuration field.

2025-06-10T04:17:02,376           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,377           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,377           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,378           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,379           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,380           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2025-06-10T04:17:02,380           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2025-06-10T04:17:02,381           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,381           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,382           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,383           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,384           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,385           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,385                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,386                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,386                 directory, all directories are treated like packages.
2025-06-10T04:17:02,387           ********************************************************************************

2025-06-10T04:17:02,387   !!
2025-06-10T04:17:02,388     check.warn(importable)
2025-06-10T04:17:02,388   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2025-06-10T04:17:02,389   !!

2025-06-10T04:17:02,390           ********************************************************************************
2025-06-10T04:17:02,391           ############################
2025-06-10T04:17:02,391           # Package would be ignored #
2025-06-10T04:17:02,392           ############################
2025-06-10T04:17:02,392           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2025-06-10T04:17:02,393           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,394           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,394           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2025-06-10T04:17:02,395           to the `packages` configuration field.

2025-06-10T04:17:02,396           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,396           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,397           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,397           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,399           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,400           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2025-06-10T04:17:02,400           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2025-06-10T04:17:02,401           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,401           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,402           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,403           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,403           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,405           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,405                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,405                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,406                 directory, all directories are treated like packages.
2025-06-10T04:17:02,406           ********************************************************************************

2025-06-10T04:17:02,407   !!
2025-06-10T04:17:02,407     check.warn(importable)
2025-06-10T04:17:02,407   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2025-06-10T04:17:02,408   !!

2025-06-10T04:17:02,409           ********************************************************************************
2025-06-10T04:17:02,409           ############################
2025-06-10T04:17:02,409           # Package would be ignored #
2025-06-10T04:17:02,410           ############################
2025-06-10T04:17:02,410           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2025-06-10T04:17:02,411           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,412           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,412           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2025-06-10T04:17:02,413           to the `packages` configuration field.

2025-06-10T04:17:02,414           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,414           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,415           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,416           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,417           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,417           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2025-06-10T04:17:02,418           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2025-06-10T04:17:02,419           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,419           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,420           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,421           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,421           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,423           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,423                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,424                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,424                 directory, all directories are treated like packages.
2025-06-10T04:17:02,425           ********************************************************************************

2025-06-10T04:17:02,426   !!
2025-06-10T04:17:02,427     check.warn(importable)
2025-06-10T04:17:02,427   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2025-06-10T04:17:02,428   !!

2025-06-10T04:17:02,429           ********************************************************************************
2025-06-10T04:17:02,429           ############################
2025-06-10T04:17:02,429           # Package would be ignored #
2025-06-10T04:17:02,430           ############################
2025-06-10T04:17:02,430           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2025-06-10T04:17:02,431           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,431           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,432           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2025-06-10T04:17:02,432           to the `packages` configuration field.

2025-06-10T04:17:02,433           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,433           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,434           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,435           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,435           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,436           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2025-06-10T04:17:02,437           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2025-06-10T04:17:02,437           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,438           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,438           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,439           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,440           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,442           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,442                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,443                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,443                 directory, all directories are treated like packages.
2025-06-10T04:17:02,444           ********************************************************************************

2025-06-10T04:17:02,445   !!
2025-06-10T04:17:02,446     check.warn(importable)
2025-06-10T04:17:02,446   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2025-06-10T04:17:02,447   !!

2025-06-10T04:17:02,447           ********************************************************************************
2025-06-10T04:17:02,448           ############################
2025-06-10T04:17:02,448           # Package would be ignored #
2025-06-10T04:17:02,449           ############################
2025-06-10T04:17:02,449           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2025-06-10T04:17:02,450           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,451           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,451           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2025-06-10T04:17:02,452           to the `packages` configuration field.

2025-06-10T04:17:02,453           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,453           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,454           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,455           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,456           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,456           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2025-06-10T04:17:02,457           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2025-06-10T04:17:02,457           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,458           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,458           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,459           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,460           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,461           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,462                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,462                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,462                 directory, all directories are treated like packages.
2025-06-10T04:17:02,463           ********************************************************************************

2025-06-10T04:17:02,464   !!
2025-06-10T04:17:02,464     check.warn(importable)
2025-06-10T04:17:02,465   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2025-06-10T04:17:02,465   !!

2025-06-10T04:17:02,466           ********************************************************************************
2025-06-10T04:17:02,467           ############################
2025-06-10T04:17:02,467           # Package would be ignored #
2025-06-10T04:17:02,468           ############################
2025-06-10T04:17:02,468           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2025-06-10T04:17:02,469           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,470           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,470           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2025-06-10T04:17:02,471           to the `packages` configuration field.

2025-06-10T04:17:02,472           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,472           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,473           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,474           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,475           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,476           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2025-06-10T04:17:02,476           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2025-06-10T04:17:02,477           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,477           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,478           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,479           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,480           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,481           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,482                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,482                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,482                 directory, all directories are treated like packages.
2025-06-10T04:17:02,483           ********************************************************************************

2025-06-10T04:17:02,483   !!
2025-06-10T04:17:02,484     check.warn(importable)
2025-06-10T04:17:02,484   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2025-06-10T04:17:02,484   !!

2025-06-10T04:17:02,485           ********************************************************************************
2025-06-10T04:17:02,485           ############################
2025-06-10T04:17:02,486           # Package would be ignored #
2025-06-10T04:17:02,486           ############################
2025-06-10T04:17:02,486           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2025-06-10T04:17:02,487           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,488           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,488           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2025-06-10T04:17:02,488           to the `packages` configuration field.

2025-06-10T04:17:02,489           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,490           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,490           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,491           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,492           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,493           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2025-06-10T04:17:02,494           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2025-06-10T04:17:02,494           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,495           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,496           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,496           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,497           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,499           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,499                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,500                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,500                 directory, all directories are treated like packages.
2025-06-10T04:17:02,501           ********************************************************************************

2025-06-10T04:17:02,501   !!
2025-06-10T04:17:02,502     check.warn(importable)
2025-06-10T04:17:02,503   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2025-06-10T04:17:02,503   !!

2025-06-10T04:17:02,504           ********************************************************************************
2025-06-10T04:17:02,505           ############################
2025-06-10T04:17:02,505           # Package would be ignored #
2025-06-10T04:17:02,506           ############################
2025-06-10T04:17:02,507           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2025-06-10T04:17:02,507           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,508           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,508           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2025-06-10T04:17:02,508           to the `packages` configuration field.

2025-06-10T04:17:02,509           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,509           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,510           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,510           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,511           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,512           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2025-06-10T04:17:02,512           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2025-06-10T04:17:02,513           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,513           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,513           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,514           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,516           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,517           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,518                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,518                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,519                 directory, all directories are treated like packages.
2025-06-10T04:17:02,519           ********************************************************************************

2025-06-10T04:17:02,520   !!
2025-06-10T04:17:02,521     check.warn(importable)
2025-06-10T04:17:02,521   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2025-06-10T04:17:02,522   !!

2025-06-10T04:17:02,523           ********************************************************************************
2025-06-10T04:17:02,523           ############################
2025-06-10T04:17:02,524           # Package would be ignored #
2025-06-10T04:17:02,524           ############################
2025-06-10T04:17:02,525           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2025-06-10T04:17:02,525           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,526           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,527           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2025-06-10T04:17:02,527           to the `packages` configuration field.

2025-06-10T04:17:02,528           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,528           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,529           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,530           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,531           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,532           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2025-06-10T04:17:02,533           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2025-06-10T04:17:02,534           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,534           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,535           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,535           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,536           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,537           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,537                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,538                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,538                 directory, all directories are treated like packages.
2025-06-10T04:17:02,539           ********************************************************************************

2025-06-10T04:17:02,539   !!
2025-06-10T04:17:02,540     check.warn(importable)
2025-06-10T04:17:02,540   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2025-06-10T04:17:02,540   !!

2025-06-10T04:17:02,541           ********************************************************************************
2025-06-10T04:17:02,542           ############################
2025-06-10T04:17:02,542           # Package would be ignored #
2025-06-10T04:17:02,543           ############################
2025-06-10T04:17:02,543           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2025-06-10T04:17:02,544           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,545           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,545           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2025-06-10T04:17:02,546           to the `packages` configuration field.

2025-06-10T04:17:02,547           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,547           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,548           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,549           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,550           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,551           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2025-06-10T04:17:02,552           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2025-06-10T04:17:02,552           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,553           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,553           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,554           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,555           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,557           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,557                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,557                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,558                 directory, all directories are treated like packages.
2025-06-10T04:17:02,559           ********************************************************************************

2025-06-10T04:17:02,560   !!
2025-06-10T04:17:02,560     check.warn(importable)
2025-06-10T04:17:02,561   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2025-06-10T04:17:02,562   !!

2025-06-10T04:17:02,562           ********************************************************************************
2025-06-10T04:17:02,563           ############################
2025-06-10T04:17:02,563           # Package would be ignored #
2025-06-10T04:17:02,563           ############################
2025-06-10T04:17:02,564           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2025-06-10T04:17:02,564           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,565           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,565           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2025-06-10T04:17:02,565           to the `packages` configuration field.

2025-06-10T04:17:02,566           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,567           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,567           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,568           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,568           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,569           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2025-06-10T04:17:02,570           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2025-06-10T04:17:02,570           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,571           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,571           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,572           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,573           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,575           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,575                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,576                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,576                 directory, all directories are treated like packages.
2025-06-10T04:17:02,577           ********************************************************************************

2025-06-10T04:17:02,578   !!
2025-06-10T04:17:02,578     check.warn(importable)
2025-06-10T04:17:02,579   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2025-06-10T04:17:02,579   !!

2025-06-10T04:17:02,580           ********************************************************************************
2025-06-10T04:17:02,581           ############################
2025-06-10T04:17:02,581           # Package would be ignored #
2025-06-10T04:17:02,581           ############################
2025-06-10T04:17:02,582           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2025-06-10T04:17:02,582           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,583           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,584           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2025-06-10T04:17:02,585           to the `packages` configuration field.

2025-06-10T04:17:02,586           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,586           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,587           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,588           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,588           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,589           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2025-06-10T04:17:02,590           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2025-06-10T04:17:02,590           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,590           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,591           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,591           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,592           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,593           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,594                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,594                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,594                 directory, all directories are treated like packages.
2025-06-10T04:17:02,595           ********************************************************************************

2025-06-10T04:17:02,595   !!
2025-06-10T04:17:02,596     check.warn(importable)
2025-06-10T04:17:02,597   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2025-06-10T04:17:02,597   !!

2025-06-10T04:17:02,598           ********************************************************************************
2025-06-10T04:17:02,599           ############################
2025-06-10T04:17:02,599           # Package would be ignored #
2025-06-10T04:17:02,600           ############################
2025-06-10T04:17:02,600           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2025-06-10T04:17:02,601           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,602           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,602           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2025-06-10T04:17:02,603           to the `packages` configuration field.

2025-06-10T04:17:02,604           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,605           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,605           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,606           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,607           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,608           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2025-06-10T04:17:02,609           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2025-06-10T04:17:02,610           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,610           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,611           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,612           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,613           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,615           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,615                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,616                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,616                 directory, all directories are treated like packages.
2025-06-10T04:17:02,617           ********************************************************************************

2025-06-10T04:17:02,617   !!
2025-06-10T04:17:02,618     check.warn(importable)
2025-06-10T04:17:02,618   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.compile' is absent from the `packages` configuration.
2025-06-10T04:17:02,618   !!

2025-06-10T04:17:02,619           ********************************************************************************
2025-06-10T04:17:02,620           ############################
2025-06-10T04:17:02,620           # Package would be ignored #
2025-06-10T04:17:02,620           ############################
2025-06-10T04:17:02,621           Python recognizes 'deepspeed.ops.csrc.compile' as an importable package[^1],
2025-06-10T04:17:02,621           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,622           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,622           package, please make sure that 'deepspeed.ops.csrc.compile' is explicitly added
2025-06-10T04:17:02,623           to the `packages` configuration field.

2025-06-10T04:17:02,623           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,624           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,624           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,625           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,626           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,627           If you don't want 'deepspeed.ops.csrc.compile' to be distributed and are
2025-06-10T04:17:02,627           already explicitly excluding 'deepspeed.ops.csrc.compile' via
2025-06-10T04:17:02,628           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,628           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,629           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,630           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,631           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,633           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,633                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,634                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,634                 directory, all directories are treated like packages.
2025-06-10T04:17:02,634           ********************************************************************************

2025-06-10T04:17:02,635   !!
2025-06-10T04:17:02,636     check.warn(importable)
2025-06-10T04:17:02,636   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2025-06-10T04:17:02,637   !!

2025-06-10T04:17:02,638           ********************************************************************************
2025-06-10T04:17:02,638           ############################
2025-06-10T04:17:02,639           # Package would be ignored #
2025-06-10T04:17:02,639           ############################
2025-06-10T04:17:02,640           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2025-06-10T04:17:02,640           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,641           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,642           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2025-06-10T04:17:02,644           to the `packages` configuration field.

2025-06-10T04:17:02,644           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,645           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,645           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,646           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,646           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,647           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2025-06-10T04:17:02,647           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2025-06-10T04:17:02,648           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,648           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,648           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,649           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,650           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,651           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,652                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,652                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,652                 directory, all directories are treated like packages.
2025-06-10T04:17:02,653           ********************************************************************************

2025-06-10T04:17:02,654   !!
2025-06-10T04:17:02,654     check.warn(importable)
2025-06-10T04:17:02,655   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2025-06-10T04:17:02,655   !!

2025-06-10T04:17:02,656           ********************************************************************************
2025-06-10T04:17:02,657           ############################
2025-06-10T04:17:02,657           # Package would be ignored #
2025-06-10T04:17:02,658           ############################
2025-06-10T04:17:02,659           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2025-06-10T04:17:02,659           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,660           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,661           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2025-06-10T04:17:02,661           to the `packages` configuration field.

2025-06-10T04:17:02,662           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,663           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,663           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,664           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,665           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,666           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2025-06-10T04:17:02,667           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2025-06-10T04:17:02,667           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,668           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,668           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,670           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,670           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,671           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,672                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,672                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,672                 directory, all directories are treated like packages.
2025-06-10T04:17:02,673           ********************************************************************************

2025-06-10T04:17:02,673   !!
2025-06-10T04:17:02,674     check.warn(importable)
2025-06-10T04:17:02,674   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2025-06-10T04:17:02,675   !!

2025-06-10T04:17:02,675           ********************************************************************************
2025-06-10T04:17:02,676           ############################
2025-06-10T04:17:02,676           # Package would be ignored #
2025-06-10T04:17:02,677           ############################
2025-06-10T04:17:02,677           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2025-06-10T04:17:02,677           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,678           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,679           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2025-06-10T04:17:02,679           to the `packages` configuration field.

2025-06-10T04:17:02,680           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,681           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,682           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,683           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,684           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,685           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2025-06-10T04:17:02,685           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2025-06-10T04:17:02,686           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,687           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,687           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,688           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,689           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,690           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,691                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,691                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,692                 directory, all directories are treated like packages.
2025-06-10T04:17:02,692           ********************************************************************************

2025-06-10T04:17:02,693   !!
2025-06-10T04:17:02,694     check.warn(importable)
2025-06-10T04:17:02,694   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2025-06-10T04:17:02,695   !!

2025-06-10T04:17:02,696           ********************************************************************************
2025-06-10T04:17:02,697           ############################
2025-06-10T04:17:02,697           # Package would be ignored #
2025-06-10T04:17:02,698           ############################
2025-06-10T04:17:02,698           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2025-06-10T04:17:02,698           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,699           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,699           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2025-06-10T04:17:02,700           to the `packages` configuration field.

2025-06-10T04:17:02,701           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,701           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,701           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,702           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,703           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,703           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2025-06-10T04:17:02,704           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2025-06-10T04:17:02,704           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,705           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,705           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,706           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,707           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,709           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,709                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,710                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,710                 directory, all directories are treated like packages.
2025-06-10T04:17:02,711           ********************************************************************************

2025-06-10T04:17:02,712   !!
2025-06-10T04:17:02,712     check.warn(importable)
2025-06-10T04:17:02,713   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2025-06-10T04:17:02,714   !!

2025-06-10T04:17:02,715           ********************************************************************************
2025-06-10T04:17:02,715           ############################
2025-06-10T04:17:02,716           # Package would be ignored #
2025-06-10T04:17:02,716           ############################
2025-06-10T04:17:02,717           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2025-06-10T04:17:02,717           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,718           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,718           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2025-06-10T04:17:02,719           to the `packages` configuration field.

2025-06-10T04:17:02,720           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,721           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,721           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,722           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,723           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,724           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2025-06-10T04:17:02,725           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2025-06-10T04:17:02,725           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,725           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,726           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,726           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,727           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,728           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,729                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,729                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,729                 directory, all directories are treated like packages.
2025-06-10T04:17:02,730           ********************************************************************************

2025-06-10T04:17:02,731   !!
2025-06-10T04:17:02,731     check.warn(importable)
2025-06-10T04:17:02,731   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2025-06-10T04:17:02,732   !!

2025-06-10T04:17:02,733           ********************************************************************************
2025-06-10T04:17:02,733           ############################
2025-06-10T04:17:02,734           # Package would be ignored #
2025-06-10T04:17:02,735           ############################
2025-06-10T04:17:02,735           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2025-06-10T04:17:02,736           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,737           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,737           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2025-06-10T04:17:02,738           to the `packages` configuration field.

2025-06-10T04:17:02,739           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,740           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,740           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,741           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,742           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,743           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2025-06-10T04:17:02,744           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2025-06-10T04:17:02,744           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,745           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,745           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,746           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,747           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,749           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,749                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,750                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,751                 directory, all directories are treated like packages.
2025-06-10T04:17:02,751           ********************************************************************************

2025-06-10T04:17:02,752   !!
2025-06-10T04:17:02,752     check.warn(importable)
2025-06-10T04:17:02,752   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2025-06-10T04:17:02,753   !!

2025-06-10T04:17:02,754           ********************************************************************************
2025-06-10T04:17:02,754           ############################
2025-06-10T04:17:02,755           # Package would be ignored #
2025-06-10T04:17:02,755           ############################
2025-06-10T04:17:02,755           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2025-06-10T04:17:02,756           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,756           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,757           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2025-06-10T04:17:02,757           to the `packages` configuration field.

2025-06-10T04:17:02,758           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,759           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,759           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,760           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,761           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,762           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2025-06-10T04:17:02,763           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2025-06-10T04:17:02,763           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,764           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,764           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,765           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,767           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,768           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,768                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,769                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,769                 directory, all directories are treated like packages.
2025-06-10T04:17:02,770           ********************************************************************************

2025-06-10T04:17:02,771   !!
2025-06-10T04:17:02,771     check.warn(importable)
2025-06-10T04:17:02,772   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2025-06-10T04:17:02,772   !!

2025-06-10T04:17:02,773           ********************************************************************************
2025-06-10T04:17:02,774           ############################
2025-06-10T04:17:02,774           # Package would be ignored #
2025-06-10T04:17:02,775           ############################
2025-06-10T04:17:02,775           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2025-06-10T04:17:02,776           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,777           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,777           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2025-06-10T04:17:02,777           to the `packages` configuration field.

2025-06-10T04:17:02,778           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,779           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,779           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,780           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,780           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,781           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2025-06-10T04:17:02,781           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2025-06-10T04:17:02,782           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,782           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,783           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,784           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,785           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,786           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,787                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,787                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,788                 directory, all directories are treated like packages.
2025-06-10T04:17:02,788           ********************************************************************************

2025-06-10T04:17:02,789   !!
2025-06-10T04:17:02,790     check.warn(importable)
2025-06-10T04:17:02,790   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2025-06-10T04:17:02,791   !!

2025-06-10T04:17:02,792           ********************************************************************************
2025-06-10T04:17:02,792           ############################
2025-06-10T04:17:02,793           # Package would be ignored #
2025-06-10T04:17:02,793           ############################
2025-06-10T04:17:02,794           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2025-06-10T04:17:02,794           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,795           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,796           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2025-06-10T04:17:02,796           to the `packages` configuration field.

2025-06-10T04:17:02,797           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,798           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,798           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,799           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,800           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,802           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2025-06-10T04:17:02,802           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2025-06-10T04:17:02,803           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,803           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,804           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,804           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,805           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,806           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,806                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,807                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,807                 directory, all directories are treated like packages.
2025-06-10T04:17:02,808           ********************************************************************************

2025-06-10T04:17:02,808   !!
2025-06-10T04:17:02,809     check.warn(importable)
2025-06-10T04:17:02,809   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2025-06-10T04:17:02,809   !!

2025-06-10T04:17:02,811           ********************************************************************************
2025-06-10T04:17:02,811           ############################
2025-06-10T04:17:02,811           # Package would be ignored #
2025-06-10T04:17:02,812           ############################
2025-06-10T04:17:02,812           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2025-06-10T04:17:02,813           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,814           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,815           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2025-06-10T04:17:02,815           to the `packages` configuration field.

2025-06-10T04:17:02,816           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,817           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,817           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,818           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,820           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,821           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2025-06-10T04:17:02,821           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2025-06-10T04:17:02,821           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,822           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,822           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,823           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,824           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,826           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,827                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,827                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,828                 directory, all directories are treated like packages.
2025-06-10T04:17:02,828           ********************************************************************************

2025-06-10T04:17:02,830   !!
2025-06-10T04:17:02,830     check.warn(importable)
2025-06-10T04:17:02,831   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2025-06-10T04:17:02,831   !!

2025-06-10T04:17:02,832           ********************************************************************************
2025-06-10T04:17:02,833           ############################
2025-06-10T04:17:02,833           # Package would be ignored #
2025-06-10T04:17:02,833           ############################
2025-06-10T04:17:02,834           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2025-06-10T04:17:02,834           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,835           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,836           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2025-06-10T04:17:02,836           to the `packages` configuration field.

2025-06-10T04:17:02,837           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,838           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,838           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,839           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,840           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,841           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2025-06-10T04:17:02,841           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2025-06-10T04:17:02,842           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,843           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,843           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,844           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,845           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,847           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,848                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,848                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,849                 directory, all directories are treated like packages.
2025-06-10T04:17:02,849           ********************************************************************************

2025-06-10T04:17:02,850   !!
2025-06-10T04:17:02,851     check.warn(importable)
2025-06-10T04:17:02,851   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2025-06-10T04:17:02,852   !!

2025-06-10T04:17:02,853           ********************************************************************************
2025-06-10T04:17:02,854           ############################
2025-06-10T04:17:02,854           # Package would be ignored #
2025-06-10T04:17:02,855           ############################
2025-06-10T04:17:02,855           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2025-06-10T04:17:02,856           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,857           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,857           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2025-06-10T04:17:02,858           to the `packages` configuration field.

2025-06-10T04:17:02,859           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,860           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,861           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,862           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,862           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,863           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2025-06-10T04:17:02,864           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2025-06-10T04:17:02,864           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,865           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,865           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,866           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,867           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,868           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,869                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,869                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,870                 directory, all directories are treated like packages.
2025-06-10T04:17:02,870           ********************************************************************************

2025-06-10T04:17:02,872   !!
2025-06-10T04:17:02,872     check.warn(importable)
2025-06-10T04:17:02,873   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2025-06-10T04:17:02,873   !!

2025-06-10T04:17:02,874           ********************************************************************************
2025-06-10T04:17:02,875           ############################
2025-06-10T04:17:02,875           # Package would be ignored #
2025-06-10T04:17:02,876           ############################
2025-06-10T04:17:02,876           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2025-06-10T04:17:02,877           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,878           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,879           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2025-06-10T04:17:02,879           to the `packages` configuration field.

2025-06-10T04:17:02,880           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,881           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,881           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,883           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,884           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,885           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2025-06-10T04:17:02,885           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2025-06-10T04:17:02,886           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,886           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,887           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,888           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,889           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,891           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,891                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,892                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,892                 directory, all directories are treated like packages.
2025-06-10T04:17:02,893           ********************************************************************************

2025-06-10T04:17:02,894   !!
2025-06-10T04:17:02,894     check.warn(importable)
2025-06-10T04:17:02,895   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2025-06-10T04:17:02,895   !!

2025-06-10T04:17:02,896           ********************************************************************************
2025-06-10T04:17:02,896           ############################
2025-06-10T04:17:02,897           # Package would be ignored #
2025-06-10T04:17:02,897           ############################
2025-06-10T04:17:02,898           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2025-06-10T04:17:02,898           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,901           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,901           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2025-06-10T04:17:02,902           to the `packages` configuration field.

2025-06-10T04:17:02,903           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,903           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,903           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,905           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,906           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,907           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2025-06-10T04:17:02,907           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2025-06-10T04:17:02,908           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,908           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,909           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,910           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,911           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,913           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,913                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,914                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,914                 directory, all directories are treated like packages.
2025-06-10T04:17:02,915           ********************************************************************************

2025-06-10T04:17:02,916   !!
2025-06-10T04:17:02,916     check.warn(importable)
2025-06-10T04:17:02,917   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2025-06-10T04:17:02,917   !!

2025-06-10T04:17:02,919           ********************************************************************************
2025-06-10T04:17:02,919           ############################
2025-06-10T04:17:02,920           # Package would be ignored #
2025-06-10T04:17:02,920           ############################
2025-06-10T04:17:02,921           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2025-06-10T04:17:02,921           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,923           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,923           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2025-06-10T04:17:02,924           to the `packages` configuration field.

2025-06-10T04:17:02,925           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,925           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,925           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,926           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,927           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,928           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2025-06-10T04:17:02,928           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2025-06-10T04:17:02,929           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,929           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,930           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,931           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,932           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,933           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,934                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,934                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,935                 directory, all directories are treated like packages.
2025-06-10T04:17:02,935           ********************************************************************************

2025-06-10T04:17:02,936   !!
2025-06-10T04:17:02,937     check.warn(importable)
2025-06-10T04:17:02,937   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2025-06-10T04:17:02,938   !!

2025-06-10T04:17:02,939           ********************************************************************************
2025-06-10T04:17:02,939           ############################
2025-06-10T04:17:02,940           # Package would be ignored #
2025-06-10T04:17:02,940           ############################
2025-06-10T04:17:02,941           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2025-06-10T04:17:02,941           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,943           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,943           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2025-06-10T04:17:02,944           to the `packages` configuration field.

2025-06-10T04:17:02,945           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,946           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,946           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,947           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,948           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,949           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2025-06-10T04:17:02,950           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2025-06-10T04:17:02,950           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,951           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,952           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,953           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,954           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,955           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,955                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,956                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,956                 directory, all directories are treated like packages.
2025-06-10T04:17:02,957           ********************************************************************************

2025-06-10T04:17:02,958   !!
2025-06-10T04:17:02,958     check.warn(importable)
2025-06-10T04:17:02,959   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2025-06-10T04:17:02,959   !!

2025-06-10T04:17:02,960           ********************************************************************************
2025-06-10T04:17:02,960           ############################
2025-06-10T04:17:02,961           # Package would be ignored #
2025-06-10T04:17:02,961           ############################
2025-06-10T04:17:02,962           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2025-06-10T04:17:02,962           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,963           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,964           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2025-06-10T04:17:02,964           to the `packages` configuration field.

2025-06-10T04:17:02,965           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,965           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,966           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,967           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,968           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,969           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2025-06-10T04:17:02,970           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2025-06-10T04:17:02,970           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,971           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,971           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,972           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,973           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,975           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,975                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,976                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,976                 directory, all directories are treated like packages.
2025-06-10T04:17:02,977           ********************************************************************************

2025-06-10T04:17:02,978   !!
2025-06-10T04:17:02,978     check.warn(importable)
2025-06-10T04:17:02,979   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2025-06-10T04:17:02,979   !!

2025-06-10T04:17:02,981           ********************************************************************************
2025-06-10T04:17:02,981           ############################
2025-06-10T04:17:02,982           # Package would be ignored #
2025-06-10T04:17:02,982           ############################
2025-06-10T04:17:02,982           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2025-06-10T04:17:02,983           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:02,984           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:02,984           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2025-06-10T04:17:02,985           to the `packages` configuration field.

2025-06-10T04:17:02,986           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:02,986           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:02,987           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:02,988           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:02,989           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:02,990           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2025-06-10T04:17:02,990           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2025-06-10T04:17:02,991           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:02,991           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:02,992           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:02,993           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:02,994           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:02,995           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:02,996                 even if it does not contain any `.py` files.
2025-06-10T04:17:02,996                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:02,997                 directory, all directories are treated like packages.
2025-06-10T04:17:02,997           ********************************************************************************

2025-06-10T04:17:02,998   !!
2025-06-10T04:17:02,999     check.warn(importable)
2025-06-10T04:17:02,999   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2025-06-10T04:17:03,000   !!

2025-06-10T04:17:03,001           ********************************************************************************
2025-06-10T04:17:03,001           ############################
2025-06-10T04:17:03,002           # Package would be ignored #
2025-06-10T04:17:03,002           ############################
2025-06-10T04:17:03,003           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2025-06-10T04:17:03,003           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:03,004           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:03,005           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2025-06-10T04:17:03,005           to the `packages` configuration field.

2025-06-10T04:17:03,007           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:03,007           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:03,008           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:03,009           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:03,010           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:03,011           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2025-06-10T04:17:03,011           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2025-06-10T04:17:03,012           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:03,012           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:03,013           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:03,014           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:03,014           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:03,016           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:03,016                 even if it does not contain any `.py` files.
2025-06-10T04:17:03,017                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:03,017                 directory, all directories are treated like packages.
2025-06-10T04:17:03,018           ********************************************************************************

2025-06-10T04:17:03,019   !!
2025-06-10T04:17:03,019     check.warn(importable)
2025-06-10T04:17:03,020   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2025-06-10T04:17:03,020   !!

2025-06-10T04:17:03,021           ********************************************************************************
2025-06-10T04:17:03,022           ############################
2025-06-10T04:17:03,022           # Package would be ignored #
2025-06-10T04:17:03,023           ############################
2025-06-10T04:17:03,023           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2025-06-10T04:17:03,024           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:03,025           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:03,025           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2025-06-10T04:17:03,026           to the `packages` configuration field.

2025-06-10T04:17:03,027           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:03,027           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:03,028           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:03,029           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:03,030           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:03,031           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2025-06-10T04:17:03,032           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2025-06-10T04:17:03,032           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:03,033           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:03,033           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:03,034           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:03,036           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:03,038           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:03,038                 even if it does not contain any `.py` files.
2025-06-10T04:17:03,039                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:03,039                 directory, all directories are treated like packages.
2025-06-10T04:17:03,040           ********************************************************************************

2025-06-10T04:17:03,041   !!
2025-06-10T04:17:03,042     check.warn(importable)
2025-06-10T04:17:03,042   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2025-06-10T04:17:03,043   !!

2025-06-10T04:17:03,044           ********************************************************************************
2025-06-10T04:17:03,044           ############################
2025-06-10T04:17:03,045           # Package would be ignored #
2025-06-10T04:17:03,045           ############################
2025-06-10T04:17:03,046           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2025-06-10T04:17:03,046           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:03,047           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:03,048           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2025-06-10T04:17:03,048           to the `packages` configuration field.

2025-06-10T04:17:03,049           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:03,050           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:03,050           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:03,051           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:03,052           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:03,053           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2025-06-10T04:17:03,054           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2025-06-10T04:17:03,054           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:03,055           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:03,055           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:03,056           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:03,057           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:03,059           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:03,059                 even if it does not contain any `.py` files.
2025-06-10T04:17:03,060                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:03,061                 directory, all directories are treated like packages.
2025-06-10T04:17:03,061           ********************************************************************************

2025-06-10T04:17:03,062   !!
2025-06-10T04:17:03,063     check.warn(importable)
2025-06-10T04:17:03,063   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2025-06-10T04:17:03,064   !!

2025-06-10T04:17:03,065           ********************************************************************************
2025-06-10T04:17:03,066           ############################
2025-06-10T04:17:03,066           # Package would be ignored #
2025-06-10T04:17:03,067           ############################
2025-06-10T04:17:03,067           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2025-06-10T04:17:03,068           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:03,069           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:03,070           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2025-06-10T04:17:03,071           to the `packages` configuration field.

2025-06-10T04:17:03,071           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:03,072           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:03,072           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:03,073           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:03,074           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:03,075           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2025-06-10T04:17:03,075           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2025-06-10T04:17:03,076           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:03,076           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:03,077           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:03,078           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:03,079           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:03,080           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:03,081                 even if it does not contain any `.py` files.
2025-06-10T04:17:03,081                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:03,081                 directory, all directories are treated like packages.
2025-06-10T04:17:03,082           ********************************************************************************

2025-06-10T04:17:03,083   !!
2025-06-10T04:17:03,083     check.warn(importable)
2025-06-10T04:17:03,084   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2025-06-10T04:17:03,084   !!

2025-06-10T04:17:03,085           ********************************************************************************
2025-06-10T04:17:03,086           ############################
2025-06-10T04:17:03,086           # Package would be ignored #
2025-06-10T04:17:03,087           ############################
2025-06-10T04:17:03,087           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2025-06-10T04:17:03,088           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:03,089           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:03,090           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2025-06-10T04:17:03,090           to the `packages` configuration field.

2025-06-10T04:17:03,092           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:03,093           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:03,093           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:03,094           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:03,095           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:03,097           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2025-06-10T04:17:03,097           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2025-06-10T04:17:03,098           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:03,099           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:03,099           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:03,100           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:03,101           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:03,102           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:03,103                 even if it does not contain any `.py` files.
2025-06-10T04:17:03,103                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:03,104                 directory, all directories are treated like packages.
2025-06-10T04:17:03,104           ********************************************************************************

2025-06-10T04:17:03,105   !!
2025-06-10T04:17:03,106     check.warn(importable)
2025-06-10T04:17:03,106   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2025-06-10T04:17:03,107   !!

2025-06-10T04:17:03,107           ********************************************************************************
2025-06-10T04:17:03,108           ############################
2025-06-10T04:17:03,108           # Package would be ignored #
2025-06-10T04:17:03,109           ############################
2025-06-10T04:17:03,110           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2025-06-10T04:17:03,110           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:03,111           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:03,111           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2025-06-10T04:17:03,112           to the `packages` configuration field.

2025-06-10T04:17:03,113           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:03,113           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:03,114           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:03,115           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:03,116           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:03,117           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2025-06-10T04:17:03,118           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2025-06-10T04:17:03,118           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:03,119           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:03,119           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:03,120           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:03,121           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:03,123           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:03,123                 even if it does not contain any `.py` files.
2025-06-10T04:17:03,124                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:03,124                 directory, all directories are treated like packages.
2025-06-10T04:17:03,125           ********************************************************************************

2025-06-10T04:17:03,126   !!
2025-06-10T04:17:03,126     check.warn(importable)
2025-06-10T04:17:03,127   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2025-06-10T04:17:03,128   !!

2025-06-10T04:17:03,129           ********************************************************************************
2025-06-10T04:17:03,129           ############################
2025-06-10T04:17:03,130           # Package would be ignored #
2025-06-10T04:17:03,131           ############################
2025-06-10T04:17:03,131           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2025-06-10T04:17:03,132           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:03,133           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:03,133           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2025-06-10T04:17:03,133           to the `packages` configuration field.

2025-06-10T04:17:03,134           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:03,135           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:03,135           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:03,136           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:03,137           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:03,139           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2025-06-10T04:17:03,140           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2025-06-10T04:17:03,140           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:03,141           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:03,141           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:03,142           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:03,143           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:03,145           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:03,145                 even if it does not contain any `.py` files.
2025-06-10T04:17:03,146                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:03,146                 directory, all directories are treated like packages.
2025-06-10T04:17:03,147           ********************************************************************************

2025-06-10T04:17:03,148   !!
2025-06-10T04:17:03,148     check.warn(importable)
2025-06-10T04:17:03,149   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2025-06-10T04:17:03,149   !!

2025-06-10T04:17:03,150           ********************************************************************************
2025-06-10T04:17:03,152           ############################
2025-06-10T04:17:03,152           # Package would be ignored #
2025-06-10T04:17:03,153           ############################
2025-06-10T04:17:03,153           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2025-06-10T04:17:03,154           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:03,155           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:03,156           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2025-06-10T04:17:03,156           to the `packages` configuration field.

2025-06-10T04:17:03,157           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:03,158           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:03,158           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:03,160           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:03,161           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:03,163           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2025-06-10T04:17:03,163           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2025-06-10T04:17:03,164           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:03,164           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:03,165           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:03,165           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:03,166           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:03,168           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:03,168                 even if it does not contain any `.py` files.
2025-06-10T04:17:03,168                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:03,169                 directory, all directories are treated like packages.
2025-06-10T04:17:03,169           ********************************************************************************

2025-06-10T04:17:03,170   !!
2025-06-10T04:17:03,171     check.warn(importable)
2025-06-10T04:17:03,171   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2025-06-10T04:17:03,172   !!

2025-06-10T04:17:03,173           ********************************************************************************
2025-06-10T04:17:03,173           ############################
2025-06-10T04:17:03,174           # Package would be ignored #
2025-06-10T04:17:03,174           ############################
2025-06-10T04:17:03,175           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2025-06-10T04:17:03,175           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:03,176           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:03,177           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2025-06-10T04:17:03,177           to the `packages` configuration field.

2025-06-10T04:17:03,178           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:03,179           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:03,180           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:03,180           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:03,181           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:03,183           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2025-06-10T04:17:03,183           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2025-06-10T04:17:03,184           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:03,184           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:03,185           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:03,186           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:03,187           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:03,188           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:03,189                 even if it does not contain any `.py` files.
2025-06-10T04:17:03,189                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:03,190                 directory, all directories are treated like packages.
2025-06-10T04:17:03,190           ********************************************************************************

2025-06-10T04:17:03,192   !!
2025-06-10T04:17:03,192     check.warn(importable)
2025-06-10T04:17:03,193   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2025-06-10T04:17:03,193   !!

2025-06-10T04:17:03,194           ********************************************************************************
2025-06-10T04:17:03,194           ############################
2025-06-10T04:17:03,195           # Package would be ignored #
2025-06-10T04:17:03,195           ############################
2025-06-10T04:17:03,196           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2025-06-10T04:17:03,196           but it is absent from setuptools' `packages` configuration.

2025-06-10T04:17:03,197           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-10T04:17:03,198           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2025-06-10T04:17:03,198           to the `packages` configuration field.

2025-06-10T04:17:03,199           Alternatively, you can also rely on setuptools' discovery methods
2025-06-10T04:17:03,199           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-10T04:17:03,200           instead of `find_packages(...)`/`find:`).

2025-06-10T04:17:03,201           You can read more about "package discovery" on setuptools documentation page:

2025-06-10T04:17:03,202           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-10T04:17:03,203           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2025-06-10T04:17:03,203           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2025-06-10T04:17:03,204           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-10T04:17:03,204           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-10T04:17:03,205           combination with a more fine grained `package-data` configuration.

2025-06-10T04:17:03,206           You can read more about "package data files" on setuptools documentation page:

2025-06-10T04:17:03,207           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-10T04:17:03,208           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-10T04:17:03,209                 even if it does not contain any `.py` files.
2025-06-10T04:17:03,209                 On the other hand, currently there is no concept of package data
2025-06-10T04:17:03,210                 directory, all directories are treated like packages.
2025-06-10T04:17:03,210           ********************************************************************************

2025-06-10T04:17:03,211   !!
2025-06-10T04:17:03,212     check.warn(importable)
2025-06-10T04:17:03,212   creating build/lib/deepspeed/autotuning/config_templates
2025-06-10T04:17:03,213   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-10T04:17:03,213   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-10T04:17:03,214   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-10T04:17:03,214   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-10T04:17:03,215   creating build/lib/deepspeed/ops/csrc/adagrad
2025-06-10T04:17:03,215   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2025-06-10T04:17:03,216   creating build/lib/deepspeed/ops/csrc/adam
2025-06-10T04:17:03,216   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-10T04:17:03,217   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-10T04:17:03,218   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-10T04:17:03,218   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2025-06-10T04:17:03,219   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2025-06-10T04:17:03,219   creating build/lib/deepspeed/ops/csrc/aio/common
2025-06-10T04:17:03,220   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-10T04:17:03,220   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-10T04:17:03,221   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-10T04:17:03,221   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-10T04:17:03,221   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-10T04:17:03,222   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-10T04:17:03,222   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,223   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,223   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,224   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,224   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,225   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,225   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,226   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,226   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,227   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,227   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,228   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,228   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,229   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,229   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,230   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,230   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,231   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:03,232   creating build/lib/deepspeed/ops/csrc/aio/py_test
2025-06-10T04:17:03,232   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2025-06-10T04:17:03,233   creating build/lib/deepspeed/ops/csrc/compile
2025-06-10T04:17:03,233   copying deepspeed/ops/csrc/compile/deepcompile.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-10T04:17:03,234   copying deepspeed/ops/csrc/compile/init.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-10T04:17:03,234   copying deepspeed/ops/csrc/compile/util.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-10T04:17:03,235   copying deepspeed/ops/csrc/compile/z1.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-10T04:17:03,236   copying deepspeed/ops/csrc/compile/z1.h -> build/lib/deepspeed/ops/csrc/compile
2025-06-10T04:17:03,236   copying deepspeed/ops/csrc/compile/z3.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-10T04:17:03,236   copying deepspeed/ops/csrc/compile/z3.h -> build/lib/deepspeed/ops/csrc/compile
2025-06-10T04:17:03,237   creating build/lib/deepspeed/ops/csrc/cpu/adam
2025-06-10T04:17:03,237   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2025-06-10T04:17:03,238   creating build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-10T04:17:03,238   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-10T04:17:03,239   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-10T04:17:03,239   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-10T04:17:03,240   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-10T04:17:03,240   creating build/lib/deepspeed/ops/csrc/cpu/lion
2025-06-10T04:17:03,241   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2025-06-10T04:17:03,241   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-10T04:17:03,241   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-10T04:17:03,242   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-10T04:17:03,242   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-10T04:17:03,243   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-10T04:17:03,244   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-10T04:17:03,244   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-10T04:17:03,245   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-10T04:17:03,245   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-10T04:17:03,246   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-10T04:17:03,246   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-10T04:17:03,247   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-10T04:17:03,247   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-10T04:17:03,248   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-10T04:17:03,248   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-10T04:17:03,249   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-10T04:17:03,249   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-10T04:17:03,250   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-10T04:17:03,251   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-10T04:17:03,251   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-10T04:17:03,251   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-10T04:17:03,252   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-10T04:17:03,252   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-10T04:17:03,253   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-10T04:17:03,253   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-10T04:17:03,254   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-10T04:17:03,254   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-10T04:17:03,255   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-10T04:17:03,255   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-10T04:17:03,256   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-10T04:17:03,256   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-10T04:17:03,257   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-10T04:17:03,257   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-10T04:17:03,258   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-10T04:17:03,258   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-10T04:17:03,259   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-10T04:17:03,259   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-10T04:17:03,260   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-10T04:17:03,260   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-10T04:17:03,261   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-10T04:17:03,261   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-10T04:17:03,262   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-10T04:17:03,262   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-10T04:17:03,263   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-10T04:17:03,264   creating build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,264   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,265   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,265   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,266   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,266   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,267   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,267   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,268   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,268   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,268   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,269   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,269   copying deepspeed/ops/csrc/includes/deepcompile.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,270   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,270   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,271   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,271   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,272   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,273   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,273   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,274   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,274   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,275   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,277   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,280   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,283   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,285   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,288   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,291   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,293   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,296   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-10T04:17:03,298   creating build/lib/deepspeed/ops/csrc/lamb
2025-06-10T04:17:03,299   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2025-06-10T04:17:03,302   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2025-06-10T04:17:03,305   creating build/lib/deepspeed/ops/csrc/lion
2025-06-10T04:17:03,306   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-10T04:17:03,308   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-10T04:17:03,311   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-10T04:17:03,313   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2025-06-10T04:17:03,315   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2025-06-10T04:17:03,317   creating build/lib/deepspeed/ops/csrc/quantization
2025-06-10T04:17:03,318   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-10T04:17:03,321   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-10T04:17:03,324   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2025-06-10T04:17:03,327   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-10T04:17:03,330   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-10T04:17:03,332   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-10T04:17:03,335   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-10T04:17:03,338   creating build/lib/deepspeed/ops/csrc/random_ltd
2025-06-10T04:17:03,339   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-10T04:17:03,341   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-10T04:17:03,344   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-10T04:17:03,346   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-10T04:17:03,349   creating build/lib/deepspeed/ops/csrc/sparse_attention
2025-06-10T04:17:03,350   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2025-06-10T04:17:03,353   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-10T04:17:03,355   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-10T04:17:03,358   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-10T04:17:03,360   creating build/lib/deepspeed/ops/csrc/spatial/includes
2025-06-10T04:17:03,361   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2025-06-10T04:17:03,363   creating build/lib/deepspeed/ops/csrc/transformer
2025-06-10T04:17:03,364   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-10T04:17:03,367   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-10T04:17:03,370   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2025-06-10T04:17:03,374   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-10T04:17:03,377   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-10T04:17:03,380   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-10T04:17:03,384   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-10T04:17:03,387   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-10T04:17:03,390   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:03,392   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:03,395   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:03,397   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:03,400   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:03,403   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:03,406   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:03,410   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:03,412   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:03,415   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:03,418   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:03,421   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-10T04:17:03,422   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-10T04:17:03,425   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-10T04:17:03,428   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-10T04:17:03,430   creating build/lib/deepspeed/ops/csrc/utils
2025-06-10T04:17:03,431   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2025-06-10T04:17:03,433   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-06-10T04:17:03,435   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-06-10T04:17:03,438   creating build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-10T04:17:03,439   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-10T04:17:03,441   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-10T04:17:03,444   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-10T04:17:03,446   creating build/lib/deepspeed/ops/csrc/xpu/common
2025-06-10T04:17:03,447   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2025-06-10T04:17:03,450   creating build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-10T04:17:03,451   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-10T04:17:03,453   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-10T04:17:03,455   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-10T04:17:03,458   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-10T04:17:03,460   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-10T04:17:03,463   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2025-06-10T04:17:03,464   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2025-06-10T04:17:03,466   creating build/lib/deepspeed/inference/v2/kernels/includes
2025-06-10T04:17:03,467   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-10T04:17:03,470   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-10T04:17:03,473   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-10T04:17:03,475   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-10T04:17:03,478   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-10T04:17:03,481   creating build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-10T04:17:03,481   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-10T04:17:03,484   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-10T04:17:03,486   creating build/lib/deepspeed/inference/v2/ragged/includes
2025-06-10T04:17:03,487   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2025-06-10T04:17:03,489   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-10T04:17:03,491   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-10T04:17:03,492   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-10T04:17:03,494   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-10T04:17:03,495   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-10T04:17:03,498   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-10T04:17:03,500   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-10T04:17:03,502   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-10T04:17:03,504   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-10T04:17:03,507   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-10T04:17:03,508   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-10T04:17:03,510   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-10T04:17:03,512   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-10T04:17:03,515   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-10T04:17:03,517   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-10T04:17:03,519   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-10T04:17:03,522   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-10T04:17:03,524   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-10T04:17:03,526   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-10T04:17:03,529   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-10T04:17:03,532   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-10T04:17:03,534   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-10T04:17:03,536   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-10T04:17:03,539   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-10T04:17:03,541   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-10T04:17:03,544   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-10T04:17:03,546   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-10T04:17:03,549   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-10T04:17:03,551   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-10T04:17:03,553   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-10T04:17:03,555   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-10T04:17:03,558   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-10T04:17:03,560   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-10T04:17:03,562   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:17:03,565   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:17:03,568   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:17:03,570   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:17:03,573   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-10T04:17:03,575   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-10T04:17:03,577   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-10T04:17:03,579   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-10T04:17:03,582   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-10T04:17:03,584   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-10T04:17:03,586   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-10T04:17:03,589   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:17:03,592   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:17:03,594   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:17:03,597   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-10T04:17:03,600   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-10T04:17:03,602   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-10T04:17:03,605   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-10T04:17:03,607   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:03,608   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:03,611   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:03,613   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:03,616   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:03,618   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:03,621   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:03,623   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:03,626   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:03,628   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:03,631   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-10T04:17:03,633   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-10T04:17:03,635   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-10T04:17:03,638   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-10T04:17:03,641   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-10T04:17:03,643   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-10T04:17:03,646   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-10T04:17:03,648   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-10T04:17:03,650   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-10T04:17:03,653   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-10T04:17:03,655   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-10T04:17:03,657   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-10T04:17:03,660   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-10T04:17:03,662   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-10T04:17:03,664   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-10T04:17:03,667   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-10T04:17:03,669   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-10T04:17:03,728   running build_scripts
2025-06-10T04:17:03,729   creating build/scripts-3.11
2025-06-10T04:17:03,730   copying and adjusting bin/deepspeed -> build/scripts-3.11
2025-06-10T04:17:03,732   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2025-06-10T04:17:03,734   copying and adjusting bin/ds -> build/scripts-3.11
2025-06-10T04:17:03,735   copying bin/ds_ssh -> build/scripts-3.11
2025-06-10T04:17:03,737   copying and adjusting bin/ds_report -> build/scripts-3.11
2025-06-10T04:17:03,739   copying and adjusting bin/ds_bench -> build/scripts-3.11
2025-06-10T04:17:03,740   copying and adjusting bin/dsr -> build/scripts-3.11
2025-06-10T04:17:03,742   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2025-06-10T04:17:03,744   copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11
2025-06-10T04:17:03,745   copying and adjusting bin/ds_io -> build/scripts-3.11
2025-06-10T04:17:03,746   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2025-06-10T04:17:03,747   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2025-06-10T04:17:03,747   changing mode of build/scripts-3.11/ds from 644 to 755
2025-06-10T04:17:03,748   changing mode of build/scripts-3.11/ds_report from 644 to 755
2025-06-10T04:17:03,748   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2025-06-10T04:17:03,749   changing mode of build/scripts-3.11/dsr from 644 to 755
2025-06-10T04:17:03,749   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2025-06-10T04:17:03,750   changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755
2025-06-10T04:17:03,751   changing mode of build/scripts-3.11/ds_io from 644 to 755
2025-06-10T04:17:03,778   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2025-06-10T04:17:03,779   !!

2025-06-10T04:17:03,780           ********************************************************************************
2025-06-10T04:17:03,781           Please avoid running ``setup.py`` directly.
2025-06-10T04:17:03,781           Instead, use pypa/build, pypa/installer or other
2025-06-10T04:17:03,782           standards-based tools.

2025-06-10T04:17:03,783           By 2025-Oct-31, you need to update your project and remove deprecated calls
2025-06-10T04:17:03,783           or your builds will no longer be supported.

2025-06-10T04:17:03,784           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2025-06-10T04:17:03,784           ********************************************************************************

2025-06-10T04:17:03,785   !!
2025-06-10T04:17:03,786     self.initialize_options()
2025-06-10T04:17:03,807   installing to build/bdist.linux-armv7l/wheel
2025-06-10T04:17:03,808   running install
2025-06-10T04:17:03,833   running install_lib
2025-06-10T04:17:03,861   creating build/bdist.linux-armv7l/wheel
2025-06-10T04:17:03,863   creating build/bdist.linux-armv7l/wheel/deepspeed
2025-06-10T04:17:03,865   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2025-06-10T04:17:03,867   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2025-06-10T04:17:03,869   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2025-06-10T04:17:03,870   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2025-06-10T04:17:03,872   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-10T04:17:03,873   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-10T04:17:03,875   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-10T04:17:03,877   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-10T04:17:03,880   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2025-06-10T04:17:03,881   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-06-10T04:17:03,884   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-06-10T04:17:03,886   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-10T04:17:03,887   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-06-10T04:17:03,889   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-06-10T04:17:03,892   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2025-06-10T04:17:03,893   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-06-10T04:17:03,895   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-06-10T04:17:03,897   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2025-06-10T04:17:03,899   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2025-06-10T04:17:03,900   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-10T04:17:03,902   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-10T04:17:03,904   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-10T04:17:03,907   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2025-06-10T04:17:03,908   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-06-10T04:17:03,910   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-06-10T04:17:03,912   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2025-06-10T04:17:03,913   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-06-10T04:17:03,915   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-06-10T04:17:03,918   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2025-06-10T04:17:03,919   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-10T04:17:03,921   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-10T04:17:03,923   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-10T04:17:03,925   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-10T04:17:03,927   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-10T04:17:03,929   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-10T04:17:03,931   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-10T04:17:03,933   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-10T04:17:03,935   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2025-06-10T04:17:03,936   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-10T04:17:03,938   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-10T04:17:03,940   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-10T04:17:03,942   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-10T04:17:03,944   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-10T04:17:03,947   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-10T04:17:03,948   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-10T04:17:03,950   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-10T04:17:03,952   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-10T04:17:03,954   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-10T04:17:03,956   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-10T04:17:03,958   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-10T04:17:03,960   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-10T04:17:03,962   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-10T04:17:03,965   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2025-06-10T04:17:03,966   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-10T04:17:03,968   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-10T04:17:03,970   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-10T04:17:03,972   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-10T04:17:03,974   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-10T04:17:03,976   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2025-06-10T04:17:03,978   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2025-06-10T04:17:03,979   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-10T04:17:03,981   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-10T04:17:03,982   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-10T04:17:03,984   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-10T04:17:03,986   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-10T04:17:03,988   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-10T04:17:03,990   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-10T04:17:03,992   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-10T04:17:03,994   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-10T04:17:03,996   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-10T04:17:03,997   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-10T04:17:03,999   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-10T04:17:04,001   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-10T04:17:04,003   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-10T04:17:04,005   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-10T04:17:04,007   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-10T04:17:04,009   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-06-10T04:17:04,011   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-10T04:17:04,012   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-10T04:17:04,014   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-10T04:17:04,016   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-10T04:17:04,018   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-10T04:17:04,020   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-10T04:17:04,022   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-10T04:17:04,023   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-10T04:17:04,025   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-10T04:17:04,028   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-10T04:17:04,029   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-10T04:17:04,032   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-10T04:17:04,033   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-10T04:17:04,036   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-10T04:17:04,038   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-10T04:17:04,039   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-10T04:17:04,041   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-10T04:17:04,043   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-10T04:17:04,046   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-10T04:17:04,047   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-10T04:17:04,049   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-10T04:17:04,051   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-10T04:17:04,053   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-10T04:17:04,055   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-10T04:17:04,057   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-10T04:17:04,059   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-10T04:17:04,060   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-10T04:17:04,062   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-10T04:17:04,064   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-10T04:17:04,066   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-10T04:17:04,069   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:17:04,070   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:17:04,072   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:17:04,074   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:17:04,076   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:17:04,078   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:17:04,080   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:17:04,082   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:17:04,084   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-10T04:17:04,087   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-10T04:17:04,088   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-10T04:17:04,090   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-10T04:17:04,092   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-10T04:17:04,094   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-10T04:17:04,097   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-10T04:17:04,098   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-10T04:17:04,100   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-06-10T04:17:04,103   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2025-06-10T04:17:04,104   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-10T04:17:04,107   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-10T04:17:04,109   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-10T04:17:04,111   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-10T04:17:04,114   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-10T04:17:04,116   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-06-10T04:17:04,119   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2025-06-10T04:17:04,121   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-10T04:17:04,122   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-10T04:17:04,124   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-10T04:17:04,126   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-10T04:17:04,128   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-10T04:17:04,130   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-10T04:17:04,132   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-10T04:17:04,134   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-10T04:17:04,137   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:17:04,138   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:17:04,141   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:17:04,143   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:17:04,145   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:17:04,147   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:17:04,149   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:17:04,151   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:17:04,154   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-10T04:17:04,156   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-10T04:17:04,157   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-10T04:17:04,160   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:04,161   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:04,164   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:04,166   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:04,168   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:04,171   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:04,173   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:04,175   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:04,178   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:04,180   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-10T04:17:04,182   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-10T04:17:04,185   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-10T04:17:04,188   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-10T04:17:04,190   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-10T04:17:04,193   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-10T04:17:04,196   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-06-10T04:17:04,198   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-10T04:17:04,199   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-10T04:17:04,202   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-10T04:17:04,204   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-10T04:17:04,206   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-10T04:17:04,208   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-10T04:17:04,211   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-06-10T04:17:04,213   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-10T04:17:04,215   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-10T04:17:04,217   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-10T04:17:04,220   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-10T04:17:04,222   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-10T04:17:04,224   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-10T04:17:04,226   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-10T04:17:04,228   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-10T04:17:04,230   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-10T04:17:04,233   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-10T04:17:04,235   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-10T04:17:04,237   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-06-10T04:17:04,240   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-10T04:17:04,241   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-06-10T04:17:04,244   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-10T04:17:04,245   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-10T04:17:04,248   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-10T04:17:04,250   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-10T04:17:04,251   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-10T04:17:04,253   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-10T04:17:04,256   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-10T04:17:04,257   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-10T04:17:04,260   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-10T04:17:04,262   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-10T04:17:04,264   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-10T04:17:04,266   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-10T04:17:04,268   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-10T04:17:04,271   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-06-10T04:17:04,273   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-10T04:17:04,274   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-10T04:17:04,276   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-10T04:17:04,279   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2025-06-10T04:17:04,280   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-10T04:17:04,283   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-10T04:17:04,286   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-10T04:17:04,287   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-10T04:17:04,289   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-10T04:17:04,291   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-10T04:17:04,293   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-10T04:17:04,296   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2025-06-10T04:17:04,297   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-10T04:17:04,300   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-10T04:17:04,302   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-10T04:17:04,304   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-10T04:17:04,307   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-10T04:17:04,308   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-10T04:17:04,311   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-10T04:17:04,313   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-10T04:17:04,314   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-10T04:17:04,317   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2025-06-10T04:17:04,318   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-10T04:17:04,320   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-10T04:17:04,322   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-10T04:17:04,324   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-10T04:17:04,327   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2025-06-10T04:17:04,328   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-10T04:17:04,331   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-10T04:17:04,334   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-10T04:17:04,336   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-10T04:17:04,339   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:17:04,340   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:17:04,343   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:17:04,345   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:17:04,348   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:17:04,350   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:17:04,353   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:17:04,356   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:17:04,361   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:17:04,365   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-10T04:17:04,372   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-10T04:17:04,376   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-10T04:17:04,380   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-10T04:17:04,383   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2025-06-10T04:17:04,384   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-10T04:17:04,386   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-10T04:17:04,388   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-10T04:17:04,390   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-10T04:17:04,392   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-10T04:17:04,395   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:17:04,396   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:17:04,399   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:17:04,400   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:17:04,403   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:17:04,405   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:17:04,407   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:17:04,409   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:17:04,411   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:17:04,413   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-10T04:17:04,415   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2025-06-10T04:17:04,417   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-10T04:17:04,419   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-10T04:17:04,421   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-10T04:17:04,423   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-10T04:17:04,426   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-10T04:17:04,427   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-10T04:17:04,430   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-10T04:17:04,431   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-10T04:17:04,434   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-10T04:17:04,436   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2025-06-10T04:17:04,437   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-10T04:17:04,440   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-10T04:17:04,442   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-10T04:17:04,444   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-10T04:17:04,447   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2025-06-10T04:17:04,448   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-10T04:17:04,450   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-10T04:17:04,452   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-10T04:17:04,454   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-10T04:17:04,456   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-10T04:17:04,459   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-10T04:17:04,461   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-10T04:17:04,463   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-10T04:17:04,465   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-10T04:17:04,468   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2025-06-10T04:17:04,469   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-10T04:17:04,471   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-10T04:17:04,474   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2025-06-10T04:17:04,475   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2025-06-10T04:17:04,478   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2025-06-10T04:17:04,479   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-06-10T04:17:04,481   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-06-10T04:17:04,482   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-10T04:17:04,484   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-10T04:17:04,487   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-10T04:17:04,488   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-10T04:17:04,491   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-10T04:17:04,493   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-10T04:17:04,496   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-10T04:17:04,498   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-10T04:17:04,501   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2025-06-10T04:17:04,503   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-10T04:17:04,505   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-10T04:17:04,508   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-10T04:17:04,510   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-10T04:17:04,512   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-10T04:17:04,515   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2025-06-10T04:17:04,516   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-10T04:17:04,518   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-10T04:17:04,521   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-10T04:17:04,523   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-10T04:17:04,525   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-10T04:17:04,528   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-10T04:17:04,531   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2025-06-10T04:17:04,532   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-10T04:17:04,534   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-10T04:17:04,538   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-10T04:17:04,540   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-10T04:17:04,542   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-10T04:17:04,544   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-10T04:17:04,547   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2025-06-10T04:17:04,548   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-10T04:17:04,550   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-10T04:17:04,552   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-10T04:17:04,555   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-10T04:17:04,557   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-10T04:17:04,559   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-10T04:17:04,562   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2025-06-10T04:17:04,563   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-10T04:17:04,565   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-10T04:17:04,566   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-10T04:17:04,568   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-10T04:17:04,571   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2025-06-10T04:17:04,572   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-10T04:17:04,574   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-10T04:17:04,577   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-10T04:17:04,579   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-10T04:17:04,581   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-10T04:17:04,583   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-10T04:17:04,586   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2025-06-10T04:17:04,587   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-10T04:17:04,589   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-10T04:17:04,592   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-10T04:17:04,594   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-10T04:17:04,596   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-10T04:17:04,598   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-10T04:17:04,602   creating build/bdist.linux-armv7l/wheel/deepspeed/nvme
2025-06-10T04:17:04,603   copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-10T04:17:04,605   copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-10T04:17:04,607   copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-10T04:17:04,609   copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-10T04:17:04,611   copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-10T04:17:04,613   copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-10T04:17:04,615   copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-10T04:17:04,617   copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-10T04:17:04,619   copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-10T04:17:04,621   copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-10T04:17:04,623   copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-10T04:17:04,625   copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-10T04:17:04,628   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2025-06-10T04:17:04,629   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-10T04:17:04,632   copying build/lib/deepspeed/accelerator/sdaa_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-10T04:17:04,635   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-10T04:17:04,637   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-10T04:17:04,639   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-10T04:17:04,642   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-10T04:17:04,644   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-10T04:17:04,647   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-10T04:17:04,649   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-10T04:17:04,651   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-10T04:17:04,653   copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-10T04:17:04,657   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2025-06-10T04:17:04,658   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2025-06-10T04:17:04,660   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-10T04:17:04,663   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-10T04:17:04,665   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-10T04:17:04,667   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-10T04:17:04,669   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2025-06-10T04:17:04,671   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2025-06-10T04:17:04,672   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-10T04:17:04,675   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-10T04:17:04,677   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-10T04:17:04,679   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-10T04:17:04,682   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-10T04:17:04,685   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-10T04:17:04,687   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-10T04:17:04,690   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-10T04:17:04,692   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,695   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,698   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/sequence_parallel
2025-06-10T04:17:04,699   copying build/lib/deepspeed/runtime/sequence_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel
2025-06-10T04:17:04,701   copying build/lib/deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel
2025-06-10T04:17:04,705   copying build/lib/deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel
2025-06-10T04:17:04,707   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,710   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2025-06-10T04:17:04,711   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-10T04:17:04,713   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-10T04:17:04,716   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-10T04:17:04,718   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-10T04:17:04,721   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-10T04:17:04,723   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-10T04:17:04,726   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-10T04:17:04,728   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-10T04:17:04,732   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-10T04:17:04,735   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-10T04:17:04,737   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-10T04:17:04,740   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-10T04:17:04,745   copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-10T04:17:04,747   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-10T04:17:04,752   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-10T04:17:04,755   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-10T04:17:04,757   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-10T04:17:04,759   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,761   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,767   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2025-06-10T04:17:04,768   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-10T04:17:04,771   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-10T04:17:04,774   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-10T04:17:04,776   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-10T04:17:04,778   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-10T04:17:04,780   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-10T04:17:04,782   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-10T04:17:04,784   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-10T04:17:04,787   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-10T04:17:04,789   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,792   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino
2025-06-10T04:17:04,793   copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-10T04:17:04,796   copying build/lib/deepspeed/runtime/domino/async_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-10T04:17:04,799   copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-10T04:17:04,801   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,804   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2025-06-10T04:17:04,805   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-10T04:17:04,807   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-10T04:17:04,809   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-10T04:17:04,813   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2025-06-10T04:17:04,814   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2025-06-10T04:17:04,816   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-10T04:17:04,818   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-10T04:17:04,820   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-10T04:17:04,822   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-10T04:17:04,824   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-10T04:17:04,827   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2025-06-10T04:17:04,828   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-10T04:17:04,830   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-10T04:17:04,833   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-10T04:17:04,836   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-10T04:17:04,838   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-10T04:17:04,841   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-10T04:17:04,843   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-10T04:17:04,846   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-10T04:17:04,848   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-10T04:17:04,850   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-10T04:17:04,852   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,854   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,858   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2025-06-10T04:17:04,859   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-06-10T04:17:04,861   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-06-10T04:17:04,863   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,865   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,868   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,869   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,872   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2025-06-10T04:17:04,873   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-10T04:17:04,876   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-10T04:17:04,878   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-10T04:17:04,882   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-10T04:17:04,886   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-10T04:17:04,887   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-10T04:17:04,890   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,892   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,895   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,898   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,901   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/tensor_parallel
2025-06-10T04:17:04,902   copying build/lib/deepspeed/runtime/tensor_parallel/tp_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-10T04:17:04,904   copying build/lib/deepspeed/runtime/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-10T04:17:04,906   copying build/lib/deepspeed/runtime/tensor_parallel/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-10T04:17:04,908   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-10T04:17:04,911   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2025-06-10T04:17:04,912   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-10T04:17:04,914   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-10T04:17:04,917   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-10T04:17:04,919   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-10T04:17:04,922   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-10T04:17:04,924   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-10T04:17:04,927   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-10T04:17:04,929   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2025-06-10T04:17:04,931   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2025-06-10T04:17:04,932   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-06-10T04:17:04,934   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-06-10T04:17:04,938   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2025-06-10T04:17:04,940   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2025-06-10T04:17:04,941   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,943   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,945   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,948   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,950   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,952   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,954   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,956   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,958   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,961   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,963   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,966   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,968   copying build/lib/deepspeed/ops/csrc/includes/deepcompile.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,970   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,972   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,975   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,977   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,979   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,981   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,983   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,985   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,988   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,991   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,993   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,996   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:04,998   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:05,000   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:05,002   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:05,004   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:05,006   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-10T04:17:05,009   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2025-06-10T04:17:05,010   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-06-10T04:17:05,012   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-06-10T04:17:05,015   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2025-06-10T04:17:05,017   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2025-06-10T04:17:05,018   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2025-06-10T04:17:05,021   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2025-06-10T04:17:05,022   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-10T04:17:05,024   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-10T04:17:05,027   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-10T04:17:05,029   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-10T04:17:05,031   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-10T04:17:05,034   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2025-06-10T04:17:05,036   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-10T04:17:05,038   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-10T04:17:05,040   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-10T04:17:05,043   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2025-06-10T04:17:05,044   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2025-06-10T04:17:05,047   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2025-06-10T04:17:05,048   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2025-06-10T04:17:05,051   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2025-06-10T04:17:05,053   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-10T04:17:05,054   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-10T04:17:05,056   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-10T04:17:05,060   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-10T04:17:05,062   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-10T04:17:05,067   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-10T04:17:05,068   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-10T04:17:05,071   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-10T04:17:05,075   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-10T04:17:05,079   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-10T04:17:05,081   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-10T04:17:05,083   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-10T04:17:05,086   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-10T04:17:05,089   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-10T04:17:05,090   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-10T04:17:05,093   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-10T04:17:05,096   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-10T04:17:05,098   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-10T04:17:05,101   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-10T04:17:05,103   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-10T04:17:05,106   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-10T04:17:05,107   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-10T04:17:05,110   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-10T04:17:05,113   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-10T04:17:05,116   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-10T04:17:05,120   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-10T04:17:05,123   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-10T04:17:05,125   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-10T04:17:05,128   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-10T04:17:05,129   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-10T04:17:05,132   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-10T04:17:05,135   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2025-06-10T04:17:05,136   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2025-06-10T04:17:05,137   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-10T04:17:05,140   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-10T04:17:05,142   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-10T04:17:05,144   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-10T04:17:05,146   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-10T04:17:05,148   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-10T04:17:05,151   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,152   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,154   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,157   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,159   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,161   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,164   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,166   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,168   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,170   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,172   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,174   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,176   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,178   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,180   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,183   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,185   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,187   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-10T04:17:05,189   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2025-06-10T04:17:05,191   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2025-06-10T04:17:05,193   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2025-06-10T04:17:05,195   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2025-06-10T04:17:05,196   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-10T04:17:05,199   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-10T04:17:05,201   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-10T04:17:05,204   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-10T04:17:05,206   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-10T04:17:05,208   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-10T04:17:05,210   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2025-06-10T04:17:05,211   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2025-06-10T04:17:05,214   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/compile
2025-06-10T04:17:05,215   copying build/lib/deepspeed/ops/csrc/compile/init.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-10T04:17:05,218   copying build/lib/deepspeed/ops/csrc/compile/z1.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-10T04:17:05,220   copying build/lib/deepspeed/ops/csrc/compile/util.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-10T04:17:05,222   copying build/lib/deepspeed/ops/csrc/compile/z3.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-10T04:17:05,225   copying build/lib/deepspeed/ops/csrc/compile/deepcompile.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-10T04:17:05,227   copying build/lib/deepspeed/ops/csrc/compile/z1.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-10T04:17:05,230   copying build/lib/deepspeed/ops/csrc/compile/z3.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-10T04:17:05,232   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2025-06-10T04:17:05,233   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-10T04:17:05,236   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-10T04:17:05,238   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-10T04:17:05,241   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-10T04:17:05,244   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2025-06-10T04:17:05,245   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2025-06-10T04:17:05,246   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2025-06-10T04:17:05,249   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2025-06-10T04:17:05,250   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-06-10T04:17:05,252   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-06-10T04:17:05,255   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2025-06-10T04:17:05,256   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-10T04:17:05,259   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-10T04:17:05,261   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-10T04:17:05,263   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-10T04:17:05,265   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-10T04:17:05,268   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2025-06-10T04:17:05,269   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2025-06-10T04:17:05,272   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2025-06-10T04:17:05,273   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2025-06-10T04:17:05,276   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2025-06-10T04:17:05,277   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-06-10T04:17:05,280   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-10T04:17:05,281   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-06-10T04:17:05,284   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-06-10T04:17:05,286   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-06-10T04:17:05,289   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2025-06-10T04:17:05,290   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-10T04:17:05,293   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-10T04:17:05,294   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-10T04:17:05,297   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-10T04:17:05,299   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-10T04:17:05,302   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2025-06-10T04:17:05,303   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2025-06-10T04:17:05,305   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2025-06-10T04:17:05,307   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2025-06-10T04:17:05,308   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2025-06-10T04:17:05,311   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2025-06-10T04:17:05,312   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-10T04:17:05,314   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-10T04:17:05,317   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-10T04:17:05,319   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-10T04:17:05,323   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2025-06-10T04:17:05,324   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2025-06-10T04:17:05,326   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2025-06-10T04:17:05,329   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-10T04:17:05,332   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-10T04:17:05,334   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-10T04:17:05,337   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:05,339   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:05,341   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:05,344   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:05,347   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:05,350   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:05,352   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:05,354   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:05,358   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:05,361   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:05,364   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-10T04:17:05,366   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-10T04:17:05,369   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-10T04:17:05,372   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-10T04:17:05,374   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-10T04:17:05,377   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-10T04:17:05,380   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-10T04:17:05,383   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-10T04:17:05,386   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-10T04:17:05,392   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2025-06-10T04:17:05,393   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-10T04:17:05,396   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-10T04:17:05,399   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-10T04:17:05,402   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-10T04:17:05,404   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-10T04:17:05,407   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-10T04:17:05,409   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-10T04:17:05,414   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2025-06-10T04:17:05,415   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-06-10T04:17:05,417   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-06-10T04:17:05,421   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2025-06-10T04:17:05,422   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2025-06-10T04:17:05,424   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2025-06-10T04:17:05,425   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2025-06-10T04:17:05,429   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2025-06-10T04:17:05,430   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,433   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2025-06-10T04:17:05,434   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-10T04:17:05,436   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-10T04:17:05,438   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-10T04:17:05,440   copying build/lib/deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-10T04:17:05,442   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-10T04:17:05,444   copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-10T04:17:05,446   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-10T04:17:05,448   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,450   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,452   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,454   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,456   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,458   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,460   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,462   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,464   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,467   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu
2025-06-10T04:17:05,468   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-10T04:17:05,470   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-10T04:17:05,472   copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-10T04:17:05,474   copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-10T04:17:05,476   copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-10T04:17:05,478   copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-10T04:17:05,481   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2025-06-10T04:17:05,482   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-10T04:17:05,484   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-10T04:17:05,486   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-10T04:17:05,488   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-10T04:17:05,490   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-10T04:17:05,492   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-10T04:17:05,494   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-10T04:17:05,496   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-10T04:17:05,498   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-10T04:17:05,501   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-10T04:17:05,503   copying build/lib/deepspeed/ops/op_builder/dc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,507   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,512   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,517   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,520   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/sdaa
2025-06-10T04:17:05,521   copying build/lib/deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-10T04:17:05,523   copying build/lib/deepspeed/ops/op_builder/sdaa/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-10T04:17:05,525   copying build/lib/deepspeed/ops/op_builder/sdaa/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-10T04:17:05,527   copying build/lib/deepspeed/ops/op_builder/sdaa/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-10T04:17:05,529   copying build/lib/deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-10T04:17:05,532   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,534   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,536   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,539   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,541   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,543   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,545   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,547   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,549   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2025-06-10T04:17:05,551   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-10T04:17:05,553   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-10T04:17:05,554   copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-10T04:17:05,556   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-10T04:17:05,558   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-10T04:17:05,560   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-10T04:17:05,562   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-10T04:17:05,565   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2025-06-10T04:17:05,566   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-10T04:17:05,568   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-10T04:17:05,570   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-10T04:17:05,572   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-10T04:17:05,576   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-10T04:17:05,578   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-10T04:17:05,580   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-10T04:17:05,581   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-10T04:17:05,583   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-10T04:17:05,586   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,588   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,590   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-10T04:17:05,592   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2025-06-10T04:17:05,594   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/compile
2025-06-10T04:17:05,595   copying build/lib/deepspeed/ops/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/compile
2025-06-10T04:17:05,598   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2025-06-10T04:17:05,599   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-06-10T04:17:05,601   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-06-10T04:17:05,604   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2025-06-10T04:17:05,605   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-10T04:17:05,608   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-10T04:17:05,610   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-10T04:17:05,612   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-10T04:17:05,615   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2025-06-10T04:17:05,616   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-06-10T04:17:05,618   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-06-10T04:17:05,621   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2025-06-10T04:17:05,622   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-10T04:17:05,626   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2025-06-10T04:17:05,627   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-10T04:17:05,629   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-10T04:17:05,631   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-10T04:17:05,633   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-10T04:17:05,635   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-10T04:17:05,637   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-10T04:17:05,639   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-10T04:17:05,641   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-10T04:17:05,644   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-10T04:17:05,647   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-10T04:17:05,650   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2025-06-10T04:17:05,651   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-10T04:17:05,653   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-10T04:17:05,655   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-10T04:17:05,657   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-10T04:17:05,660   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2025-06-10T04:17:05,661   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-10T04:17:05,663   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-10T04:17:05,665   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-10T04:17:05,667   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-10T04:17:05,670   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2025-06-10T04:17:05,672   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2025-06-10T04:17:05,673   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-10T04:17:05,675   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-10T04:17:05,678   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-10T04:17:05,681   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,682   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,684   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,686   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,688   copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,690   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,692   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,694   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,696   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,698   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,699   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,701   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,703   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,705   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,707   copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,709   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,711   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,714   copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,716   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,718   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,720   copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,722   copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,724   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,726   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-10T04:17:05,729   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2025-06-10T04:17:05,730   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-10T04:17:05,732   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-10T04:17:05,734   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-10T04:17:05,737   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-10T04:17:05,738   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-10T04:17:05,741   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-10T04:17:05,743   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-10T04:17:05,745   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-10T04:17:05,747   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-10T04:17:05,749   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-10T04:17:05,752   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-10T04:17:05,754   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-10T04:17:05,756   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-10T04:17:05,758   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-10T04:17:05,760   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-10T04:17:05,763   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-10T04:17:05,765   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-10T04:17:05,767   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-06-10T04:17:05,770   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-06-10T04:17:05,772   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2025-06-10T04:17:05,774   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-06-10T04:17:05,776   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-06-10T04:17:05,777   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-10T04:17:05,780   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-10T04:17:05,782   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-10T04:17:05,785   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-10T04:17:05,787   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2025-06-10T04:17:05,788   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-10T04:17:05,791   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-10T04:17:05,792   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-10T04:17:05,794   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-10T04:17:05,796   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-10T04:17:05,800   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-10T04:17:05,803   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-10T04:17:05,805   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-10T04:17:05,807   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-10T04:17:05,809   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-10T04:17:05,811   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-10T04:17:05,814   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-10T04:17:05,816   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-10T04:17:05,819   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2025-06-10T04:17:05,821   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,823   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,825   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,827   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,829   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,831   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,834   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,836   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,839   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,841   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,844   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,846   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,848   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,850   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,852   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,855   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,857   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,859   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,861   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-10T04:17:05,864   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2025-06-10T04:17:05,865   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-10T04:17:05,867   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-10T04:17:05,869   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-10T04:17:05,871   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-10T04:17:05,874   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-10T04:17:05,875   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-10T04:17:05,878   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-10T04:17:05,881   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2025-06-10T04:17:05,882   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,885   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,888   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,890   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,893   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,895   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,898   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,900   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,901   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,904   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,906   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,908   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,910   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,912   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,914   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,916   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,918   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,920   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-10T04:17:05,923   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2025-06-10T04:17:05,924   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-10T04:17:05,926   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-10T04:17:05,929   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-10T04:17:05,931   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-10T04:17:05,934   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-10T04:17:05,936   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-10T04:17:05,937   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-10T04:17:05,940   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-10T04:17:05,942   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-10T04:17:05,944   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-10T04:17:05,947   creating build/bdist.linux-armv7l/wheel/deepspeed/compile
2025-06-10T04:17:05,948   copying build/lib/deepspeed/compile/init_z1.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-10T04:17:05,950   copying build/lib/deepspeed/compile/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-10T04:17:05,953   copying build/lib/deepspeed/compile/util.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-10T04:17:05,956   creating build/bdist.linux-armv7l/wheel/deepspeed/compile/passes
2025-06-10T04:17:05,957   copying build/lib/deepspeed/compile/passes/offload_adam_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-10T04:17:05,960   copying build/lib/deepspeed/compile/passes/offload_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-10T04:17:05,962   copying build/lib/deepspeed/compile/passes/zero1_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-10T04:17:05,964   copying build/lib/deepspeed/compile/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-10T04:17:05,965   copying build/lib/deepspeed/compile/passes/zero3_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-10T04:17:05,968   copying build/lib/deepspeed/compile/passes/prefetch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-10T04:17:05,970   copying build/lib/deepspeed/compile/passes/offload_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-10T04:17:05,972   copying build/lib/deepspeed/compile/passes/selective_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-10T04:17:05,974   copying build/lib/deepspeed/compile/graph_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-10T04:17:05,976   copying build/lib/deepspeed/compile/patch_compiled_func.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-10T04:17:05,978   copying build/lib/deepspeed/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-10T04:17:05,980   copying build/lib/deepspeed/compile/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-10T04:17:05,982   creating build/bdist.linux-armv7l/wheel/deepspeed/compile/profilers
2025-06-10T04:17:05,983   copying build/lib/deepspeed/compile/profilers/graph_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-10T04:17:05,986   copying build/lib/deepspeed/compile/profilers/comm_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-10T04:17:05,988   copying build/lib/deepspeed/compile/profilers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-10T04:17:05,990   copying build/lib/deepspeed/compile/inductor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-10T04:17:05,992   copying build/lib/deepspeed/compile/list_schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-10T04:17:05,995   copying build/lib/deepspeed/compile/patch_fake_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-10T04:17:05,997   copying build/lib/deepspeed/compile/init_z3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-10T04:17:05,998   copying build/lib/deepspeed/compile/partitioner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-10T04:17:06,001   copying build/lib/deepspeed/compile/fx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-10T04:17:06,004   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2025-06-10T04:17:06,005   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-10T04:17:06,007   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-10T04:17:06,010   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-10T04:17:06,012   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-10T04:17:06,014   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-10T04:17:06,016   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-10T04:17:06,019   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-10T04:17:06,022   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-10T04:17:06,025   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2025-06-10T04:17:06,026   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-10T04:17:06,028   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-10T04:17:06,030   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-10T04:17:06,033   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-10T04:17:06,035   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-10T04:17:06,036   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-10T04:17:06,038   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-10T04:17:06,040   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-10T04:17:06,043   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2025-06-10T04:17:06,044   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-10T04:17:06,046   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-10T04:17:06,048   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-10T04:17:06,050   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-10T04:17:06,052   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-10T04:17:06,054   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2025-06-10T04:17:06,055   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2025-06-10T04:17:06,058   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2025-06-10T04:17:06,059   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-10T04:17:06,061   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-10T04:17:06,063   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-10T04:17:06,065   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-10T04:17:06,067   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-10T04:17:06,068   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-10T04:17:06,070   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-10T04:17:06,073   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-10T04:17:06,074   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-10T04:17:06,076   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-10T04:17:06,079   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2025-06-10T04:17:06,080   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-10T04:17:06,082   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-10T04:17:06,084   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-10T04:17:06,086   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2025-06-10T04:17:06,088   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-06-10T04:17:06,090   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-06-10T04:17:06,092   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2025-06-10T04:17:06,093   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-10T04:17:06,095   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2025-06-10T04:17:06,096   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-06-10T04:17:06,099   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-06-10T04:17:06,101   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-10T04:17:06,103   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-10T04:17:06,105   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2025-06-10T04:17:06,106   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-10T04:17:06,108   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-10T04:17:06,110   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-10T04:17:06,113   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2025-06-10T04:17:06,114   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2025-06-10T04:17:06,116   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2025-06-10T04:17:06,117   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-10T04:17:06,119   copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-10T04:17:06,122   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-10T04:17:06,125   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-10T04:17:06,127   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2025-06-10T04:17:06,129   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-10T04:17:06,132   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-10T04:17:06,134   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-10T04:17:06,135   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-10T04:17:06,138   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-10T04:17:06,140   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-10T04:17:06,142   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-10T04:17:06,144   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-10T04:17:06,146   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-10T04:17:06,148   running install_egg_info
2025-06-10T04:17:06,183   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.17.0-py3.11.egg-info
2025-06-10T04:17:06,198   running install_scripts
2025-06-10T04:17:06,199   creating build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts
2025-06-10T04:17:06,201   copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts
2025-06-10T04:17:06,203   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts
2025-06-10T04:17:06,204   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts
2025-06-10T04:17:06,206   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts
2025-06-10T04:17:06,208   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts
2025-06-10T04:17:06,210   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts
2025-06-10T04:17:06,212   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts
2025-06-10T04:17:06,213   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts
2025-06-10T04:17:06,215   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts
2025-06-10T04:17:06,217   copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts
2025-06-10T04:17:06,218   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts/ds_nvme_tune to 755
2025-06-10T04:17:06,219   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts/ds_ssh to 755
2025-06-10T04:17:06,219   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts/ds_bench to 755
2025-06-10T04:17:06,220   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts/deepspeed to 755
2025-06-10T04:17:06,220   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts/ds_elastic to 755
2025-06-10T04:17:06,221   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts/deepspeed.pt to 755
2025-06-10T04:17:06,221   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts/dsr to 755
2025-06-10T04:17:06,222   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts/ds to 755
2025-06-10T04:17:06,223   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts/ds_report to 755
2025-06-10T04:17:06,223   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.data/scripts/ds_io to 755
2025-06-10T04:17:06,237   creating build/bdist.linux-armv7l/wheel/deepspeed-0.17.0.dist-info/WHEEL
2025-06-10T04:17:06,240   creating '/tmp/pip-wheel-nm_qnhmg/deepspeed-0.17.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2025-06-10T04:17:06,244   adding 'deepspeed/__init__.py'
2025-06-10T04:17:06,245   adding 'deepspeed/constants.py'
2025-06-10T04:17:06,247   adding 'deepspeed/env_report.py'
2025-06-10T04:17:06,249   adding 'deepspeed/git_version_info.py'
2025-06-10T04:17:06,250   adding 'deepspeed/git_version_info_installed.py'
2025-06-10T04:17:06,252   adding 'deepspeed/accelerator/__init__.py'
2025-06-10T04:17:06,253   adding 'deepspeed/accelerator/abstract_accelerator.py'
2025-06-10T04:17:06,255   adding 'deepspeed/accelerator/cpu_accelerator.py'
2025-06-10T04:17:06,257   adding 'deepspeed/accelerator/cuda_accelerator.py'
2025-06-10T04:17:06,259   adding 'deepspeed/accelerator/hpu_accelerator.py'
2025-06-10T04:17:06,261   adding 'deepspeed/accelerator/mlu_accelerator.py'
2025-06-10T04:17:06,263   adding 'deepspeed/accelerator/mps_accelerator.py'
2025-06-10T04:17:06,265   adding 'deepspeed/accelerator/npu_accelerator.py'
2025-06-10T04:17:06,266   adding 'deepspeed/accelerator/real_accelerator.py'
2025-06-10T04:17:06,268   adding 'deepspeed/accelerator/sdaa_accelerator.py'
2025-06-10T04:17:06,270   adding 'deepspeed/accelerator/xpu_accelerator.py'
2025-06-10T04:17:06,272   adding 'deepspeed/autotuning/__init__.py'
2025-06-10T04:17:06,278   adding 'deepspeed/autotuning/autotuner.py'
2025-06-10T04:17:06,279   adding 'deepspeed/autotuning/config.py'
2025-06-10T04:17:06,281   adding 'deepspeed/autotuning/constants.py'
2025-06-10T04:17:06,283   adding 'deepspeed/autotuning/scheduler.py'
2025-06-10T04:17:06,285   adding 'deepspeed/autotuning/utils.py'
2025-06-10T04:17:06,287   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2025-06-10T04:17:06,289   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2025-06-10T04:17:06,290   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2025-06-10T04:17:06,291   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2025-06-10T04:17:06,293   adding 'deepspeed/autotuning/tuner/__init__.py'
2025-06-10T04:17:06,294   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2025-06-10T04:17:06,296   adding 'deepspeed/autotuning/tuner/cost_model.py'
2025-06-10T04:17:06,297   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2025-06-10T04:17:06,298   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2025-06-10T04:17:06,300   adding 'deepspeed/autotuning/tuner/utils.py'
2025-06-10T04:17:06,301   adding 'deepspeed/checkpoint/__init__.py'
2025-06-10T04:17:06,303   adding 'deepspeed/checkpoint/constants.py'
2025-06-10T04:17:06,305   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2025-06-10T04:17:06,308   adding 'deepspeed/checkpoint/ds_to_universal.py'
2025-06-10T04:17:06,310   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2025-06-10T04:17:06,311   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2025-06-10T04:17:06,313   adding 'deepspeed/checkpoint/reshape_utils.py'
2025-06-10T04:17:06,314   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2025-06-10T04:17:06,316   adding 'deepspeed/checkpoint/utils.py'
2025-06-10T04:17:06,318   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2025-06-10T04:17:06,320   adding 'deepspeed/comm/__init__.py'
2025-06-10T04:17:06,321   adding 'deepspeed/comm/backend.py'
2025-06-10T04:17:06,323   adding 'deepspeed/comm/ccl.py'
2025-06-10T04:17:06,327   adding 'deepspeed/comm/comm.py'
2025-06-10T04:17:06,328   adding 'deepspeed/comm/config.py'
2025-06-10T04:17:06,330   adding 'deepspeed/comm/constants.py'
2025-06-10T04:17:06,331   adding 'deepspeed/comm/reduce_op.py'
2025-06-10T04:17:06,333   adding 'deepspeed/comm/torch.py'
2025-06-10T04:17:06,335   adding 'deepspeed/comm/utils.py'
2025-06-10T04:17:06,336   adding 'deepspeed/compile/__init__.py'
2025-06-10T04:17:06,338   adding 'deepspeed/compile/backend.py'
2025-06-10T04:17:06,340   adding 'deepspeed/compile/config.py'
2025-06-10T04:17:06,341   adding 'deepspeed/compile/fx.py'
2025-06-10T04:17:06,343   adding 'deepspeed/compile/graph_param.py'
2025-06-10T04:17:06,344   adding 'deepspeed/compile/inductor.py'
2025-06-10T04:17:06,346   adding 'deepspeed/compile/init_z1.py'
2025-06-10T04:17:06,347   adding 'deepspeed/compile/init_z3.py'
2025-06-10T04:17:06,350   adding 'deepspeed/compile/list_schedule.py'
2025-06-10T04:17:06,351   adding 'deepspeed/compile/partitioner.py'
2025-06-10T04:17:06,353   adding 'deepspeed/compile/patch_compiled_func.py'
2025-06-10T04:17:06,354   adding 'deepspeed/compile/patch_fake_tensor.py'
2025-06-10T04:17:06,356   adding 'deepspeed/compile/util.py'
2025-06-10T04:17:06,358   adding 'deepspeed/compile/passes/__init__.py'
2025-06-10T04:17:06,360   adding 'deepspeed/compile/passes/offload_activation.py'
2025-06-10T04:17:06,362   adding 'deepspeed/compile/passes/offload_adam_states.py'
2025-06-10T04:17:06,364   adding 'deepspeed/compile/passes/offload_parameters.py'
2025-06-10T04:17:06,365   adding 'deepspeed/compile/passes/prefetch.py'
2025-06-10T04:17:06,367   adding 'deepspeed/compile/passes/selective_gather.py'
2025-06-10T04:17:06,368   adding 'deepspeed/compile/passes/zero1_compile.py'
2025-06-10T04:17:06,370   adding 'deepspeed/compile/passes/zero3_compile.py'
2025-06-10T04:17:06,372   adding 'deepspeed/compile/profilers/__init__.py'
2025-06-10T04:17:06,373   adding 'deepspeed/compile/profilers/comm_profile.py'
2025-06-10T04:17:06,375   adding 'deepspeed/compile/profilers/graph_profile.py'
2025-06-10T04:17:06,377   adding 'deepspeed/compression/__init__.py'
2025-06-10T04:17:06,380   adding 'deepspeed/compression/basic_layer.py'
2025-06-10T04:17:06,382   adding 'deepspeed/compression/compress.py'
2025-06-10T04:17:06,385   adding 'deepspeed/compression/config.py'
2025-06-10T04:17:06,386   adding 'deepspeed/compression/constants.py'
2025-06-10T04:17:06,388   adding 'deepspeed/compression/helper.py'
2025-06-10T04:17:06,390   adding 'deepspeed/compression/scheduler.py'
2025-06-10T04:17:06,391   adding 'deepspeed/compression/utils.py'
2025-06-10T04:17:06,393   adding 'deepspeed/elasticity/__init__.py'
2025-06-10T04:17:06,394   adding 'deepspeed/elasticity/config.py'
2025-06-10T04:17:06,395   adding 'deepspeed/elasticity/constants.py'
2025-06-10T04:17:06,397   adding 'deepspeed/elasticity/elastic_agent.py'
2025-06-10T04:17:06,399   adding 'deepspeed/elasticity/elasticity.py'
2025-06-10T04:17:06,401   adding 'deepspeed/elasticity/utils.py'
2025-06-10T04:17:06,402   adding 'deepspeed/inference/__init__.py'
2025-06-10T04:17:06,404   adding 'deepspeed/inference/config.py'
2025-06-10T04:17:06,408   adding 'deepspeed/inference/engine.py'
2025-06-10T04:17:06,410   adding 'deepspeed/inference/quantization/__init__.py'
2025-06-10T04:17:06,411   adding 'deepspeed/inference/quantization/layers.py'
2025-06-10T04:17:06,413   adding 'deepspeed/inference/quantization/quantization.py'
2025-06-10T04:17:06,414   adding 'deepspeed/inference/quantization/quantization_context.py'
2025-06-10T04:17:06,416   adding 'deepspeed/inference/quantization/utils.py'
2025-06-10T04:17:06,418   adding 'deepspeed/inference/v2/__init__.py'
2025-06-10T04:17:06,419   adding 'deepspeed/inference/v2/allocator.py'
2025-06-10T04:17:06,420   adding 'deepspeed/inference/v2/config_v2.py'
2025-06-10T04:17:06,422   adding 'deepspeed/inference/v2/engine_factory.py'
2025-06-10T04:17:06,424   adding 'deepspeed/inference/v2/engine_v2.py'
2025-06-10T04:17:06,425   adding 'deepspeed/inference/v2/inference_parameter.py'
2025-06-10T04:17:06,426   adding 'deepspeed/inference/v2/inference_utils.py'
2025-06-10T04:17:06,428   adding 'deepspeed/inference/v2/logging.py'
2025-06-10T04:17:06,429   adding 'deepspeed/inference/v2/scheduling_utils.py'
2025-06-10T04:17:06,431   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2025-06-10T04:17:06,432   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2025-06-10T04:17:06,434   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2025-06-10T04:17:06,435   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2025-06-10T04:17:06,437   adding 'deepspeed/inference/v2/kernels/__init__.py'
2025-06-10T04:17:06,438   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2025-06-10T04:17:06,440   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2025-06-10T04:17:06,441   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2025-06-10T04:17:06,443   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2025-06-10T04:17:06,445   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2025-06-10T04:17:06,446   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2025-06-10T04:17:06,447   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2025-06-10T04:17:06,449   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2025-06-10T04:17:06,451   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2025-06-10T04:17:06,452   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2025-06-10T04:17:06,453   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2025-06-10T04:17:06,455   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2025-06-10T04:17:06,457   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2025-06-10T04:17:06,458   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2025-06-10T04:17:06,460   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2025-06-10T04:17:06,461   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2025-06-10T04:17:06,462   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2025-06-10T04:17:06,463   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2025-06-10T04:17:06,465   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2025-06-10T04:17:06,467   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2025-06-10T04:17:06,468   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2025-06-10T04:17:06,470   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2025-06-10T04:17:06,472   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2025-06-10T04:17:06,473   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2025-06-10T04:17:06,475   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2025-06-10T04:17:06,476   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2025-06-10T04:17:06,478   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2025-06-10T04:17:06,480   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2025-06-10T04:17:06,482   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2025-06-10T04:17:06,483   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2025-06-10T04:17:06,485   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2025-06-10T04:17:06,486   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2025-06-10T04:17:06,488   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2025-06-10T04:17:06,489   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2025-06-10T04:17:06,491   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2025-06-10T04:17:06,493   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2025-06-10T04:17:06,494   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2025-06-10T04:17:06,495   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2025-06-10T04:17:06,497   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2025-06-10T04:17:06,498   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2025-06-10T04:17:06,500   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2025-06-10T04:17:06,501   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2025-06-10T04:17:06,503   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2025-06-10T04:17:06,504   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2025-06-10T04:17:06,506   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2025-06-10T04:17:06,507   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2025-06-10T04:17:06,508   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2025-06-10T04:17:06,510   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2025-06-10T04:17:06,511   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2025-06-10T04:17:06,513   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2025-06-10T04:17:06,515   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2025-06-10T04:17:06,516   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2025-06-10T04:17:06,517   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2025-06-10T04:17:06,519   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2025-06-10T04:17:06,520   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2025-06-10T04:17:06,522   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2025-06-10T04:17:06,523   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2025-06-10T04:17:06,524   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2025-06-10T04:17:06,526   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2025-06-10T04:17:06,527   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2025-06-10T04:17:06,529   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2025-06-10T04:17:06,530   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2025-06-10T04:17:06,532   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2025-06-10T04:17:06,534   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2025-06-10T04:17:06,536   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2025-06-10T04:17:06,539   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2025-06-10T04:17:06,541   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2025-06-10T04:17:06,542   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2025-06-10T04:17:06,544   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2025-06-10T04:17:06,545   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2025-06-10T04:17:06,547   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2025-06-10T04:17:06,548   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2025-06-10T04:17:06,550   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2025-06-10T04:17:06,552   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2025-06-10T04:17:06,553   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2025-06-10T04:17:06,554   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2025-06-10T04:17:06,556   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2025-06-10T04:17:06,557   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2025-06-10T04:17:06,559   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2025-06-10T04:17:06,560   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2025-06-10T04:17:06,561   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2025-06-10T04:17:06,563   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2025-06-10T04:17:06,564   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2025-06-10T04:17:06,566   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2025-06-10T04:17:06,567   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2025-06-10T04:17:06,569   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2025-06-10T04:17:06,571   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2025-06-10T04:17:06,572   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2025-06-10T04:17:06,573   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2025-06-10T04:17:06,575   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2025-06-10T04:17:06,577   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2025-06-10T04:17:06,578   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2025-06-10T04:17:06,580   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2025-06-10T04:17:06,582   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2025-06-10T04:17:06,583   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2025-06-10T04:17:06,584   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2025-06-10T04:17:06,586   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2025-06-10T04:17:06,587   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2025-06-10T04:17:06,589   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2025-06-10T04:17:06,591   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2025-06-10T04:17:06,592   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2025-06-10T04:17:06,593   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2025-06-10T04:17:06,595   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2025-06-10T04:17:06,596   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2025-06-10T04:17:06,598   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2025-06-10T04:17:06,599   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2025-06-10T04:17:06,601   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2025-06-10T04:17:06,602   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2025-06-10T04:17:06,603   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2025-06-10T04:17:06,605   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2025-06-10T04:17:06,606   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2025-06-10T04:17:06,608   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2025-06-10T04:17:06,609   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2025-06-10T04:17:06,610   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2025-06-10T04:17:06,612   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2025-06-10T04:17:06,614   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2025-06-10T04:17:06,615   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2025-06-10T04:17:06,616   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2025-06-10T04:17:06,617   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2025-06-10T04:17:06,619   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2025-06-10T04:17:06,621   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2025-06-10T04:17:06,623   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2025-06-10T04:17:06,625   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2025-06-10T04:17:06,627   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2025-06-10T04:17:06,630   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2025-06-10T04:17:06,633   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2025-06-10T04:17:06,635   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2025-06-10T04:17:06,637   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2025-06-10T04:17:06,638   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2025-06-10T04:17:06,640   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2025-06-10T04:17:06,641   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2025-06-10T04:17:06,642   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2025-06-10T04:17:06,644   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2025-06-10T04:17:06,645   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2025-06-10T04:17:06,646   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2025-06-10T04:17:06,647   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2025-06-10T04:17:06,649   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2025-06-10T04:17:06,650   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2025-06-10T04:17:06,652   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2025-06-10T04:17:06,653   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2025-06-10T04:17:06,655   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2025-06-10T04:17:06,656   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2025-06-10T04:17:06,658   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2025-06-10T04:17:06,660   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2025-06-10T04:17:06,662   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2025-06-10T04:17:06,663   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2025-06-10T04:17:06,664   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2025-06-10T04:17:06,666   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2025-06-10T04:17:06,668   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2025-06-10T04:17:06,669   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2025-06-10T04:17:06,671   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2025-06-10T04:17:06,672   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2025-06-10T04:17:06,674   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2025-06-10T04:17:06,675   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2025-06-10T04:17:06,677   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2025-06-10T04:17:06,678   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2025-06-10T04:17:06,680   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2025-06-10T04:17:06,681   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2025-06-10T04:17:06,683   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2025-06-10T04:17:06,684   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2025-06-10T04:17:06,686   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2025-06-10T04:17:06,687   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2025-06-10T04:17:06,689   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2025-06-10T04:17:06,690   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2025-06-10T04:17:06,692   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2025-06-10T04:17:06,693   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2025-06-10T04:17:06,695   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2025-06-10T04:17:06,696   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2025-06-10T04:17:06,698   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2025-06-10T04:17:06,700   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2025-06-10T04:17:06,701   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2025-06-10T04:17:06,703   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2025-06-10T04:17:06,704   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2025-06-10T04:17:06,706   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2025-06-10T04:17:06,708   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2025-06-10T04:17:06,709   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2025-06-10T04:17:06,711   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2025-06-10T04:17:06,712   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2025-06-10T04:17:06,713   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2025-06-10T04:17:06,715   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2025-06-10T04:17:06,716   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2025-06-10T04:17:06,717   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2025-06-10T04:17:06,719   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2025-06-10T04:17:06,720   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2025-06-10T04:17:06,722   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2025-06-10T04:17:06,723   adding 'deepspeed/inference/v2/modules/__init__.py'
2025-06-10T04:17:06,725   adding 'deepspeed/inference/v2/modules/ds_module.py'
2025-06-10T04:17:06,726   adding 'deepspeed/inference/v2/modules/heuristics.py'
2025-06-10T04:17:06,727   adding 'deepspeed/inference/v2/modules/module_registry.py'
2025-06-10T04:17:06,729   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2025-06-10T04:17:06,730   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2025-06-10T04:17:06,732   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2025-06-10T04:17:06,733   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2025-06-10T04:17:06,734   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2025-06-10T04:17:06,736   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2025-06-10T04:17:06,737   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2025-06-10T04:17:06,739   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2025-06-10T04:17:06,740   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2025-06-10T04:17:06,742   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2025-06-10T04:17:06,744   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2025-06-10T04:17:06,745   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2025-06-10T04:17:06,747   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2025-06-10T04:17:06,748   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2025-06-10T04:17:06,750   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2025-06-10T04:17:06,752   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2025-06-10T04:17:06,754   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2025-06-10T04:17:06,755   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2025-06-10T04:17:06,757   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2025-06-10T04:17:06,758   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2025-06-10T04:17:06,760   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2025-06-10T04:17:06,761   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2025-06-10T04:17:06,763   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2025-06-10T04:17:06,765   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2025-06-10T04:17:06,766   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2025-06-10T04:17:06,768   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2025-06-10T04:17:06,769   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2025-06-10T04:17:06,771   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2025-06-10T04:17:06,772   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2025-06-10T04:17:06,773   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2025-06-10T04:17:06,775   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2025-06-10T04:17:06,776   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2025-06-10T04:17:06,778   adding 'deepspeed/inference/v2/ragged/__init__.py'
2025-06-10T04:17:06,779   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2025-06-10T04:17:06,781   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2025-06-10T04:17:06,782   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2025-06-10T04:17:06,784   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2025-06-10T04:17:06,786   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2025-06-10T04:17:06,788   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2025-06-10T04:17:06,790   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2025-06-10T04:17:06,791   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2025-06-10T04:17:06,793   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2025-06-10T04:17:06,795   adding 'deepspeed/launcher/__init__.py'
2025-06-10T04:17:06,796   adding 'deepspeed/launcher/constants.py'
2025-06-10T04:17:06,798   adding 'deepspeed/launcher/launch.py'
2025-06-10T04:17:06,800   adding 'deepspeed/launcher/launcher_helper.py'
2025-06-10T04:17:06,802   adding 'deepspeed/launcher/multinode_runner.py'
2025-06-10T04:17:06,805   adding 'deepspeed/launcher/runner.py'
2025-06-10T04:17:06,808   adding 'deepspeed/linear/__init__.py'
2025-06-10T04:17:06,809   adding 'deepspeed/linear/config.py'
2025-06-10T04:17:06,810   adding 'deepspeed/linear/context_manager.py'
2025-06-10T04:17:06,812   adding 'deepspeed/linear/optimized_linear.py'
2025-06-10T04:17:06,814   adding 'deepspeed/linear/quantization.py'
2025-06-10T04:17:06,816   adding 'deepspeed/model_implementations/__init__.py'
2025-06-10T04:17:06,817   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2025-06-10T04:17:06,819   adding 'deepspeed/model_implementations/diffusers/unet.py'
2025-06-10T04:17:06,820   adding 'deepspeed/model_implementations/diffusers/vae.py'
2025-06-10T04:17:06,822   adding 'deepspeed/model_implementations/features/__init__.py'
2025-06-10T04:17:06,823   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2025-06-10T04:17:06,825   adding 'deepspeed/model_implementations/transformers/__init__.py'
2025-06-10T04:17:06,826   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2025-06-10T04:17:06,828   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2025-06-10T04:17:06,829   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2025-06-10T04:17:06,830   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2025-06-10T04:17:06,832   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2025-06-10T04:17:06,833   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2025-06-10T04:17:06,834   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2025-06-10T04:17:06,835   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2025-06-10T04:17:06,837   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2025-06-10T04:17:06,839   adding 'deepspeed/module_inject/__init__.py'
2025-06-10T04:17:06,842   adding 'deepspeed/module_inject/auto_tp.py'
2025-06-10T04:17:06,844   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2025-06-10T04:17:06,846   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2025-06-10T04:17:06,847   adding 'deepspeed/module_inject/inject.py'
2025-06-10T04:17:06,851   adding 'deepspeed/module_inject/layers.py'
2025-06-10T04:17:06,853   adding 'deepspeed/module_inject/load_checkpoint.py'
2025-06-10T04:17:06,854   adding 'deepspeed/module_inject/module_quantize.py'
2025-06-10T04:17:06,856   adding 'deepspeed/module_inject/policy.py'
2025-06-10T04:17:06,860   adding 'deepspeed/module_inject/replace_module.py'
2025-06-10T04:17:06,861   adding 'deepspeed/module_inject/replace_policy.py'
2025-06-10T04:17:06,862   adding 'deepspeed/module_inject/tp_shard.py'
2025-06-10T04:17:06,863   adding 'deepspeed/module_inject/utils.py'
2025-06-10T04:17:06,865   adding 'deepspeed/module_inject/containers/__init__.py'
2025-06-10T04:17:06,868   adding 'deepspeed/module_inject/containers/base.py'
2025-06-10T04:17:06,869   adding 'deepspeed/module_inject/containers/base_moe.py'
2025-06-10T04:17:06,871   adding 'deepspeed/module_inject/containers/bert.py'
2025-06-10T04:17:06,872   adding 'deepspeed/module_inject/containers/bloom.py'
2025-06-10T04:17:06,873   adding 'deepspeed/module_inject/containers/clip.py'
2025-06-10T04:17:06,875   adding 'deepspeed/module_inject/containers/distil_bert.py'
2025-06-10T04:17:06,876   adding 'deepspeed/module_inject/containers/gpt2.py'
2025-06-10T04:17:06,878   adding 'deepspeed/module_inject/containers/gptj.py'
2025-06-10T04:17:06,879   adding 'deepspeed/module_inject/containers/gptneo.py'
2025-06-10T04:17:06,881   adding 'deepspeed/module_inject/containers/gptneox.py'
2025-06-10T04:17:06,882   adding 'deepspeed/module_inject/containers/internlm.py'
2025-06-10T04:17:06,884   adding 'deepspeed/module_inject/containers/llama.py'
2025-06-10T04:17:06,885   adding 'deepspeed/module_inject/containers/llama2.py'
2025-06-10T04:17:06,887   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2025-06-10T04:17:06,888   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2025-06-10T04:17:06,890   adding 'deepspeed/module_inject/containers/opt.py'
2025-06-10T04:17:06,891   adding 'deepspeed/module_inject/containers/unet.py'
2025-06-10T04:17:06,892   adding 'deepspeed/module_inject/containers/vae.py'
2025-06-10T04:17:06,894   adding 'deepspeed/module_inject/containers/features/__init__.py'
2025-06-10T04:17:06,896   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2025-06-10T04:17:06,897   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2025-06-10T04:17:06,899   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2025-06-10T04:17:06,900   adding 'deepspeed/module_inject/containers/features/megatron.py'
2025-06-10T04:17:06,901   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2025-06-10T04:17:06,903   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2025-06-10T04:17:06,905   adding 'deepspeed/moe/__init__.py'
2025-06-10T04:17:06,906   adding 'deepspeed/moe/experts.py'
2025-06-10T04:17:06,908   adding 'deepspeed/moe/layer.py'
2025-06-10T04:17:06,909   adding 'deepspeed/moe/mappings.py'
2025-06-10T04:17:06,912   adding 'deepspeed/moe/sharded_moe.py'
2025-06-10T04:17:06,914   adding 'deepspeed/moe/utils.py'
2025-06-10T04:17:06,916   adding 'deepspeed/monitor/__init__.py'
2025-06-10T04:17:06,917   adding 'deepspeed/monitor/comet.py'
2025-06-10T04:17:06,919   adding 'deepspeed/monitor/config.py'
2025-06-10T04:17:06,920   adding 'deepspeed/monitor/csv_monitor.py'
2025-06-10T04:17:06,921   adding 'deepspeed/monitor/monitor.py'
2025-06-10T04:17:06,923   adding 'deepspeed/monitor/tensorboard.py'
2025-06-10T04:17:06,924   adding 'deepspeed/monitor/utils.py'
2025-06-10T04:17:06,925   adding 'deepspeed/monitor/wandb.py'
2025-06-10T04:17:06,927   adding 'deepspeed/nebula/__init__.py'
2025-06-10T04:17:06,928   adding 'deepspeed/nebula/config.py'
2025-06-10T04:17:06,930   adding 'deepspeed/nebula/constants.py'
2025-06-10T04:17:06,931   adding 'deepspeed/nvme/__init__.py'
2025-06-10T04:17:06,933   adding 'deepspeed/nvme/ds_aio_args.py'
2025-06-10T04:17:06,935   adding 'deepspeed/nvme/ds_aio_basic.py'
2025-06-10T04:17:06,936   adding 'deepspeed/nvme/ds_aio_handle.py'
2025-06-10T04:17:06,938   adding 'deepspeed/nvme/ds_aio_job.py'
2025-06-10T04:17:06,939   adding 'deepspeed/nvme/parse_nvme_stats.py'
2025-06-10T04:17:06,940   adding 'deepspeed/nvme/perf_generate_param.py'
2025-06-10T04:17:06,942   adding 'deepspeed/nvme/perf_run_sweep.py'
2025-06-10T04:17:06,943   adding 'deepspeed/nvme/perf_sweep_utils.py'
2025-06-10T04:17:06,944   adding 'deepspeed/nvme/test_ds_aio.py'
2025-06-10T04:17:06,946   adding 'deepspeed/nvme/test_ds_aio_utils.py'
2025-06-10T04:17:06,947   adding 'deepspeed/nvme/validate_async_io.py'
2025-06-10T04:17:06,948   adding 'deepspeed/ops/__init__.py'
2025-06-10T04:17:06,950   adding 'deepspeed/ops/adagrad/__init__.py'
2025-06-10T04:17:06,951   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2025-06-10T04:17:06,953   adding 'deepspeed/ops/adam/__init__.py'
2025-06-10T04:17:06,955   adding 'deepspeed/ops/adam/cpu_adam.py'
2025-06-10T04:17:06,957   adding 'deepspeed/ops/adam/fused_adam.py'
2025-06-10T04:17:06,958   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2025-06-10T04:17:06,960   adding 'deepspeed/ops/aio/__init__.py'
2025-06-10T04:17:06,962   adding 'deepspeed/ops/compile/__init__.py'
2025-06-10T04:17:06,965   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2025-06-10T04:17:06,966   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2025-06-10T04:17:06,968   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2025-06-10T04:17:06,969   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2025-06-10T04:17:06,971   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2025-06-10T04:17:06,972   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2025-06-10T04:17:06,975   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2025-06-10T04:17:06,977   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2025-06-10T04:17:06,978   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2025-06-10T04:17:06,979   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2025-06-10T04:17:06,981   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2025-06-10T04:17:06,982   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2025-06-10T04:17:06,984   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2025-06-10T04:17:06,985   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2025-06-10T04:17:06,987   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2025-06-10T04:17:06,988   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2025-06-10T04:17:06,989   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2025-06-10T04:17:06,991   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2025-06-10T04:17:06,992   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2025-06-10T04:17:06,993   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2025-06-10T04:17:06,995   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2025-06-10T04:17:06,996   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2025-06-10T04:17:06,997   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2025-06-10T04:17:06,998   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2025-06-10T04:17:07,000   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2025-06-10T04:17:07,001   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2025-06-10T04:17:07,003   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2025-06-10T04:17:07,004   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2025-06-10T04:17:07,006   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2025-06-10T04:17:07,008   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2025-06-10T04:17:07,010   adding 'deepspeed/ops/csrc/compile/deepcompile.cpp'
2025-06-10T04:17:07,011   adding 'deepspeed/ops/csrc/compile/init.cpp'
2025-06-10T04:17:07,013   adding 'deepspeed/ops/csrc/compile/util.cpp'
2025-06-10T04:17:07,014   adding 'deepspeed/ops/csrc/compile/z1.cpp'
2025-06-10T04:17:07,015   adding 'deepspeed/ops/csrc/compile/z1.h'
2025-06-10T04:17:07,018   adding 'deepspeed/ops/csrc/compile/z3.cpp'
2025-06-10T04:17:07,019   adding 'deepspeed/ops/csrc/compile/z3.h'
2025-06-10T04:17:07,021   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2025-06-10T04:17:07,024   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2025-06-10T04:17:07,026   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2025-06-10T04:17:07,028   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2025-06-10T04:17:07,029   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2025-06-10T04:17:07,031   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2025-06-10T04:17:07,033   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2025-06-10T04:17:07,035   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2025-06-10T04:17:07,036   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2025-06-10T04:17:07,038   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2025-06-10T04:17:07,046   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2025-06-10T04:17:07,052   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2025-06-10T04:17:07,054   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2025-06-10T04:17:07,057   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2025-06-10T04:17:07,059   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2025-06-10T04:17:07,060   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2025-06-10T04:17:07,062   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2025-06-10T04:17:07,064   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2025-06-10T04:17:07,067   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2025-06-10T04:17:07,070   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2025-06-10T04:17:07,071   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2025-06-10T04:17:07,073   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2025-06-10T04:17:07,081   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2025-06-10T04:17:07,085   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2025-06-10T04:17:07,086   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2025-06-10T04:17:07,090   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2025-06-10T04:17:07,094   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2025-06-10T04:17:07,098   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2025-06-10T04:17:07,100   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2025-06-10T04:17:07,101   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2025-06-10T04:17:07,104   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2025-06-10T04:17:07,105   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2025-06-10T04:17:07,107   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2025-06-10T04:17:07,110   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2025-06-10T04:17:07,112   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2025-06-10T04:17:07,114   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2025-06-10T04:17:07,116   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2025-06-10T04:17:07,118   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2025-06-10T04:17:07,119   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2025-06-10T04:17:07,121   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2025-06-10T04:17:07,122   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2025-06-10T04:17:07,123   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2025-06-10T04:17:07,125   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2025-06-10T04:17:07,127   adding 'deepspeed/ops/csrc/includes/Timer.h'
2025-06-10T04:17:07,128   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2025-06-10T04:17:07,129   adding 'deepspeed/ops/csrc/includes/compat.h'
2025-06-10T04:17:07,130   adding 'deepspeed/ops/csrc/includes/context.h'
2025-06-10T04:17:07,132   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2025-06-10T04:17:07,134   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2025-06-10T04:17:07,135   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2025-06-10T04:17:07,137   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2025-06-10T04:17:07,138   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2025-06-10T04:17:07,140   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2025-06-10T04:17:07,143   adding 'deepspeed/ops/csrc/includes/deepcompile.h'
2025-06-10T04:17:07,145   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2025-06-10T04:17:07,146   adding 'deepspeed/ops/csrc/includes/dropout.h'
2025-06-10T04:17:07,147   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2025-06-10T04:17:07,149   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2025-06-10T04:17:07,150   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2025-06-10T04:17:07,152   adding 'deepspeed/ops/csrc/includes/gelu.h'
2025-06-10T04:17:07,153   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2025-06-10T04:17:07,155   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2025-06-10T04:17:07,157   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2025-06-10T04:17:07,159   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2025-06-10T04:17:07,160   adding 'deepspeed/ops/csrc/includes/quantization.h'
2025-06-10T04:17:07,162   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2025-06-10T04:17:07,164   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2025-06-10T04:17:07,166   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2025-06-10T04:17:07,168   adding 'deepspeed/ops/csrc/includes/simd.h'
2025-06-10T04:17:07,170   adding 'deepspeed/ops/csrc/includes/softmax.h'
2025-06-10T04:17:07,171   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2025-06-10T04:17:07,172   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2025-06-10T04:17:07,174   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2025-06-10T04:17:07,176   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2025-06-10T04:17:07,178   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2025-06-10T04:17:07,180   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2025-06-10T04:17:07,181   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2025-06-10T04:17:07,183   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2025-06-10T04:17:07,184   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2025-06-10T04:17:07,186   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2025-06-10T04:17:07,189   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2025-06-10T04:17:07,191   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2025-06-10T04:17:07,193   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2025-06-10T04:17:07,195   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2025-06-10T04:17:07,197   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2025-06-10T04:17:07,199   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2025-06-10T04:17:07,201   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2025-06-10T04:17:07,203   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2025-06-10T04:17:07,204   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2025-06-10T04:17:07,206   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2025-06-10T04:17:07,208   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2025-06-10T04:17:07,210   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2025-06-10T04:17:07,211   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2025-06-10T04:17:07,213   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2025-06-10T04:17:07,215   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2025-06-10T04:17:07,218   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2025-06-10T04:17:07,222   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2025-06-10T04:17:07,224   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2025-06-10T04:17:07,226   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2025-06-10T04:17:07,230   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2025-06-10T04:17:07,233   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2025-06-10T04:17:07,236   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2025-06-10T04:17:07,239   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2025-06-10T04:17:07,240   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2025-06-10T04:17:07,243   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2025-06-10T04:17:07,245   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2025-06-10T04:17:07,247   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2025-06-10T04:17:07,253   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2025-06-10T04:17:07,254   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2025-06-10T04:17:07,256   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2025-06-10T04:17:07,259   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2025-06-10T04:17:07,262   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2025-06-10T04:17:07,264   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2025-06-10T04:17:07,266   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2025-06-10T04:17:07,268   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2025-06-10T04:17:07,270   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2025-06-10T04:17:07,273   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2025-06-10T04:17:07,274   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2025-06-10T04:17:07,276   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2025-06-10T04:17:07,278   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2025-06-10T04:17:07,280   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2025-06-10T04:17:07,282   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2025-06-10T04:17:07,283   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2025-06-10T04:17:07,285   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2025-06-10T04:17:07,286   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2025-06-10T04:17:07,288   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2025-06-10T04:17:07,290   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2025-06-10T04:17:07,291   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2025-06-10T04:17:07,293   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2025-06-10T04:17:07,295   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2025-06-10T04:17:07,296   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2025-06-10T04:17:07,297   adding 'deepspeed/ops/fp_quantizer/fp8_gemm_triton.py'
2025-06-10T04:17:07,299   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2025-06-10T04:17:07,301   adding 'deepspeed/ops/gds/__init__.py'
2025-06-10T04:17:07,302   adding 'deepspeed/ops/lamb/__init__.py'
2025-06-10T04:17:07,304   adding 'deepspeed/ops/lamb/fused_lamb.py'
2025-06-10T04:17:07,306   adding 'deepspeed/ops/lion/__init__.py'
2025-06-10T04:17:07,307   adding 'deepspeed/ops/lion/cpu_lion.py'
2025-06-10T04:17:07,309   adding 'deepspeed/ops/lion/fused_lion.py'
2025-06-10T04:17:07,310   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2025-06-10T04:17:07,312   adding 'deepspeed/ops/op_builder/__init__.py'
2025-06-10T04:17:07,313   adding 'deepspeed/ops/op_builder/all_ops.py'
2025-06-10T04:17:07,315   adding 'deepspeed/ops/op_builder/async_io.py'
2025-06-10T04:17:07,319   adding 'deepspeed/ops/op_builder/builder.py'
2025-06-10T04:17:07,320   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2025-06-10T04:17:07,321   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2025-06-10T04:17:07,322   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2025-06-10T04:17:07,323   adding 'deepspeed/ops/op_builder/dc.py'
2025-06-10T04:17:07,325   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2025-06-10T04:17:07,326   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2025-06-10T04:17:07,327   adding 'deepspeed/ops/op_builder/fused_adam.py'
2025-06-10T04:17:07,329   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2025-06-10T04:17:07,330   adding 'deepspeed/ops/op_builder/fused_lion.py'
2025-06-10T04:17:07,331   adding 'deepspeed/ops/op_builder/gds.py'
2025-06-10T04:17:07,333   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2025-06-10T04:17:07,334   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2025-06-10T04:17:07,335   adding 'deepspeed/ops/op_builder/quantizer.py'
2025-06-10T04:17:07,337   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2025-06-10T04:17:07,338   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2025-06-10T04:17:07,339   adding 'deepspeed/ops/op_builder/random_ltd.py'
2025-06-10T04:17:07,341   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2025-06-10T04:17:07,342   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2025-06-10T04:17:07,343   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2025-06-10T04:17:07,344   adding 'deepspeed/ops/op_builder/transformer.py'
2025-06-10T04:17:07,346   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2025-06-10T04:17:07,348   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2025-06-10T04:17:07,349   adding 'deepspeed/ops/op_builder/cpu/async_io.py'
2025-06-10T04:17:07,350   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2025-06-10T04:17:07,352   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2025-06-10T04:17:07,353   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2025-06-10T04:17:07,354   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2025-06-10T04:17:07,355   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2025-06-10T04:17:07,357   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2025-06-10T04:17:07,358   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2025-06-10T04:17:07,360   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2025-06-10T04:17:07,361   adding 'deepspeed/ops/op_builder/hpu/fp_quantizer.py'
2025-06-10T04:17:07,362   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2025-06-10T04:17:07,364   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2025-06-10T04:17:07,365   adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py'
2025-06-10T04:17:07,367   adding 'deepspeed/ops/op_builder/mlu/__init__.py'
2025-06-10T04:17:07,368   adding 'deepspeed/ops/op_builder/mlu/builder.py'
2025-06-10T04:17:07,369   adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py'
2025-06-10T04:17:07,371   adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py'
2025-06-10T04:17:07,372   adding 'deepspeed/ops/op_builder/mlu/fused_adam.py'
2025-06-10T04:17:07,373   adding 'deepspeed/ops/op_builder/mlu/no_impl.py'
2025-06-10T04:17:07,375   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2025-06-10T04:17:07,376   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2025-06-10T04:17:07,378   adding 'deepspeed/ops/op_builder/npu/builder.py'
2025-06-10T04:17:07,379   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2025-06-10T04:17:07,380   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2025-06-10T04:17:07,382   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2025-06-10T04:17:07,383   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2025-06-10T04:17:07,385   adding 'deepspeed/ops/op_builder/npu/inference.py'
2025-06-10T04:17:07,386   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2025-06-10T04:17:07,388   adding 'deepspeed/ops/op_builder/sdaa/__init__.py'
2025-06-10T04:17:07,389   adding 'deepspeed/ops/op_builder/sdaa/builder.py'
2025-06-10T04:17:07,390   adding 'deepspeed/ops/op_builder/sdaa/cpu_adam.py'
2025-06-10T04:17:07,392   adding 'deepspeed/ops/op_builder/sdaa/fused_adam.py'
2025-06-10T04:17:07,393   adding 'deepspeed/ops/op_builder/sdaa/no_impl.py'
2025-06-10T04:17:07,395   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2025-06-10T04:17:07,396   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2025-06-10T04:17:07,398   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2025-06-10T04:17:07,399   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2025-06-10T04:17:07,400   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2025-06-10T04:17:07,401   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2025-06-10T04:17:07,403   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2025-06-10T04:17:07,404   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2025-06-10T04:17:07,405   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2025-06-10T04:17:07,407   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2025-06-10T04:17:07,408   adding 'deepspeed/ops/quantizer/__init__.py'
2025-06-10T04:17:07,409   adding 'deepspeed/ops/quantizer/quantizer.py'
2025-06-10T04:17:07,411   adding 'deepspeed/ops/random_ltd/__init__.py'
2025-06-10T04:17:07,413   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2025-06-10T04:17:07,415   adding 'deepspeed/ops/sparse_attention/__init__.py'
2025-06-10T04:17:07,416   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2025-06-10T04:17:07,420   adding 'deepspeed/ops/sparse_attention/matmul.py'
2025-06-10T04:17:07,422   adding 'deepspeed/ops/sparse_attention/softmax.py'
2025-06-10T04:17:07,424   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2025-06-10T04:17:07,425   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2025-06-10T04:17:07,429   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2025-06-10T04:17:07,431   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2025-06-10T04:17:07,432   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2025-06-10T04:17:07,434   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2025-06-10T04:17:07,435   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2025-06-10T04:17:07,437   adding 'deepspeed/ops/transformer/__init__.py'
2025-06-10T04:17:07,439   adding 'deepspeed/ops/transformer/transformer.py'
2025-06-10T04:17:07,441   adding 'deepspeed/ops/transformer/inference/__init__.py'
2025-06-10T04:17:07,442   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2025-06-10T04:17:07,444   adding 'deepspeed/ops/transformer/inference/config.py'
2025-06-10T04:17:07,445   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2025-06-10T04:17:07,447   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2025-06-10T04:17:07,448   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2025-06-10T04:17:07,450   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2025-06-10T04:17:07,452   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2025-06-10T04:17:07,454   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2025-06-10T04:17:07,456   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2025-06-10T04:17:07,458   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2025-06-10T04:17:07,459   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2025-06-10T04:17:07,461   adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py'
2025-06-10T04:17:07,462   adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py'
2025-06-10T04:17:07,463   adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py'
2025-06-10T04:17:07,464   adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py'
2025-06-10T04:17:07,466   adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py'
2025-06-10T04:17:07,467   adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py'
2025-06-10T04:17:07,468   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2025-06-10T04:17:07,470   adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py'
2025-06-10T04:17:07,471   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2025-06-10T04:17:07,472   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2025-06-10T04:17:07,473   adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py'
2025-06-10T04:17:07,474   adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py'
2025-06-10T04:17:07,476   adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py'
2025-06-10T04:17:07,477   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2025-06-10T04:17:07,479   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2025-06-10T04:17:07,480   adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py'
2025-06-10T04:17:07,481   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2025-06-10T04:17:07,483   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2025-06-10T04:17:07,484   adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py'
2025-06-10T04:17:07,485   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2025-06-10T04:17:07,487   adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py'
2025-06-10T04:17:07,489   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2025-06-10T04:17:07,491   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2025-06-10T04:17:07,492   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2025-06-10T04:17:07,494   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2025-06-10T04:17:07,496   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2025-06-10T04:17:07,497   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2025-06-10T04:17:07,499   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2025-06-10T04:17:07,500   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2025-06-10T04:17:07,501   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2025-06-10T04:17:07,503   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2025-06-10T04:17:07,505   adding 'deepspeed/pipe/__init__.py'
2025-06-10T04:17:07,507   adding 'deepspeed/profiling/__init__.py'
2025-06-10T04:17:07,508   adding 'deepspeed/profiling/config.py'
2025-06-10T04:17:07,509   adding 'deepspeed/profiling/constants.py'
2025-06-10T04:17:07,511   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2025-06-10T04:17:07,517   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2025-06-10T04:17:07,519   adding 'deepspeed/runtime/__init__.py'
2025-06-10T04:17:07,520   adding 'deepspeed/runtime/base_optimizer.py'
2025-06-10T04:17:07,523   adding 'deepspeed/runtime/bf16_optimizer.py'
2025-06-10T04:17:07,525   adding 'deepspeed/runtime/compiler.py'
2025-06-10T04:17:07,529   adding 'deepspeed/runtime/config.py'
2025-06-10T04:17:07,531   adding 'deepspeed/runtime/config_utils.py'
2025-06-10T04:17:07,533   adding 'deepspeed/runtime/constants.py'
2025-06-10T04:17:07,535   adding 'deepspeed/runtime/dataloader.py'
2025-06-10T04:17:07,536   adding 'deepspeed/runtime/eigenvalue.py'
2025-06-10T04:17:07,557   adding 'deepspeed/runtime/engine.py'
2025-06-10T04:17:07,560   adding 'deepspeed/runtime/hybrid_engine.py'
2025-06-10T04:17:07,564   adding 'deepspeed/runtime/lr_schedules.py'
2025-06-10T04:17:07,566   adding 'deepspeed/runtime/progressive_layer_drop.py'
2025-06-10T04:17:07,567   adding 'deepspeed/runtime/quantize.py'
2025-06-10T04:17:07,569   adding 'deepspeed/runtime/sparse_tensor.py'
2025-06-10T04:17:07,571   adding 'deepspeed/runtime/state_dict_factory.py'
2025-06-10T04:17:07,576   adding 'deepspeed/runtime/utils.py'
2025-06-10T04:17:07,578   adding 'deepspeed/runtime/weight_quantizer.py'
2025-06-10T04:17:07,580   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2025-06-10T04:17:07,584   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2025-06-10T04:17:07,586   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2025-06-10T04:17:07,588   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2025-06-10T04:17:07,589   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2025-06-10T04:17:07,590   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2025-06-10T04:17:07,591   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2025-06-10T04:17:07,593   adding 'deepspeed/runtime/comm/__init__.py'
2025-06-10T04:17:07,595   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2025-06-10T04:17:07,596   adding 'deepspeed/runtime/comm/compressed.py'
2025-06-10T04:17:07,598   adding 'deepspeed/runtime/comm/hccl.py'
2025-06-10T04:17:07,600   adding 'deepspeed/runtime/comm/mpi.py'
2025-06-10T04:17:07,601   adding 'deepspeed/runtime/comm/nccl.py'
2025-06-10T04:17:07,603   adding 'deepspeed/runtime/compression/__init__.py'
2025-06-10T04:17:07,604   adding 'deepspeed/runtime/compression/cupy.py'
2025-06-10T04:17:07,606   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2025-06-10T04:17:07,607   adding 'deepspeed/runtime/data_pipeline/config.py'
2025-06-10T04:17:07,609   adding 'deepspeed/runtime/data_pipeline/constants.py'
2025-06-10T04:17:07,610   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2025-06-10T04:17:07,612   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2025-06-10T04:17:07,614   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2025-06-10T04:17:07,615   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2025-06-10T04:17:07,616   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2025-06-10T04:17:07,618   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2025-06-10T04:17:07,619   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2025-06-10T04:17:07,625   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2025-06-10T04:17:07,627   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2025-06-10T04:17:07,630   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2025-06-10T04:17:07,632   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2025-06-10T04:17:07,635   adding 'deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py'
2025-06-10T04:17:07,637   adding 'deepspeed/runtime/domino/__init__.py'
2025-06-10T04:17:07,638   adding 'deepspeed/runtime/domino/async_linear.py'
2025-06-10T04:17:07,641   adding 'deepspeed/runtime/domino/transformer.py'
2025-06-10T04:17:07,642   adding 'deepspeed/runtime/fp16/__init__.py'
2025-06-10T04:17:07,645   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2025-06-10T04:17:07,647   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2025-06-10T04:17:07,650   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2025-06-10T04:17:07,652   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2025-06-10T04:17:07,654   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2025-06-10T04:17:07,657   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2025-06-10T04:17:07,659   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2025-06-10T04:17:07,661   adding 'deepspeed/runtime/pipe/__init__.py'
2025-06-10T04:17:07,668   adding 'deepspeed/runtime/pipe/engine.py'
2025-06-10T04:17:07,672   adding 'deepspeed/runtime/pipe/module.py'
2025-06-10T04:17:07,674   adding 'deepspeed/runtime/pipe/p2p.py'
2025-06-10T04:17:07,676   adding 'deepspeed/runtime/pipe/schedule.py'
2025-06-10T04:17:07,679   adding 'deepspeed/runtime/pipe/topology.py'
2025-06-10T04:17:07,681   adding 'deepspeed/runtime/sequence_parallel/__init__.py'
2025-06-10T04:17:07,682   adding 'deepspeed/runtime/sequence_parallel/parallel_state_sp.py'
2025-06-10T04:17:07,689   adding 'deepspeed/runtime/sequence_parallel/ulysses_sp.py'
2025-06-10T04:17:07,691   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2025-06-10T04:17:07,692   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2025-06-10T04:17:07,693   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2025-06-10T04:17:07,695   adding 'deepspeed/runtime/swap_tensor/constants.py'
2025-06-10T04:17:07,697   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2025-06-10T04:17:07,699   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2025-06-10T04:17:07,702   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2025-06-10T04:17:07,703   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2025-06-10T04:17:07,705   adding 'deepspeed/runtime/swap_tensor/utils.py'
2025-06-10T04:17:07,707   adding 'deepspeed/runtime/tensor_parallel/__init__.py'
2025-06-10T04:17:07,708   adding 'deepspeed/runtime/tensor_parallel/config.py'
2025-06-10T04:17:07,710   adding 'deepspeed/runtime/tensor_parallel/tp_manager.py'
2025-06-10T04:17:07,712   adding 'deepspeed/runtime/zero/__init__.py'
2025-06-10T04:17:07,714   adding 'deepspeed/runtime/zero/config.py'
2025-06-10T04:17:07,716   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2025-06-10T04:17:07,717   adding 'deepspeed/runtime/zero/linear.py'
2025-06-10T04:17:07,720   adding 'deepspeed/runtime/zero/mics.py'
2025-06-10T04:17:07,722   adding 'deepspeed/runtime/zero/mics_utils.py'
2025-06-10T04:17:07,723   adding 'deepspeed/runtime/zero/offload_config.py'
2025-06-10T04:17:07,725   adding 'deepspeed/runtime/zero/offload_states.py'
2025-06-10T04:17:07,728   adding 'deepspeed/runtime/zero/parameter_offload.py'
2025-06-10T04:17:07,740   adding 'deepspeed/runtime/zero/partition_parameters.py'
2025-06-10T04:17:07,744   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2025-06-10T04:17:07,746   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2025-06-10T04:17:07,763   adding 'deepspeed/runtime/zero/stage3.py'
2025-06-10T04:17:07,780   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2025-06-10T04:17:07,782   adding 'deepspeed/runtime/zero/test.py'
2025-06-10T04:17:07,784   adding 'deepspeed/runtime/zero/tiling.py'
2025-06-10T04:17:07,786   adding 'deepspeed/runtime/zero/utils.py'
2025-06-10T04:17:07,788   adding 'deepspeed/sequence/__init__.py'
2025-06-10T04:17:07,789   adding 'deepspeed/sequence/cross_entropy.py'
2025-06-10T04:17:07,794   adding 'deepspeed/sequence/fpdt_layer.py'
2025-06-10T04:17:07,797   adding 'deepspeed/sequence/layer.py'
2025-06-10T04:17:07,799   adding 'deepspeed/utils/__init__.py'
2025-06-10T04:17:07,801   adding 'deepspeed/utils/bwc.py'
2025-06-10T04:17:07,802   adding 'deepspeed/utils/comms_logging.py'
2025-06-10T04:17:07,804   adding 'deepspeed/utils/config.py'
2025-06-10T04:17:07,805   adding 'deepspeed/utils/debug.py'
2025-06-10T04:17:07,806   adding 'deepspeed/utils/exceptions.py'
2025-06-10T04:17:07,809   adding 'deepspeed/utils/groups.py'
2025-06-10T04:17:07,811   adding 'deepspeed/utils/init_on_device.py'
2025-06-10T04:17:07,813   adding 'deepspeed/utils/logging.py'
2025-06-10T04:17:07,814   adding 'deepspeed/utils/mixed_precision_linkage.py'
2025-06-10T04:17:07,816   adding 'deepspeed/utils/numa.py'
2025-06-10T04:17:07,817   adding 'deepspeed/utils/nvtx.py'
2025-06-10T04:17:07,819   adding 'deepspeed/utils/tensor_fragment.py'
2025-06-10T04:17:07,821   adding 'deepspeed/utils/timer.py'
2025-06-10T04:17:07,822   adding 'deepspeed/utils/torch.py'
2025-06-10T04:17:07,824   adding 'deepspeed/utils/types.py'
2025-06-10T04:17:07,825   adding 'deepspeed/utils/z3_leaf_module.py'
2025-06-10T04:17:07,829   adding 'deepspeed/utils/zero_to_fp32.py'
2025-06-10T04:17:07,832   adding 'deepspeed-0.17.0.data/scripts/deepspeed'
2025-06-10T04:17:07,833   adding 'deepspeed-0.17.0.data/scripts/deepspeed.pt'
2025-06-10T04:17:07,835   adding 'deepspeed-0.17.0.data/scripts/ds'
2025-06-10T04:17:07,836   adding 'deepspeed-0.17.0.data/scripts/ds_bench'
2025-06-10T04:17:07,837   adding 'deepspeed-0.17.0.data/scripts/ds_elastic'
2025-06-10T04:17:07,838   adding 'deepspeed-0.17.0.data/scripts/ds_io'
2025-06-10T04:17:07,839   adding 'deepspeed-0.17.0.data/scripts/ds_nvme_tune'
2025-06-10T04:17:07,840   adding 'deepspeed-0.17.0.data/scripts/ds_report'
2025-06-10T04:17:07,841   adding 'deepspeed-0.17.0.data/scripts/ds_ssh'
2025-06-10T04:17:07,842   adding 'deepspeed-0.17.0.data/scripts/dsr'
2025-06-10T04:17:07,846   adding 'deepspeed-0.17.0.dist-info/licenses/LICENSE'
2025-06-10T04:17:07,851   adding 'deepspeed-0.17.0.dist-info/METADATA'
2025-06-10T04:17:07,852   adding 'deepspeed-0.17.0.dist-info/WHEEL'
2025-06-10T04:17:07,853   adding 'deepspeed-0.17.0.dist-info/entry_points.txt'
2025-06-10T04:17:07,854   adding 'deepspeed-0.17.0.dist-info/top_level.txt'
2025-06-10T04:17:07,869   adding 'deepspeed-0.17.0.dist-info/RECORD'
2025-06-10T04:17:07,900   removing build/bdist.linux-armv7l/wheel
2025-06-10T04:17:08,133   deepspeed build time = 11.989398956298828 secs
2025-06-10T04:17:08,265   Building wheel for deepspeed (setup.py): finished with status 'done'
2025-06-10T04:17:08,284   Created wheel for deepspeed: filename=deepspeed-0.17.0-py3-none-any.whl size=1661039 sha256=f7797218bb80761d1f3b1827d0ab50254edb3eeb189f8823bd9d02421c965acb
2025-06-10T04:17:08,285   Stored in directory: /tmp/pip-ephem-wheel-cache-6f4sv_77/wheels/e2/2d/57/36002705392ed4f9382a49d48c84ae071c8c162d094c3a45d0
2025-06-10T04:17:08,331 Successfully built deepspeed
2025-06-10T04:17:08,378 Removed build tracker: '/tmp/pip-build-tracker-f4lzw6lh'