2025-11-05T20:36:26,643 Created temporary directory: /tmp/pip-ephem-wheel-cache-xd43ib9a 2025-11-05T20:36:26,646 Created temporary directory: /tmp/pip-build-tracker-wuez3bjp 2025-11-05T20:36:26,646 Initialized build tracking at /tmp/pip-build-tracker-wuez3bjp 2025-11-05T20:36:26,647 Created build tracker: /tmp/pip-build-tracker-wuez3bjp 2025-11-05T20:36:26,648 Entered build tracker: /tmp/pip-build-tracker-wuez3bjp 2025-11-05T20:36:26,649 Created temporary directory: /tmp/pip-wheel-fgqpc9gg 2025-11-05T20:36:26,653 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-11-05T20:36:26,657 Created temporary directory: /tmp/pip-ephem-wheel-cache-9c4lff35 2025-11-05T20:36:26,692 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-11-05T20:36:26,697 2 location(s) to search for versions of deepspeed: 2025-11-05T20:36:26,697 * https://pypi.org/simple/deepspeed/ 2025-11-05T20:36:26,697 * https://www.piwheels.org/simple/deepspeed/ 2025-11-05T20:36:26,698 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2025-11-05T20:36:26,699 Getting page https://pypi.org/simple/deepspeed/ 2025-11-05T20:36:26,701 Found index url https://pypi.org/simple 2025-11-05T20:36:26,867 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2025-11-05T20:36:26,891 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-11-05T20:36:26,892 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2025-11-05T20:36:26,892 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-11-05T20:36:26,893 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2025-11-05T20:36:26,894 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-11-05T20:36:26,895 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2025-11-05T20:36:26,895 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-11-05T20:36:26,896 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2025-11-05T20:36:26,897 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-11-05T20:36:26,898 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2025-11-05T20:36:26,898 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2025-11-05T20:36:26,899 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2025-11-05T20:36:26,900 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2025-11-05T20:36:26,901 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2025-11-05T20:36:26,901 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2025-11-05T20:36:26,902 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2025-11-05T20:36:26,903 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2025-11-05T20:36:26,904 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2025-11-05T20:36:26,905 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2025-11-05T20:36:26,905 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2025-11-05T20:36:26,906 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2025-11-05T20:36:26,907 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2025-11-05T20:36:26,907 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2025-11-05T20:36:26,908 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2025-11-05T20:36:26,909 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2025-11-05T20:36:26,909 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2025-11-05T20:36:26,910 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2025-11-05T20:36:26,911 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2025-11-05T20:36:26,911 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2025-11-05T20:36:26,912 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2025-11-05T20:36:26,913 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2025-11-05T20:36:26,913 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2025-11-05T20:36:26,914 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2025-11-05T20:36:26,915 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2025-11-05T20:36:26,915 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2025-11-05T20:36:26,916 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2025-11-05T20:36:26,916 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2025-11-05T20:36:26,917 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2025-11-05T20:36:26,918 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2025-11-05T20:36:26,919 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2025-11-05T20:36:26,920 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2025-11-05T20:36:26,920 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2025-11-05T20:36:26,921 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2025-11-05T20:36:26,922 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2025-11-05T20:36:26,922 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2025-11-05T20:36:26,923 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2025-11-05T20:36:26,924 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2025-11-05T20:36:26,925 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2025-11-05T20:36:26,925 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2025-11-05T20:36:26,926 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2025-11-05T20:36:26,926 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2025-11-05T20:36:26,927 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2025-11-05T20:36:26,928 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2025-11-05T20:36:26,928 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2025-11-05T20:36:26,929 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2025-11-05T20:36:26,930 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2025-11-05T20:36:26,930 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2025-11-05T20:36:26,931 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2025-11-05T20:36:26,932 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2025-11-05T20:36:26,933 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2025-11-05T20:36:26,934 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2025-11-05T20:36:26,934 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2025-11-05T20:36:26,935 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2025-11-05T20:36:26,936 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2025-11-05T20:36:26,936 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2025-11-05T20:36:26,937 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2025-11-05T20:36:26,938 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2025-11-05T20:36:26,939 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2025-11-05T20:36:26,940 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2025-11-05T20:36:26,940 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2025-11-05T20:36:26,941 Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5 2025-11-05T20:36:26,942 Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0 2025-11-05T20:36:26,942 Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1 2025-11-05T20:36:26,943 Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2 2025-11-05T20:36:26,944 Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3 2025-11-05T20:36:26,945 Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0 2025-11-05T20:36:26,946 Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1 2025-11-05T20:36:26,947 Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2 2025-11-05T20:36:26,948 Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0 2025-11-05T20:36:26,949 Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1 2025-11-05T20:36:26,950 Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2 2025-11-05T20:36:26,950 Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3 2025-11-05T20:36:26,951 Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4 2025-11-05T20:36:26,952 Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5 2025-11-05T20:36:26,953 Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6 2025-11-05T20:36:26,953 Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0 2025-11-05T20:36:26,954 Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1 2025-11-05T20:36:26,954 Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2 2025-11-05T20:36:26,955 Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3 2025-11-05T20:36:26,956 Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4 2025-11-05T20:36:26,956 Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5 2025-11-05T20:36:26,957 Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0 2025-11-05T20:36:26,958 Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1 2025-11-05T20:36:26,959 Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2 2025-11-05T20:36:26,959 Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3 2025-11-05T20:36:26,960 Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4 2025-11-05T20:36:26,961 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-11-05T20:36:26,962 Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5 2025-11-05T20:36:26,963 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-11-05T20:36:26,964 Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0 2025-11-05T20:36:26,965 Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1 2025-11-05T20:36:26,967 Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2 2025-11-05T20:36:26,968 Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3 2025-11-05T20:36:26,969 Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4 2025-11-05T20:36:26,970 Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0 2025-11-05T20:36:26,971 Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1 2025-11-05T20:36:26,972 Found link https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.2 2025-11-05T20:36:26,973 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/52/23/cfe2166f06f1817b73b8695addd2fded55f4189322bcf181cfb7feaba550/deepspeed-0.16.3-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-11-05T20:36:26,974 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/ce/92/853de2a32b3f9c0945e0c9e145eddac98e570c1faebcd58aa85e6dcd89ba/deepspeed-0.16.3-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-11-05T20:36:26,974 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/55/8f/57ee424e114478a667c604b2f3f05bbc1addc0afc089b9ab6a64b233063d/deepspeed-0.16.3-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-11-05T20:36:26,975 Found link https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.3 2025-11-05T20:36:26,976 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/3d/65/1a6394f5d6dee851e9ea59e385f6d6428e3bfe36f83c06e0336e14dcfd11/deepspeed-0.16.4-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-11-05T20:36:26,977 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a3/aa/bb67b63cc25c5e29e4ca3f8b155e0faf74d5a33acf2ec67e249206a36b0f/deepspeed-0.16.4-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-11-05T20:36:26,977 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d4/59/fd251661b78b049eed7ee46f0d8d51c69ae7fbb710716a1ebcc796a6b0fd/deepspeed-0.16.4-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-11-05T20:36:26,978 Found link https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.4 2025-11-05T20:36:26,979 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/15/b0/be6cc74fd1e23da20d6c34db923858a8ae5017d39a13dedc188a935c646a/deepspeed-0.16.5-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-11-05T20:36:26,980 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/0b/78/9a87d137f83f53dd57f425ac174723c746c53029bf6cdce22eb9e805e3f0/deepspeed-0.16.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-11-05T20:36:26,981 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/80/f8/a9b1fca237fe8ea25f866956778280d0b735350f29fb6f4e0b548aa02a5f/deepspeed-0.16.5-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-11-05T20:36:26,982 Found link https://files.pythonhosted.org/packages/0d/88/96569b2acb3219c9c72068f9b952c59beffe366e7d1edd9e922e5c68f08b/deepspeed-0.16.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.5 2025-11-05T20:36:26,983 Found link https://files.pythonhosted.org/packages/cb/a3/1d758fcbcdb3f5ecf4e71907e293f17bae8a9f448b112e65c6195e90c2d3/deepspeed-0.16.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.6 2025-11-05T20:36:26,984 Found link https://files.pythonhosted.org/packages/06/b3/a3903de5c5b707170c5c27e1a40f4ef613f14d241bd84d8b151a2a8786f6/deepspeed-0.16.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.7 2025-11-05T20:36:26,985 Found link https://files.pythonhosted.org/packages/e1/27/f857569546dc97f64169df1cc35d1ec5161766c4a0ec32f2af5d39614a51/deepspeed-0.16.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.8 2025-11-05T20:36:26,986 Found link https://files.pythonhosted.org/packages/4f/5c/7542904cddfaa50a9a7ae6770349d468773359f5af1718865452cea8729d/deepspeed-0.16.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.9 2025-11-05T20:36:26,988 Found link https://files.pythonhosted.org/packages/1e/35/eef570f4da4a39d0e7f2e72757295fdba3718a8eca60d8d6dcfeb9e6f26d/deepspeed-0.17.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.0 2025-11-05T20:36:26,989 Found link https://files.pythonhosted.org/packages/38/10/a7f63e086c1e1c12e290c98363c748ef5ddd6313fde739d2aeccd5ed0cd4/deepspeed-0.17.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.1 2025-11-05T20:36:26,990 Found link https://files.pythonhosted.org/packages/8c/45/1ddcf8f8500d90fad9f3396bfb1295462d46a747ddcbfafcd7714d46827e/deepspeed-0.17.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.2 2025-11-05T20:36:26,992 Found link https://files.pythonhosted.org/packages/9e/6b/89faa30a38405cd2d7a81790b262673ca4c8e8ec97c2f8c433da04d7a002/deepspeed-0.17.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.3 2025-11-05T20:36:26,993 Found link https://files.pythonhosted.org/packages/84/b3/02d000bfd0d6f0ba3f5dac487e4151b3e9b4b3ee71336882102dc9ad79ad/deepspeed-0.17.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.4 2025-11-05T20:36:26,995 Found link https://files.pythonhosted.org/packages/46/e7/bc1e5868d85cb8e21c43915023e462b9a147f739f26d8584e3c46771ec67/deepspeed-0.17.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.5 2025-11-05T20:36:26,996 Found link https://files.pythonhosted.org/packages/d4/a9/6130c78d84980ed636092be1a262d6429d539105724e675b6f65ef74a05e/deepspeed-0.17.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.6 2025-11-05T20:36:26,998 Found link https://files.pythonhosted.org/packages/95/e8/77fbbbb0fa0549f0fec68bfef7ba835ccd80d5001a9dde69f6ede9211d7b/deepspeed-0.18.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.0 2025-11-05T20:36:26,999 Found link https://files.pythonhosted.org/packages/2a/d7/79f3e4b1316891299152e29b2a905b3fbb0e4efa24f0e848ff9c28a9343a/deepspeed-0.18.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.1 2025-11-05T20:36:27,001 Found link https://files.pythonhosted.org/packages/74/cd/c4cdcc947db3d1f103223b2067e455710c5674acdff249289bc3c0501ecf/deepspeed-0.18.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.2 2025-11-05T20:36:27,003 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2025-11-05T20:36:27,006 Getting page https://www.piwheels.org/simple/deepspeed/ 2025-11-05T20:36:27,009 Found index url https://www.piwheels.org/simple 2025-11-05T20:36:27,296 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2025-11-05T20:36:27,320 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.18.1-py3-none-any.whl#sha256=5b86199df0324c59913dc827c8771d0942a2b1804f8c9d92e08358308adb31f7 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,321 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.18.0-py3-none-any.whl#sha256=3806dbea5c2f5799704a24d865cc115c4144608ad04994b8096a3cfd085e52d3 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,321 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.17.6-py3-none-any.whl#sha256=6142b8dbad6e01ce0890830a65ca1c102f2bf8216edcca0ba86b7c81febd2754 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,322 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.17.5-py3-none-any.whl#sha256=2fcd7e824802bae8190b39577b346f58a20cba5bd72a63f4fd6a8d9b7ef8e498 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,322 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.4-py3-none-any.whl#sha256=b1edf8e83c0a6ebc2db69bde686b7a07864f60f5960b31b794b4a1676f3cea11 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,323 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.3-py3-none-any.whl#sha256=3a1f3c5148ccffdb4f7b2663159aa9f4b400b1705731ae98b26ae9469875a138 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,323 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.2-py3-none-any.whl#sha256=009db2687461691ee6dd5edfc2ed43c0196c6413460b1975e27cba0386a9057e (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,324 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.1-py3-none-any.whl#sha256=317c4287d7bc03d677f5153dbc7225b5f6920c800dbbf1714eb61e2a5495b2b1 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,324 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.0-py3-none-any.whl#sha256=f7797218bb80761d1f3b1827d0ab50254edb3eeb189f8823bd9d02421c965acb (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,325 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.9-py3-none-any.whl#sha256=92e997f08ef2dfe72ce84292b8747f4dee177f80704f7a7191712a35da9cd095 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,326 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.8-py3-none-any.whl#sha256=a9a578ecf810f68bb8113342e3cfd5cfddaeadb101f9c1241dae35ed1078f6b3 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,326 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.7-py3-none-any.whl#sha256=390b2019766f00b87f17ec77236c987f6852ba1ee233be5b1a2a330f50fcf246 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,327 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.6-py3-none-any.whl#sha256=af190f747f3e6a5537f0bbfb35b97d076f3d15e240e1800404dd193133843e1d (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,327 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.5-py3-none-any.whl#sha256=b65b62a7d371ef56c8cd0c38c09ad930ab3a2441eb27d9e7636dfea16d4bf6fc (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,328 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.4-py3-none-any.whl#sha256=f7e7f46731a9413aa0993e9ee9416b6a9855dffe584e16f0bbd4194a018748b2 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,329 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.3-py3-none-any.whl#sha256=054c0fa6b98d59faf0968749e9d119504df57dd8334791a44ecb60427ea29b4a (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,330 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.2-py3-none-any.whl#sha256=6cabfff7c8a552345ac3b9fbcc500f4465315c7650be5b5f7e3009539cbabd73 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,330 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.1-py3-none-any.whl#sha256=45cadca45ee75892b02c00b75da09cd965b62e17a660bca28dcb1bcbc400fc7f (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,331 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.0-py3-none-any.whl#sha256=21568f469c01b32303030bf470a2d8bc65df4f428bf96f73c9d85be6b0b9fac4 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,331 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.4-py3-none-any.whl#sha256=d01cb59961fa1b3eb47d6b5035f4a925d418b537f005094898ad48678170a378 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,332 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.3-py3-none-any.whl#sha256=ac1d6ef48f043e3e1858cf241195baf309d54215928b0322ca299679e7794bc8 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,332 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.2-py3-none-any.whl#sha256=16ea51d88f40735af0a091c9c35469be928a90803f396d6fd6dc0ff8a49add7e (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,333 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.1-py3-none-any.whl#sha256=8bca1a074d792f19189c2b1b8b8c9962858ce647bc47f35bff3d87b5ee95a598 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,333 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.0-py3-none-any.whl#sha256=e2d59c9f87cb64d1319e530f7b1098888cd22efd72cbc53a63869967507e2cda (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,334 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.5-py3-none-any.whl#sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,335 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,336 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,336 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,337 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,337 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,338 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,339 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,339 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,340 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,340 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,341 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,341 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,342 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,342 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,343 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,344 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,344 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,345 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,345 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,346 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,347 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,347 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,348 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,348 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,349 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,349 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,350 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,350 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,351 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,352 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,352 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,353 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,353 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,354 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,355 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,356 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,356 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,357 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,357 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,358 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,358 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,359 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,359 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,360 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,361 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,361 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,362 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,363 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,363 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,364 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,364 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,365 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,365 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,366 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,366 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,367 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,367 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,368 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,368 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,369 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,370 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,370 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,371 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,371 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,372 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,373 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2025-11-05T20:36:27,373 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2025-11-05T20:36:27,374 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2025-11-05T20:36:27,407 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2025-11-05T20:36:27,426 Collecting deepspeed==0.18.2 2025-11-05T20:36:27,429 Created temporary directory: /tmp/pip-unpack-j9p0morp 2025-11-05T20:36:27,655 Downloading deepspeed-0.18.2.tar.gz (1.6 MB) 2025-11-05T20:36:33,304 Added deepspeed==0.18.2 from https://files.pythonhosted.org/packages/74/cd/c4cdcc947db3d1f103223b2067e455710c5674acdff249289bc3c0501ecf/deepspeed-0.18.2.tar.gz to build tracker '/tmp/pip-build-tracker-wuez3bjp' 2025-11-05T20:36:33,306 Running setup.py (path:/tmp/pip-wheel-fgqpc9gg/deepspeed_e56ff6ffa4ec4023b59aefb6313f136c/setup.py) egg_info for package deepspeed 2025-11-05T20:36:33,307 Created temporary directory: /tmp/pip-pip-egg-info-1jvjihy9 2025-11-05T20:36:33,308 Preparing metadata (setup.py): started 2025-11-05T20:36:33,309 Running command python setup.py egg_info 2025-11-05T20:36:34,381 fatal: not a git repository (or any of the parent directories): .git 2025-11-05T20:36:34,849 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2025-11-05T20:36:34,850  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2025-11-05T20:36:34,851 DS_BUILD_OPS=0 2025-11-05T20:36:34,851 Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False} 2025-11-05T20:36:34,852 version=0.18.2, git_hash=unknown, git_branch=unknown 2025-11-05T20:36:34,853 install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm'] 2025-11-05T20:36:34,853 ext_modules=[] 2025-11-05T20:36:34,854 running egg_info 2025-11-05T20:36:34,877 creating /tmp/pip-pip-egg-info-1jvjihy9/deepspeed.egg-info 2025-11-05T20:36:34,878 writing /tmp/pip-pip-egg-info-1jvjihy9/deepspeed.egg-info/PKG-INFO 2025-11-05T20:36:34,915 writing dependency_links to /tmp/pip-pip-egg-info-1jvjihy9/deepspeed.egg-info/dependency_links.txt 2025-11-05T20:36:34,917 writing entry points to /tmp/pip-pip-egg-info-1jvjihy9/deepspeed.egg-info/entry_points.txt 2025-11-05T20:36:34,938 writing requirements to /tmp/pip-pip-egg-info-1jvjihy9/deepspeed.egg-info/requires.txt 2025-11-05T20:36:34,940 writing top-level names to /tmp/pip-pip-egg-info-1jvjihy9/deepspeed.egg-info/top_level.txt 2025-11-05T20:36:34,941 writing manifest file '/tmp/pip-pip-egg-info-1jvjihy9/deepspeed.egg-info/SOURCES.txt' 2025-11-05T20:36:35,195 reading manifest file '/tmp/pip-pip-egg-info-1jvjihy9/deepspeed.egg-info/SOURCES.txt' 2025-11-05T20:36:35,197 reading manifest template 'MANIFEST.in' 2025-11-05T20:36:35,199 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2025-11-05T20:36:35,199 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2025-11-05T20:36:36,960 warning: no files found matching '*.hip' under directory 'deepspeed' 2025-11-05T20:36:38,019 warning: no files found matching '*.cc' under directory 'deepspeed' 2025-11-05T20:36:38,753 warning: no files found matching '*.tr' under directory 'csrc' 2025-11-05T20:36:38,897 warning: no files found matching '*.cc' under directory 'csrc' 2025-11-05T20:36:38,948 warning: no files found matching '*.py' under directory 'benchmarks' 2025-11-05T20:36:38,954 adding license file 'LICENSE' 2025-11-05T20:36:38,995 writing manifest file '/tmp/pip-pip-egg-info-1jvjihy9/deepspeed.egg-info/SOURCES.txt' 2025-11-05T20:36:38,997 deepspeed build time = 4.612886905670166 secs 2025-11-05T20:36:39,113 Preparing metadata (setup.py): finished with status 'done' 2025-11-05T20:36:39,119 Source in /tmp/pip-wheel-fgqpc9gg/deepspeed_e56ff6ffa4ec4023b59aefb6313f136c has version 0.18.2, which satisfies requirement deepspeed==0.18.2 from https://files.pythonhosted.org/packages/74/cd/c4cdcc947db3d1f103223b2067e455710c5674acdff249289bc3c0501ecf/deepspeed-0.18.2.tar.gz 2025-11-05T20:36:39,120 Removed deepspeed==0.18.2 from https://files.pythonhosted.org/packages/74/cd/c4cdcc947db3d1f103223b2067e455710c5674acdff249289bc3c0501ecf/deepspeed-0.18.2.tar.gz from build tracker '/tmp/pip-build-tracker-wuez3bjp' 2025-11-05T20:36:39,129 Created temporary directory: /tmp/pip-unpack-nvm6mwio 2025-11-05T20:36:39,130 Building wheels for collected packages: deepspeed 2025-11-05T20:36:39,134 Created temporary directory: /tmp/pip-wheel-fi8eux_0 2025-11-05T20:36:39,135 Building wheel for deepspeed (setup.py): started 2025-11-05T20:36:39,136 Destination directory: /tmp/pip-wheel-fi8eux_0 2025-11-05T20:36:39,137 Running command python setup.py bdist_wheel 2025-11-05T20:36:39,624 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2025-11-05T20:36:39,627  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2025-11-05T20:36:39,753 DS_BUILD_OPS=0 2025-11-05T20:36:39,866 Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False} 2025-11-05T20:36:39,885 fatal: not a git repository (or any of the parent directories): .git 2025-11-05T20:36:39,886 version=0.18.2, git_hash=unknown, git_branch=unknown 2025-11-05T20:36:39,887 install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm'] 2025-11-05T20:36:39,888 ext_modules=[] 2025-11-05T20:36:40,279 running bdist_wheel 2025-11-05T20:36:40,413 running build 2025-11-05T20:36:40,413 running build_py 2025-11-05T20:36:40,443 creating build/lib/deepspeed 2025-11-05T20:36:40,446 copying deepspeed/env_report.py -> build/lib/deepspeed 2025-11-05T20:36:40,448 copying deepspeed/__init__.py -> build/lib/deepspeed 2025-11-05T20:36:40,451 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2025-11-05T20:36:40,453 copying deepspeed/constants.py -> build/lib/deepspeed 2025-11-05T20:36:40,455 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2025-11-05T20:36:40,457 creating build/lib/deepspeed/autotuning 2025-11-05T20:36:40,458 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2025-11-05T20:36:40,461 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2025-11-05T20:36:40,464 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2025-11-05T20:36:40,467 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2025-11-05T20:36:40,469 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2025-11-05T20:36:40,471 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2025-11-05T20:36:40,475 creating build/lib/deepspeed/ops 2025-11-05T20:36:40,476 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2025-11-05T20:36:40,478 creating build/lib/deepspeed/utils 2025-11-05T20:36:40,480 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,482 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,484 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,486 copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,488 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,490 copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,492 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,495 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,497 copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,499 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,501 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,504 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,506 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,508 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,510 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,512 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,514 copying deepspeed/utils/config.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,516 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2025-11-05T20:36:40,519 creating build/lib/deepspeed/compression 2025-11-05T20:36:40,520 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2025-11-05T20:36:40,523 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2025-11-05T20:36:40,525 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2025-11-05T20:36:40,527 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2025-11-05T20:36:40,529 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2025-11-05T20:36:40,532 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2025-11-05T20:36:40,535 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2025-11-05T20:36:40,537 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2025-11-05T20:36:40,540 creating build/lib/deepspeed/profiling 2025-11-05T20:36:40,541 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2025-11-05T20:36:40,543 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2025-11-05T20:36:40,545 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2025-11-05T20:36:40,548 creating build/lib/deepspeed/monitor 2025-11-05T20:36:40,549 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2025-11-05T20:36:40,551 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2025-11-05T20:36:40,553 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2025-11-05T20:36:40,555 copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor 2025-11-05T20:36:40,557 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2025-11-05T20:36:40,559 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2025-11-05T20:36:40,561 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2025-11-05T20:36:40,563 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2025-11-05T20:36:40,566 creating build/lib/deepspeed/sequence 2025-11-05T20:36:40,567 copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence 2025-11-05T20:36:40,569 copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence 2025-11-05T20:36:40,571 copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence 2025-11-05T20:36:40,573 copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence 2025-11-05T20:36:40,577 creating build/lib/deepspeed/io 2025-11-05T20:36:40,578 copying deepspeed/io/fast_file_writer.py -> build/lib/deepspeed/io 2025-11-05T20:36:40,581 copying deepspeed/io/base_file_writer.py -> build/lib/deepspeed/io 2025-11-05T20:36:40,582 copying deepspeed/io/utils.py -> build/lib/deepspeed/io 2025-11-05T20:36:40,584 copying deepspeed/io/__init__.py -> build/lib/deepspeed/io 2025-11-05T20:36:40,586 copying deepspeed/io/double_io_buffer.py -> build/lib/deepspeed/io 2025-11-05T20:36:40,588 copying deepspeed/io/base_io_buffer.py -> build/lib/deepspeed/io 2025-11-05T20:36:40,590 copying deepspeed/io/single_io_buffer.py -> build/lib/deepspeed/io 2025-11-05T20:36:40,591 copying deepspeed/io/py_file_writer.py -> build/lib/deepspeed/io 2025-11-05T20:36:40,593 copying deepspeed/io/mock_file_writer.py -> build/lib/deepspeed/io 2025-11-05T20:36:40,595 copying deepspeed/io/constants.py -> build/lib/deepspeed/io 2025-11-05T20:36:40,597 creating build/lib/deepspeed/elasticity 2025-11-05T20:36:40,598 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2025-11-05T20:36:40,600 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2025-11-05T20:36:40,602 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2025-11-05T20:36:40,604 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2025-11-05T20:36:40,607 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2025-11-05T20:36:40,609 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2025-11-05T20:36:40,612 creating build/lib/deepspeed/nvme 2025-11-05T20:36:40,613 copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme 2025-11-05T20:36:40,615 copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme 2025-11-05T20:36:40,617 copying deepspeed/nvme/ds_aio_constants.py -> build/lib/deepspeed/nvme 2025-11-05T20:36:40,619 copying deepspeed/nvme/torch_fastio_engine.py -> build/lib/deepspeed/nvme 2025-11-05T20:36:40,621 copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme 2025-11-05T20:36:40,623 copying deepspeed/nvme/io_engine.py -> build/lib/deepspeed/nvme 2025-11-05T20:36:40,625 copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme 2025-11-05T20:36:40,627 copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme 2025-11-05T20:36:40,629 copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme 2025-11-05T20:36:40,631 copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme 2025-11-05T20:36:40,633 copying deepspeed/nvme/torch_io.py -> build/lib/deepspeed/nvme 2025-11-05T20:36:40,635 copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme 2025-11-05T20:36:40,637 copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme 2025-11-05T20:36:40,639 copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme 2025-11-05T20:36:40,642 copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme 2025-11-05T20:36:40,644 copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme 2025-11-05T20:36:40,646 creating build/lib/deepspeed/inference 2025-11-05T20:36:40,647 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2025-11-05T20:36:40,649 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2025-11-05T20:36:40,652 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2025-11-05T20:36:40,655 creating build/lib/deepspeed/compile 2025-11-05T20:36:40,656 copying deepspeed/compile/__init__.py -> build/lib/deepspeed/compile 2025-11-05T20:36:40,658 copying deepspeed/compile/init_z3.py -> build/lib/deepspeed/compile 2025-11-05T20:36:40,660 copying deepspeed/compile/patch_fake_tensor.py -> build/lib/deepspeed/compile 2025-11-05T20:36:40,661 copying deepspeed/compile/input_storage.py -> build/lib/deepspeed/compile 2025-11-05T20:36:40,664 copying deepspeed/compile/patch_compiled_func.py -> build/lib/deepspeed/compile 2025-11-05T20:36:40,666 copying deepspeed/compile/list_schedule.py -> build/lib/deepspeed/compile 2025-11-05T20:36:40,668 copying deepspeed/compile/inductor.py -> build/lib/deepspeed/compile 2025-11-05T20:36:40,670 copying deepspeed/compile/fx.py -> build/lib/deepspeed/compile 2025-11-05T20:36:40,672 copying deepspeed/compile/graph_param.py -> build/lib/deepspeed/compile 2025-11-05T20:36:40,674 copying deepspeed/compile/util.py -> build/lib/deepspeed/compile 2025-11-05T20:36:40,677 copying deepspeed/compile/init_z1.py -> build/lib/deepspeed/compile 2025-11-05T20:36:40,679 copying deepspeed/compile/partitioner.py -> build/lib/deepspeed/compile 2025-11-05T20:36:40,681 copying deepspeed/compile/config.py -> build/lib/deepspeed/compile 2025-11-05T20:36:40,683 copying deepspeed/compile/backend.py -> build/lib/deepspeed/compile 2025-11-05T20:36:40,686 creating build/lib/deepspeed/checkpoint 2025-11-05T20:36:40,687 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2025-11-05T20:36:40,689 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2025-11-05T20:36:40,692 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2025-11-05T20:36:40,694 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2025-11-05T20:36:40,696 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2025-11-05T20:36:40,698 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2025-11-05T20:36:40,700 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2025-11-05T20:36:40,702 copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint 2025-11-05T20:36:40,705 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2025-11-05T20:36:40,707 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2025-11-05T20:36:40,710 creating build/lib/deepspeed/accelerator 2025-11-05T20:36:40,711 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2025-11-05T20:36:40,713 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2025-11-05T20:36:40,715 copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator 2025-11-05T20:36:40,718 copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator 2025-11-05T20:36:40,720 copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator 2025-11-05T20:36:40,722 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2025-11-05T20:36:40,725 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2025-11-05T20:36:40,728 copying deepspeed/accelerator/sdaa_accelerator.py -> build/lib/deepspeed/accelerator 2025-11-05T20:36:40,730 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2025-11-05T20:36:40,732 copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator 2025-11-05T20:36:40,735 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2025-11-05T20:36:40,738 creating build/lib/deepspeed/launcher 2025-11-05T20:36:40,739 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2025-11-05T20:36:40,741 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2025-11-05T20:36:40,744 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2025-11-05T20:36:40,746 copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher 2025-11-05T20:36:40,748 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2025-11-05T20:36:40,751 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2025-11-05T20:36:40,753 creating build/lib/deepspeed/moe 2025-11-05T20:36:40,754 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2025-11-05T20:36:40,756 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2025-11-05T20:36:40,758 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2025-11-05T20:36:40,760 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2025-11-05T20:36:40,762 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2025-11-05T20:36:40,764 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2025-11-05T20:36:40,767 creating build/lib/deepspeed/module_inject 2025-11-05T20:36:40,768 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2025-11-05T20:36:40,770 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2025-11-05T20:36:40,772 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2025-11-05T20:36:40,775 copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject 2025-11-05T20:36:40,777 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2025-11-05T20:36:40,779 copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject 2025-11-05T20:36:40,781 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2025-11-05T20:36:40,784 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2025-11-05T20:36:40,786 copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject 2025-11-05T20:36:40,788 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2025-11-05T20:36:40,790 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2025-11-05T20:36:40,793 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2025-11-05T20:36:40,795 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2025-11-05T20:36:40,797 creating build/lib/deepspeed/datastates 2025-11-05T20:36:40,798 copying deepspeed/datastates/__init__.py -> build/lib/deepspeed/datastates 2025-11-05T20:36:40,800 copying deepspeed/datastates/config.py -> build/lib/deepspeed/datastates 2025-11-05T20:36:40,803 creating build/lib/deepspeed/model_implementations 2025-11-05T20:36:40,803 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2025-11-05T20:36:40,806 creating build/lib/deepspeed/linear 2025-11-05T20:36:40,807 copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear 2025-11-05T20:36:40,810 copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear 2025-11-05T20:36:40,811 copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear 2025-11-05T20:36:40,813 copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear 2025-11-05T20:36:40,816 copying deepspeed/linear/config.py -> build/lib/deepspeed/linear 2025-11-05T20:36:40,818 creating build/lib/deepspeed/pipe 2025-11-05T20:36:40,819 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2025-11-05T20:36:40,822 creating build/lib/deepspeed/runtime 2025-11-05T20:36:40,823 copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,825 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,828 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,830 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,832 copying deepspeed/runtime/torch_autocast.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,834 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,836 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,839 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,845 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,846 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,850 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,852 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,854 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,856 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,859 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,861 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,864 copying deepspeed/runtime/precision_config.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,866 copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,868 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,871 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2025-11-05T20:36:40,873 creating build/lib/deepspeed/comm 2025-11-05T20:36:40,874 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2025-11-05T20:36:40,877 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2025-11-05T20:36:40,880 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2025-11-05T20:36:40,881 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2025-11-05T20:36:40,883 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2025-11-05T20:36:40,886 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2025-11-05T20:36:40,888 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2025-11-05T20:36:40,889 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2025-11-05T20:36:40,891 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2025-11-05T20:36:40,894 creating build/lib/deepspeed/nebula 2025-11-05T20:36:40,895 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2025-11-05T20:36:40,897 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2025-11-05T20:36:40,899 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2025-11-05T20:36:40,901 creating build/lib/deepspeed/autotuning/tuner 2025-11-05T20:36:40,902 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2025-11-05T20:36:40,904 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2025-11-05T20:36:40,906 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2025-11-05T20:36:40,908 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2025-11-05T20:36:40,910 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2025-11-05T20:36:40,912 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2025-11-05T20:36:40,914 creating build/lib/deepspeed/ops/lion 2025-11-05T20:36:40,915 copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion 2025-11-05T20:36:40,918 copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion 2025-11-05T20:36:40,920 copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion 2025-11-05T20:36:40,922 copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion 2025-11-05T20:36:40,925 creating build/lib/deepspeed/ops/deepspeed4science 2025-11-05T20:36:40,926 copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science 2025-11-05T20:36:40,928 copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science 2025-11-05T20:36:40,931 creating build/lib/deepspeed/ops/lamb 2025-11-05T20:36:40,932 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2025-11-05T20:36:40,935 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2025-11-05T20:36:40,937 creating build/lib/deepspeed/ops/aio 2025-11-05T20:36:40,938 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2025-11-05T20:36:40,940 creating build/lib/deepspeed/ops/random_ltd 2025-11-05T20:36:40,941 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2025-11-05T20:36:40,943 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2025-11-05T20:36:40,946 creating build/lib/deepspeed/ops/adagrad 2025-11-05T20:36:40,947 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2025-11-05T20:36:40,949 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2025-11-05T20:36:40,951 creating build/lib/deepspeed/ops/compile 2025-11-05T20:36:40,952 copying deepspeed/ops/compile/__init__.py -> build/lib/deepspeed/ops/compile 2025-11-05T20:36:40,955 creating build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,956 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,958 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,960 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,962 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,964 copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,966 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,967 copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,969 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,971 copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,973 copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,975 copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,978 copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,980 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,981 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,983 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,985 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,987 copying deepspeed/ops/op_builder/dc.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,989 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,991 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,993 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,995 copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,997 copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:40,999 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:41,002 copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:41,004 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:41,006 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2025-11-05T20:36:41,009 creating build/lib/deepspeed/ops/fp_quantizer 2025-11-05T20:36:41,010 copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer 2025-11-05T20:36:41,013 copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer 2025-11-05T20:36:41,014 copying deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/lib/deepspeed/ops/fp_quantizer 2025-11-05T20:36:41,017 copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer 2025-11-05T20:36:41,019 creating build/lib/deepspeed/ops/quantizer 2025-11-05T20:36:41,020 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2025-11-05T20:36:41,022 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2025-11-05T20:36:41,024 creating build/lib/deepspeed/ops/adam 2025-11-05T20:36:41,025 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2025-11-05T20:36:41,027 copying deepspeed/ops/adam/zenflow_torch_adam.py -> build/lib/deepspeed/ops/adam 2025-11-05T20:36:41,030 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2025-11-05T20:36:41,032 copying deepspeed/ops/adam/zenflow_cpu_adam.py -> build/lib/deepspeed/ops/adam 2025-11-05T20:36:41,034 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2025-11-05T20:36:41,036 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2025-11-05T20:36:41,039 creating build/lib/deepspeed/ops/gds 2025-11-05T20:36:41,040 copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds 2025-11-05T20:36:41,042 creating build/lib/deepspeed/ops/sparse_attention 2025-11-05T20:36:41,043 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2025-11-05T20:36:41,045 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2025-11-05T20:36:41,047 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2025-11-05T20:36:41,050 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2025-11-05T20:36:41,052 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2025-11-05T20:36:41,055 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2025-11-05T20:36:41,058 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2025-11-05T20:36:41,061 creating build/lib/deepspeed/ops/transformer 2025-11-05T20:36:41,062 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2025-11-05T20:36:41,064 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2025-11-05T20:36:41,068 creating build/lib/deepspeed/ops/op_builder/xpu 2025-11-05T20:36:41,069 copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-11-05T20:36:41,071 copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-11-05T20:36:41,073 copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-11-05T20:36:41,075 copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-11-05T20:36:41,077 copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-11-05T20:36:41,079 copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-11-05T20:36:41,081 copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-11-05T20:36:41,083 copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-11-05T20:36:41,086 copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-11-05T20:36:41,088 copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-11-05T20:36:41,091 creating build/lib/deepspeed/ops/op_builder/sdaa 2025-11-05T20:36:41,092 copying deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-11-05T20:36:41,094 copying deepspeed/ops/op_builder/sdaa/__init__.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-11-05T20:36:41,096 copying deepspeed/ops/op_builder/sdaa/no_impl.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-11-05T20:36:41,098 copying deepspeed/ops/op_builder/sdaa/builder.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-11-05T20:36:41,100 copying deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-11-05T20:36:41,102 creating build/lib/deepspeed/ops/op_builder/npu 2025-11-05T20:36:41,103 copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2025-11-05T20:36:41,105 copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu 2025-11-05T20:36:41,107 copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu 2025-11-05T20:36:41,109 copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu 2025-11-05T20:36:41,111 copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu 2025-11-05T20:36:41,113 copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu 2025-11-05T20:36:41,115 copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu 2025-11-05T20:36:41,117 copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2025-11-05T20:36:41,119 copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu 2025-11-05T20:36:41,122 creating build/lib/deepspeed/ops/op_builder/hpu 2025-11-05T20:36:41,123 copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-11-05T20:36:41,125 copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-11-05T20:36:41,127 copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-11-05T20:36:41,129 copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-11-05T20:36:41,131 copying deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-11-05T20:36:41,133 copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-11-05T20:36:41,135 copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-11-05T20:36:41,138 creating build/lib/deepspeed/ops/op_builder/mlu 2025-11-05T20:36:41,139 copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-11-05T20:36:41,141 copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-11-05T20:36:41,143 copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-11-05T20:36:41,145 copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-11-05T20:36:41,147 copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-11-05T20:36:41,149 copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-11-05T20:36:41,152 creating build/lib/deepspeed/ops/op_builder/cpu 2025-11-05T20:36:41,153 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-11-05T20:36:41,155 copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-11-05T20:36:41,157 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-11-05T20:36:41,159 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-11-05T20:36:41,161 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-11-05T20:36:41,163 copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-11-05T20:36:41,165 copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-11-05T20:36:41,168 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2025-11-05T20:36:41,169 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-11-05T20:36:41,171 creating build/lib/deepspeed/ops/transformer/inference 2025-11-05T20:36:41,172 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2025-11-05T20:36:41,175 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2025-11-05T20:36:41,177 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2025-11-05T20:36:41,179 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2025-11-05T20:36:41,182 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2025-11-05T20:36:41,184 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2025-11-05T20:36:41,186 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2025-11-05T20:36:41,188 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2025-11-05T20:36:41,191 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2025-11-05T20:36:41,193 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2025-11-05T20:36:41,196 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,197 copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,200 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,202 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,204 copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,206 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,208 copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,210 copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,212 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,214 copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,217 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,219 copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,222 copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,224 copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,226 copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,228 copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,230 copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,232 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,235 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,237 copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,239 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,241 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,243 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,245 copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:41,248 creating build/lib/deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:41,249 copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:41,251 copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:41,253 copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:41,255 copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:41,257 copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:41,259 copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:41,262 copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:41,264 copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:41,267 copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:41,269 copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:41,272 creating build/lib/deepspeed/profiling/flops_profiler 2025-11-05T20:36:41,273 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2025-11-05T20:36:41,275 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2025-11-05T20:36:41,279 creating build/lib/deepspeed/inference/quantization 2025-11-05T20:36:41,280 copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization 2025-11-05T20:36:41,282 copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization 2025-11-05T20:36:41,285 copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization 2025-11-05T20:36:41,286 copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization 2025-11-05T20:36:41,289 copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization 2025-11-05T20:36:41,292 creating build/lib/deepspeed/inference/v2 2025-11-05T20:36:41,293 copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2 2025-11-05T20:36:41,295 copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2 2025-11-05T20:36:41,297 copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2 2025-11-05T20:36:41,298 copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2 2025-11-05T20:36:41,300 copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2 2025-11-05T20:36:41,303 copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2 2025-11-05T20:36:41,304 copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2 2025-11-05T20:36:41,306 copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2 2025-11-05T20:36:41,308 copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2 2025-11-05T20:36:41,311 creating build/lib/deepspeed/inference/v2/ragged 2025-11-05T20:36:41,312 copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged 2025-11-05T20:36:41,314 copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged 2025-11-05T20:36:41,316 copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged 2025-11-05T20:36:41,319 copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged 2025-11-05T20:36:41,321 copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged 2025-11-05T20:36:41,323 copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged 2025-11-05T20:36:41,325 copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged 2025-11-05T20:36:41,328 creating build/lib/deepspeed/inference/v2/checkpoint 2025-11-05T20:36:41,329 copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-11-05T20:36:41,331 copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-11-05T20:36:41,332 copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-11-05T20:36:41,334 copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-11-05T20:36:41,337 creating build/lib/deepspeed/inference/v2/kernels 2025-11-05T20:36:41,337 copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels 2025-11-05T20:36:41,339 copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels 2025-11-05T20:36:41,342 creating build/lib/deepspeed/inference/v2/modules 2025-11-05T20:36:41,343 copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules 2025-11-05T20:36:41,345 copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules 2025-11-05T20:36:41,347 copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules 2025-11-05T20:36:41,350 copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules 2025-11-05T20:36:41,352 creating build/lib/deepspeed/inference/v2/model_implementations 2025-11-05T20:36:41,354 copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-11-05T20:36:41,362 copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-11-05T20:36:41,369 copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-11-05T20:36:41,372 copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-11-05T20:36:41,375 copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-11-05T20:36:41,377 copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-11-05T20:36:41,380 copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-11-05T20:36:41,383 creating build/lib/deepspeed/inference/v2/kernels/core_ops 2025-11-05T20:36:41,385 copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops 2025-11-05T20:36:41,387 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2025-11-05T20:36:41,389 copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2025-11-05T20:36:41,392 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops 2025-11-05T20:36:41,393 copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2025-11-05T20:36:41,395 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-11-05T20:36:41,397 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-11-05T20:36:41,399 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-11-05T20:36:41,402 creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-11-05T20:36:41,403 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-11-05T20:36:41,406 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-11-05T20:36:41,408 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-11-05T20:36:41,410 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-11-05T20:36:41,412 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-11-05T20:36:41,414 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-11-05T20:36:41,416 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-11-05T20:36:41,418 creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-11-05T20:36:41,420 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-11-05T20:36:41,422 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-11-05T20:36:41,424 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:41,425 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:41,428 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:41,430 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:41,432 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:41,434 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:41,437 creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-11-05T20:36:41,438 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-11-05T20:36:41,440 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-11-05T20:36:41,443 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-11-05T20:36:41,444 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-11-05T20:36:41,446 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-11-05T20:36:41,449 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-11-05T20:36:41,450 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-11-05T20:36:41,452 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-11-05T20:36:41,454 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-11-05T20:36:41,457 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-11-05T20:36:41,458 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-11-05T20:36:41,461 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-11-05T20:36:41,463 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-11-05T20:36:41,464 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-11-05T20:36:41,467 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-11-05T20:36:41,469 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-11-05T20:36:41,470 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-11-05T20:36:41,473 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-11-05T20:36:41,475 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-11-05T20:36:41,477 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-11-05T20:36:41,479 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-11-05T20:36:41,482 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-11-05T20:36:41,483 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-11-05T20:36:41,486 copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-11-05T20:36:41,488 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:41,490 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:41,492 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:41,494 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:41,496 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:41,499 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-11-05T20:36:41,500 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-11-05T20:36:41,502 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-11-05T20:36:41,505 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-11-05T20:36:41,506 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-11-05T20:36:41,508 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-11-05T20:36:41,511 creating build/lib/deepspeed/inference/v2/modules/implementations 2025-11-05T20:36:41,512 copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations 2025-11-05T20:36:41,515 creating build/lib/deepspeed/inference/v2/modules/configs 2025-11-05T20:36:41,516 copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-11-05T20:36:41,518 copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-11-05T20:36:41,520 copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-11-05T20:36:41,523 copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-11-05T20:36:41,525 copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-11-05T20:36:41,527 copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-11-05T20:36:41,529 copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-11-05T20:36:41,532 creating build/lib/deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:41,533 copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:41,536 copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:41,538 copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:41,540 copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:41,543 copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:41,545 copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:41,547 copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:41,549 copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:41,552 creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-11-05T20:36:41,553 copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-11-05T20:36:41,555 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-11-05T20:36:41,558 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-11-05T20:36:41,560 creating build/lib/deepspeed/inference/v2/modules/implementations/attention 2025-11-05T20:36:41,561 copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2025-11-05T20:36:41,564 copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2025-11-05T20:36:41,567 creating build/lib/deepspeed/inference/v2/modules/implementations/embedding 2025-11-05T20:36:41,568 copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2025-11-05T20:36:41,570 copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2025-11-05T20:36:41,573 creating build/lib/deepspeed/inference/v2/modules/implementations/moe 2025-11-05T20:36:41,574 copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2025-11-05T20:36:41,576 copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2025-11-05T20:36:41,579 creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2025-11-05T20:36:41,580 copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2025-11-05T20:36:41,583 copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2025-11-05T20:36:41,585 creating build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-11-05T20:36:41,586 copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-11-05T20:36:41,589 copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-11-05T20:36:41,591 copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-11-05T20:36:41,594 creating build/lib/deepspeed/inference/v2/modules/implementations/unembed 2025-11-05T20:36:41,596 copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2025-11-05T20:36:41,598 copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2025-11-05T20:36:41,601 creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-11-05T20:36:41,602 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-11-05T20:36:41,605 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-11-05T20:36:41,607 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-11-05T20:36:41,609 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-11-05T20:36:41,612 creating build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-11-05T20:36:41,613 copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-11-05T20:36:41,616 copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-11-05T20:36:41,618 copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-11-05T20:36:41,620 copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-11-05T20:36:41,622 creating build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:41,624 copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:41,626 copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:41,628 copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:41,630 copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:41,633 copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:41,635 copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:41,637 copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:41,640 copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:41,642 copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:41,644 creating build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-11-05T20:36:41,646 copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-11-05T20:36:41,648 copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-11-05T20:36:41,650 copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-11-05T20:36:41,652 copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-11-05T20:36:41,655 creating build/lib/deepspeed/inference/v2/model_implementations/phi 2025-11-05T20:36:41,656 copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-11-05T20:36:41,659 copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-11-05T20:36:41,661 copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-11-05T20:36:41,663 copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-11-05T20:36:41,666 creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-11-05T20:36:41,667 copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-11-05T20:36:41,670 copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-11-05T20:36:41,672 copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-11-05T20:36:41,674 copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-11-05T20:36:41,677 creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:41,678 copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:41,680 copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:41,682 copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:41,684 copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:41,686 copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:41,688 copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:41,690 copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:41,692 copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:41,695 copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:41,697 creating build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-11-05T20:36:41,699 copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-11-05T20:36:41,701 copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-11-05T20:36:41,703 copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-11-05T20:36:41,705 copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-11-05T20:36:41,708 creating build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-11-05T20:36:41,709 copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-11-05T20:36:41,711 copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-11-05T20:36:41,713 copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-11-05T20:36:41,715 copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-11-05T20:36:41,718 creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-11-05T20:36:41,719 copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-11-05T20:36:41,722 copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-11-05T20:36:41,724 copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-11-05T20:36:41,726 copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-11-05T20:36:41,729 creating build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-11-05T20:36:41,730 copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-11-05T20:36:41,758 copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-11-05T20:36:41,769 copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-11-05T20:36:41,771 copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-11-05T20:36:41,773 creating build/lib/deepspeed/inference/v2/model_implementations/opt 2025-11-05T20:36:41,775 copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-11-05T20:36:41,778 copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-11-05T20:36:41,780 copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-11-05T20:36:41,782 copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-11-05T20:36:41,785 creating build/lib/deepspeed/compile/passes 2025-11-05T20:36:41,786 copying deepspeed/compile/passes/zero1_compile.py -> build/lib/deepspeed/compile/passes 2025-11-05T20:36:41,788 copying deepspeed/compile/passes/offload_activation.py -> build/lib/deepspeed/compile/passes 2025-11-05T20:36:41,790 copying deepspeed/compile/passes/__init__.py -> build/lib/deepspeed/compile/passes 2025-11-05T20:36:41,792 copying deepspeed/compile/passes/prefetch.py -> build/lib/deepspeed/compile/passes 2025-11-05T20:36:41,795 copying deepspeed/compile/passes/offload_parameters.py -> build/lib/deepspeed/compile/passes 2025-11-05T20:36:41,797 copying deepspeed/compile/passes/selective_gather.py -> build/lib/deepspeed/compile/passes 2025-11-05T20:36:41,800 copying deepspeed/compile/passes/zero3_compile.py -> build/lib/deepspeed/compile/passes 2025-11-05T20:36:41,802 copying deepspeed/compile/passes/offload_adam_states.py -> build/lib/deepspeed/compile/passes 2025-11-05T20:36:41,805 creating build/lib/deepspeed/compile/profilers 2025-11-05T20:36:41,807 copying deepspeed/compile/profilers/comm_profile.py -> build/lib/deepspeed/compile/profilers 2025-11-05T20:36:41,809 copying deepspeed/compile/profilers/__init__.py -> build/lib/deepspeed/compile/profilers 2025-11-05T20:36:41,811 copying deepspeed/compile/profilers/graph_profile.py -> build/lib/deepspeed/compile/profilers 2025-11-05T20:36:41,815 creating build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,816 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,818 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,821 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,823 copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,826 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,828 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,830 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,834 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,837 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,839 copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,842 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,844 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,847 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,849 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,851 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,854 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,857 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,859 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,862 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2025-11-05T20:36:41,865 creating build/lib/deepspeed/module_inject/containers/features 2025-11-05T20:36:41,866 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2025-11-05T20:36:41,869 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2025-11-05T20:36:41,871 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2025-11-05T20:36:41,874 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2025-11-05T20:36:41,876 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2025-11-05T20:36:41,879 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2025-11-05T20:36:41,882 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2025-11-05T20:36:41,885 creating build/lib/deepspeed/model_implementations/transformers 2025-11-05T20:36:41,886 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2025-11-05T20:36:41,889 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2025-11-05T20:36:41,891 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2025-11-05T20:36:41,893 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2025-11-05T20:36:41,895 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2025-11-05T20:36:41,898 copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers 2025-11-05T20:36:41,900 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2025-11-05T20:36:41,902 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2025-11-05T20:36:41,904 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2025-11-05T20:36:41,907 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2025-11-05T20:36:41,910 creating build/lib/deepspeed/model_implementations/diffusers 2025-11-05T20:36:41,911 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2025-11-05T20:36:41,914 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2025-11-05T20:36:41,916 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2025-11-05T20:36:41,919 creating build/lib/deepspeed/model_implementations/features 2025-11-05T20:36:41,920 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2025-11-05T20:36:41,922 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2025-11-05T20:36:41,925 creating build/lib/deepspeed/runtime/sequence_parallel 2025-11-05T20:36:41,926 copying deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/lib/deepspeed/runtime/sequence_parallel 2025-11-05T20:36:41,928 copying deepspeed/runtime/sequence_parallel/__init__.py -> build/lib/deepspeed/runtime/sequence_parallel 2025-11-05T20:36:41,930 copying deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/lib/deepspeed/runtime/sequence_parallel 2025-11-05T20:36:41,933 creating build/lib/deepspeed/runtime/compression 2025-11-05T20:36:41,935 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2025-11-05T20:36:41,937 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2025-11-05T20:36:41,939 creating build/lib/deepspeed/runtime/data_pipeline 2025-11-05T20:36:41,940 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2025-11-05T20:36:41,942 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2025-11-05T20:36:41,945 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2025-11-05T20:36:41,947 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2025-11-05T20:36:41,950 creating build/lib/deepspeed/runtime/superoffload 2025-11-05T20:36:41,951 copying deepspeed/runtime/superoffload/__init__.py -> build/lib/deepspeed/runtime/superoffload 2025-11-05T20:36:41,953 copying deepspeed/runtime/superoffload/superoffload_utils.py -> build/lib/deepspeed/runtime/superoffload 2025-11-05T20:36:41,956 copying deepspeed/runtime/superoffload/superoffload_stage3.py -> build/lib/deepspeed/runtime/superoffload 2025-11-05T20:36:41,959 creating build/lib/deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:41,960 copying deepspeed/runtime/checkpoint_engine/datastates_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:41,962 copying deepspeed/runtime/checkpoint_engine/utils.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:41,964 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:41,966 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:41,969 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:41,971 copying deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:41,973 copying deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:41,975 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:41,978 creating build/lib/deepspeed/runtime/activation_checkpointing 2025-11-05T20:36:41,979 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2025-11-05T20:36:41,981 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2025-11-05T20:36:41,984 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2025-11-05T20:36:41,986 creating build/lib/deepspeed/runtime/domino 2025-11-05T20:36:41,987 copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino 2025-11-05T20:36:41,989 copying deepspeed/runtime/domino/async_linear.py -> build/lib/deepspeed/runtime/domino 2025-11-05T20:36:41,992 copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino 2025-11-05T20:36:41,995 creating build/lib/deepspeed/runtime/zero 2025-11-05T20:36:41,997 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:41,999 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:42,001 copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:42,003 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:42,008 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:42,011 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:42,016 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:42,019 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:42,021 copying deepspeed/runtime/zero/leaf_module_config.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:42,023 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:42,025 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:42,028 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:42,030 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:42,033 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:42,035 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:42,040 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:42,042 copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:42,044 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2025-11-05T20:36:42,047 creating build/lib/deepspeed/runtime/tensor_parallel 2025-11-05T20:36:42,049 copying deepspeed/runtime/tensor_parallel/__init__.py -> build/lib/deepspeed/runtime/tensor_parallel 2025-11-05T20:36:42,051 copying deepspeed/runtime/tensor_parallel/tp_manager.py -> build/lib/deepspeed/runtime/tensor_parallel 2025-11-05T20:36:42,053 copying deepspeed/runtime/tensor_parallel/config.py -> build/lib/deepspeed/runtime/tensor_parallel 2025-11-05T20:36:42,056 creating build/lib/deepspeed/runtime/swap_tensor 2025-11-05T20:36:42,057 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2025-11-05T20:36:42,059 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2025-11-05T20:36:42,061 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-11-05T20:36:42,064 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-11-05T20:36:42,066 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-11-05T20:36:42,069 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2025-11-05T20:36:42,071 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2025-11-05T20:36:42,074 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2025-11-05T20:36:42,076 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-11-05T20:36:42,079 creating build/lib/deepspeed/runtime/zenflow 2025-11-05T20:36:42,080 copying deepspeed/runtime/zenflow/zenflow_stage_1_and_2.py -> build/lib/deepspeed/runtime/zenflow 2025-11-05T20:36:42,083 copying deepspeed/runtime/zenflow/__init__.py -> build/lib/deepspeed/runtime/zenflow 2025-11-05T20:36:42,085 copying deepspeed/runtime/zenflow/engine.py -> build/lib/deepspeed/runtime/zenflow 2025-11-05T20:36:42,087 copying deepspeed/runtime/zenflow/zenflow_config.py -> build/lib/deepspeed/runtime/zenflow 2025-11-05T20:36:42,089 copying deepspeed/runtime/zenflow/engine_stage3.py -> build/lib/deepspeed/runtime/zenflow 2025-11-05T20:36:42,092 copying deepspeed/runtime/zenflow/zenflow_utils.py -> build/lib/deepspeed/runtime/zenflow 2025-11-05T20:36:42,095 creating build/lib/deepspeed/runtime/pipe 2025-11-05T20:36:42,096 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2025-11-05T20:36:42,099 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2025-11-05T20:36:42,101 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2025-11-05T20:36:42,105 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2025-11-05T20:36:42,108 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2025-11-05T20:36:42,111 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2025-11-05T20:36:42,114 creating build/lib/deepspeed/runtime/model_checkpointing 2025-11-05T20:36:42,116 copying deepspeed/runtime/model_checkpointing/utils.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-11-05T20:36:42,118 copying deepspeed/runtime/model_checkpointing/__init__.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-11-05T20:36:42,120 copying deepspeed/runtime/model_checkpointing/writer_factory.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-11-05T20:36:42,122 copying deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-11-05T20:36:42,125 copying deepspeed/runtime/model_checkpointing/constants.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-11-05T20:36:42,127 copying deepspeed/runtime/model_checkpointing/config.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-11-05T20:36:42,130 creating build/lib/deepspeed/runtime/comm 2025-11-05T20:36:42,131 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2025-11-05T20:36:42,133 copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm 2025-11-05T20:36:42,136 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2025-11-05T20:36:42,139 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2025-11-05T20:36:42,141 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2025-11-05T20:36:42,144 copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm 2025-11-05T20:36:42,147 creating build/lib/deepspeed/runtime/fp16 2025-11-05T20:36:42,148 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2025-11-05T20:36:42,150 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2025-11-05T20:36:42,153 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2025-11-05T20:36:42,156 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2025-11-05T20:36:42,159 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-11-05T20:36:42,160 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-11-05T20:36:42,162 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-11-05T20:36:42,165 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-11-05T20:36:42,167 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-11-05T20:36:42,169 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-11-05T20:36:42,172 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-11-05T20:36:42,173 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-11-05T20:36:42,175 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-11-05T20:36:42,178 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-11-05T20:36:42,180 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-11-05T20:36:42,183 copying deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-11-05T20:36:42,186 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-11-05T20:36:42,189 creating build/lib/deepspeed/runtime/zero/muon 2025-11-05T20:36:42,191 copying deepspeed/runtime/zero/muon/original_muon.py -> build/lib/deepspeed/runtime/zero/muon 2025-11-05T20:36:42,194 copying deepspeed/runtime/zero/muon/__init__.py -> build/lib/deepspeed/runtime/zero/muon 2025-11-05T20:36:42,196 copying deepspeed/runtime/zero/muon/muon_optimizer.py -> build/lib/deepspeed/runtime/zero/muon 2025-11-05T20:36:42,199 creating build/lib/deepspeed/runtime/fp16/onebit 2025-11-05T20:36:42,200 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-11-05T20:36:42,202 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-11-05T20:36:42,205 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-11-05T20:36:42,208 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-11-05T20:36:42,211 running egg_info 2025-11-05T20:36:42,239 writing deepspeed.egg-info/PKG-INFO 2025-11-05T20:36:42,277 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2025-11-05T20:36:42,278 writing entry points to deepspeed.egg-info/entry_points.txt 2025-11-05T20:36:42,301 writing requirements to deepspeed.egg-info/requires.txt 2025-11-05T20:36:42,302 writing top-level names to deepspeed.egg-info/top_level.txt 2025-11-05T20:36:42,448 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2025-11-05T20:36:42,524 reading manifest template 'MANIFEST.in' 2025-11-05T20:36:42,526 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2025-11-05T20:36:42,527 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2025-11-05T20:36:44,350 warning: no files found matching '*.hip' under directory 'deepspeed' 2025-11-05T20:36:45,444 warning: no files found matching '*.cc' under directory 'deepspeed' 2025-11-05T20:36:46,277 warning: no files found matching '*.tr' under directory 'csrc' 2025-11-05T20:36:46,402 warning: no files found matching '*.cc' under directory 'csrc' 2025-11-05T20:36:46,455 warning: no files found matching '*.py' under directory 'benchmarks' 2025-11-05T20:36:46,461 adding license file 'LICENSE' 2025-11-05T20:36:46,515 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2025-11-05T20:36:46,524 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2025-11-05T20:36:46,524 !! 2025-11-05T20:36:46,525 ******************************************************************************** 2025-11-05T20:36:46,526 ############################ 2025-11-05T20:36:46,526 # Package would be ignored # 2025-11-05T20:36:46,527 ############################ 2025-11-05T20:36:46,527 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2025-11-05T20:36:46,528 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,529 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,529 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2025-11-05T20:36:46,530 to the `packages` configuration field. 2025-11-05T20:36:46,531 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,532 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,532 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,534 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,535 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,536 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2025-11-05T20:36:46,537 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2025-11-05T20:36:46,538 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,538 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,539 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,540 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,541 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,543 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,543 even if it does not contain any `.py` files. 2025-11-05T20:36:46,544 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,544 directory, all directories are treated like packages. 2025-11-05T20:36:46,545 ******************************************************************************** 2025-11-05T20:36:46,546 !! 2025-11-05T20:36:46,547 check.warn(importable) 2025-11-05T20:36:46,547 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration. 2025-11-05T20:36:46,548 !! 2025-11-05T20:36:46,549 ******************************************************************************** 2025-11-05T20:36:46,550 ############################ 2025-11-05T20:36:46,551 # Package would be ignored # 2025-11-05T20:36:46,551 ############################ 2025-11-05T20:36:46,551 Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1], 2025-11-05T20:36:46,552 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,552 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,553 package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added 2025-11-05T20:36:46,553 to the `packages` configuration field. 2025-11-05T20:36:46,554 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,554 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,555 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,556 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,556 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,557 If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are 2025-11-05T20:36:46,558 already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via 2025-11-05T20:36:46,558 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,558 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,559 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,560 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,561 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,563 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,563 even if it does not contain any `.py` files. 2025-11-05T20:36:46,564 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,564 directory, all directories are treated like packages. 2025-11-05T20:36:46,565 ******************************************************************************** 2025-11-05T20:36:46,566 !! 2025-11-05T20:36:46,567 check.warn(importable) 2025-11-05T20:36:46,567 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration. 2025-11-05T20:36:46,568 !! 2025-11-05T20:36:46,569 ******************************************************************************** 2025-11-05T20:36:46,570 ############################ 2025-11-05T20:36:46,570 # Package would be ignored # 2025-11-05T20:36:46,571 ############################ 2025-11-05T20:36:46,571 Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1], 2025-11-05T20:36:46,572 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,573 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,573 package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added 2025-11-05T20:36:46,574 to the `packages` configuration field. 2025-11-05T20:36:46,575 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,575 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,576 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,577 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,578 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,579 If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are 2025-11-05T20:36:46,579 already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via 2025-11-05T20:36:46,579 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,580 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,580 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,581 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,582 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,583 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,583 even if it does not contain any `.py` files. 2025-11-05T20:36:46,583 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,584 directory, all directories are treated like packages. 2025-11-05T20:36:46,584 ******************************************************************************** 2025-11-05T20:36:46,585 !! 2025-11-05T20:36:46,585 check.warn(importable) 2025-11-05T20:36:46,586 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration. 2025-11-05T20:36:46,586 !! 2025-11-05T20:36:46,587 ******************************************************************************** 2025-11-05T20:36:46,588 ############################ 2025-11-05T20:36:46,588 # Package would be ignored # 2025-11-05T20:36:46,589 ############################ 2025-11-05T20:36:46,589 Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1], 2025-11-05T20:36:46,590 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,591 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,592 package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added 2025-11-05T20:36:46,592 to the `packages` configuration field. 2025-11-05T20:36:46,594 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,594 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,595 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,596 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,597 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,598 If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are 2025-11-05T20:36:46,598 already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via 2025-11-05T20:36:46,599 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,599 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,600 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,601 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,602 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,603 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,604 even if it does not contain any `.py` files. 2025-11-05T20:36:46,605 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,605 directory, all directories are treated like packages. 2025-11-05T20:36:46,606 ******************************************************************************** 2025-11-05T20:36:46,607 !! 2025-11-05T20:36:46,607 check.warn(importable) 2025-11-05T20:36:46,607 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration. 2025-11-05T20:36:46,608 !! 2025-11-05T20:36:46,608 ******************************************************************************** 2025-11-05T20:36:46,609 ############################ 2025-11-05T20:36:46,609 # Package would be ignored # 2025-11-05T20:36:46,609 ############################ 2025-11-05T20:36:46,610 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1], 2025-11-05T20:36:46,610 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,611 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,611 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added 2025-11-05T20:36:46,612 to the `packages` configuration field. 2025-11-05T20:36:46,613 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,613 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,613 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,615 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,616 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,617 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are 2025-11-05T20:36:46,617 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via 2025-11-05T20:36:46,618 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,619 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,619 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,621 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,622 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,624 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,624 even if it does not contain any `.py` files. 2025-11-05T20:36:46,625 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,625 directory, all directories are treated like packages. 2025-11-05T20:36:46,626 ******************************************************************************** 2025-11-05T20:36:46,627 !! 2025-11-05T20:36:46,627 check.warn(importable) 2025-11-05T20:36:46,628 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration. 2025-11-05T20:36:46,628 !! 2025-11-05T20:36:46,629 ******************************************************************************** 2025-11-05T20:36:46,630 ############################ 2025-11-05T20:36:46,630 # Package would be ignored # 2025-11-05T20:36:46,631 ############################ 2025-11-05T20:36:46,631 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1], 2025-11-05T20:36:46,632 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,633 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,634 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added 2025-11-05T20:36:46,634 to the `packages` configuration field. 2025-11-05T20:36:46,635 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,635 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,635 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,636 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,637 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,638 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are 2025-11-05T20:36:46,638 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via 2025-11-05T20:36:46,638 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,639 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,639 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,640 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,641 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,642 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,643 even if it does not contain any `.py` files. 2025-11-05T20:36:46,644 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,644 directory, all directories are treated like packages. 2025-11-05T20:36:46,645 ******************************************************************************** 2025-11-05T20:36:46,646 !! 2025-11-05T20:36:46,646 check.warn(importable) 2025-11-05T20:36:46,647 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration. 2025-11-05T20:36:46,648 !! 2025-11-05T20:36:46,649 ******************************************************************************** 2025-11-05T20:36:46,649 ############################ 2025-11-05T20:36:46,650 # Package would be ignored # 2025-11-05T20:36:46,650 ############################ 2025-11-05T20:36:46,651 Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1], 2025-11-05T20:36:46,651 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,652 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,653 package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added 2025-11-05T20:36:46,653 to the `packages` configuration field. 2025-11-05T20:36:46,654 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,655 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,655 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,656 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,658 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,659 If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are 2025-11-05T20:36:46,659 already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via 2025-11-05T20:36:46,660 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,661 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,661 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,662 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,663 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,664 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,664 even if it does not contain any `.py` files. 2025-11-05T20:36:46,664 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,665 directory, all directories are treated like packages. 2025-11-05T20:36:46,665 ******************************************************************************** 2025-11-05T20:36:46,666 !! 2025-11-05T20:36:46,666 check.warn(importable) 2025-11-05T20:36:46,667 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration. 2025-11-05T20:36:46,667 !! 2025-11-05T20:36:46,668 ******************************************************************************** 2025-11-05T20:36:46,668 ############################ 2025-11-05T20:36:46,669 # Package would be ignored # 2025-11-05T20:36:46,669 ############################ 2025-11-05T20:36:46,669 Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1], 2025-11-05T20:36:46,670 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,671 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,672 package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added 2025-11-05T20:36:46,672 to the `packages` configuration field. 2025-11-05T20:36:46,673 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,674 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,674 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,675 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,676 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,678 If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are 2025-11-05T20:36:46,678 already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via 2025-11-05T20:36:46,679 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,679 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,680 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,681 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,682 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,683 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,683 even if it does not contain any `.py` files. 2025-11-05T20:36:46,684 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,684 directory, all directories are treated like packages. 2025-11-05T20:36:46,685 ******************************************************************************** 2025-11-05T20:36:46,686 !! 2025-11-05T20:36:46,687 check.warn(importable) 2025-11-05T20:36:46,687 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2025-11-05T20:36:46,688 !! 2025-11-05T20:36:46,689 ******************************************************************************** 2025-11-05T20:36:46,689 ############################ 2025-11-05T20:36:46,690 # Package would be ignored # 2025-11-05T20:36:46,690 ############################ 2025-11-05T20:36:46,690 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2025-11-05T20:36:46,691 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,691 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,692 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2025-11-05T20:36:46,692 to the `packages` configuration field. 2025-11-05T20:36:46,693 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,693 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,694 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,695 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,696 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,697 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2025-11-05T20:36:46,697 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2025-11-05T20:36:46,697 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,698 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,699 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,700 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,701 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,703 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,703 even if it does not contain any `.py` files. 2025-11-05T20:36:46,704 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,704 directory, all directories are treated like packages. 2025-11-05T20:36:46,705 ******************************************************************************** 2025-11-05T20:36:46,706 !! 2025-11-05T20:36:46,706 check.warn(importable) 2025-11-05T20:36:46,707 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2025-11-05T20:36:46,707 !! 2025-11-05T20:36:46,708 ******************************************************************************** 2025-11-05T20:36:46,709 ############################ 2025-11-05T20:36:46,709 # Package would be ignored # 2025-11-05T20:36:46,710 ############################ 2025-11-05T20:36:46,710 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2025-11-05T20:36:46,711 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,712 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,712 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2025-11-05T20:36:46,713 to the `packages` configuration field. 2025-11-05T20:36:46,714 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,714 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,715 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,716 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,717 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,718 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2025-11-05T20:36:46,718 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2025-11-05T20:36:46,718 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,719 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,719 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,720 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,720 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,721 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,722 even if it does not contain any `.py` files. 2025-11-05T20:36:46,722 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,723 directory, all directories are treated like packages. 2025-11-05T20:36:46,723 ******************************************************************************** 2025-11-05T20:36:46,724 !! 2025-11-05T20:36:46,724 check.warn(importable) 2025-11-05T20:36:46,724 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2025-11-05T20:36:46,725 !! 2025-11-05T20:36:46,726 ******************************************************************************** 2025-11-05T20:36:46,726 ############################ 2025-11-05T20:36:46,727 # Package would be ignored # 2025-11-05T20:36:46,728 ############################ 2025-11-05T20:36:46,728 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2025-11-05T20:36:46,729 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,730 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,730 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2025-11-05T20:36:46,731 to the `packages` configuration field. 2025-11-05T20:36:46,732 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,733 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,733 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,734 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,735 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,736 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2025-11-05T20:36:46,737 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2025-11-05T20:36:46,737 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,738 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,738 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,739 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,740 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,742 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,742 even if it does not contain any `.py` files. 2025-11-05T20:36:46,743 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,744 directory, all directories are treated like packages. 2025-11-05T20:36:46,744 ******************************************************************************** 2025-11-05T20:36:46,745 !! 2025-11-05T20:36:46,745 check.warn(importable) 2025-11-05T20:36:46,746 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2025-11-05T20:36:46,746 !! 2025-11-05T20:36:46,747 ******************************************************************************** 2025-11-05T20:36:46,747 ############################ 2025-11-05T20:36:46,747 # Package would be ignored # 2025-11-05T20:36:46,748 ############################ 2025-11-05T20:36:46,748 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2025-11-05T20:36:46,748 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,749 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,749 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2025-11-05T20:36:46,750 to the `packages` configuration field. 2025-11-05T20:36:46,751 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,751 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,751 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,752 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,753 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,754 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2025-11-05T20:36:46,754 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2025-11-05T20:36:46,755 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,755 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,756 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,757 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,758 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,760 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,760 even if it does not contain any `.py` files. 2025-11-05T20:36:46,761 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,761 directory, all directories are treated like packages. 2025-11-05T20:36:46,762 ******************************************************************************** 2025-11-05T20:36:46,763 !! 2025-11-05T20:36:46,763 check.warn(importable) 2025-11-05T20:36:46,764 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2025-11-05T20:36:46,764 !! 2025-11-05T20:36:46,765 ******************************************************************************** 2025-11-05T20:36:46,766 ############################ 2025-11-05T20:36:46,766 # Package would be ignored # 2025-11-05T20:36:46,767 ############################ 2025-11-05T20:36:46,767 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2025-11-05T20:36:46,768 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,769 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,769 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2025-11-05T20:36:46,770 to the `packages` configuration field. 2025-11-05T20:36:46,771 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,771 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,772 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,773 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,774 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,775 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2025-11-05T20:36:46,775 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2025-11-05T20:36:46,775 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,776 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,776 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,777 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,778 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,779 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,779 even if it does not contain any `.py` files. 2025-11-05T20:36:46,780 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,780 directory, all directories are treated like packages. 2025-11-05T20:36:46,781 ******************************************************************************** 2025-11-05T20:36:46,782 !! 2025-11-05T20:36:46,782 check.warn(importable) 2025-11-05T20:36:46,783 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.compile' is absent from the `packages` configuration. 2025-11-05T20:36:46,783 !! 2025-11-05T20:36:46,785 ******************************************************************************** 2025-11-05T20:36:46,785 ############################ 2025-11-05T20:36:46,786 # Package would be ignored # 2025-11-05T20:36:46,786 ############################ 2025-11-05T20:36:46,787 Python recognizes 'deepspeed.ops.csrc.compile' as an importable package[^1], 2025-11-05T20:36:46,787 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,789 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,789 package, please make sure that 'deepspeed.ops.csrc.compile' is explicitly added 2025-11-05T20:36:46,790 to the `packages` configuration field. 2025-11-05T20:36:46,791 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,791 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,792 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,792 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,793 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,794 If you don't want 'deepspeed.ops.csrc.compile' to be distributed and are 2025-11-05T20:36:46,795 already explicitly excluding 'deepspeed.ops.csrc.compile' via 2025-11-05T20:36:46,796 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,796 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,797 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,798 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,799 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,800 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,800 even if it does not contain any `.py` files. 2025-11-05T20:36:46,801 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,801 directory, all directories are treated like packages. 2025-11-05T20:36:46,801 ******************************************************************************** 2025-11-05T20:36:46,802 !! 2025-11-05T20:36:46,802 check.warn(importable) 2025-11-05T20:36:46,803 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration. 2025-11-05T20:36:46,803 !! 2025-11-05T20:36:46,804 ******************************************************************************** 2025-11-05T20:36:46,804 ############################ 2025-11-05T20:36:46,805 # Package would be ignored # 2025-11-05T20:36:46,805 ############################ 2025-11-05T20:36:46,805 Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1], 2025-11-05T20:36:46,806 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,807 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,807 package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added 2025-11-05T20:36:46,807 to the `packages` configuration field. 2025-11-05T20:36:46,808 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,809 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,809 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,810 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,811 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,812 If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are 2025-11-05T20:36:46,813 already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via 2025-11-05T20:36:46,813 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,814 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,814 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,816 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,817 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,818 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,818 even if it does not contain any `.py` files. 2025-11-05T20:36:46,819 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,819 directory, all directories are treated like packages. 2025-11-05T20:36:46,820 ******************************************************************************** 2025-11-05T20:36:46,821 !! 2025-11-05T20:36:46,821 check.warn(importable) 2025-11-05T20:36:46,822 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2025-11-05T20:36:46,822 !! 2025-11-05T20:36:46,824 ******************************************************************************** 2025-11-05T20:36:46,824 ############################ 2025-11-05T20:36:46,825 # Package would be ignored # 2025-11-05T20:36:46,826 ############################ 2025-11-05T20:36:46,826 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2025-11-05T20:36:46,826 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,827 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,827 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2025-11-05T20:36:46,828 to the `packages` configuration field. 2025-11-05T20:36:46,828 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,829 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,829 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,830 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,831 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,831 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2025-11-05T20:36:46,832 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2025-11-05T20:36:46,832 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,833 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,833 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,834 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,835 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,836 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,836 even if it does not contain any `.py` files. 2025-11-05T20:36:46,837 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,837 directory, all directories are treated like packages. 2025-11-05T20:36:46,838 ******************************************************************************** 2025-11-05T20:36:46,839 !! 2025-11-05T20:36:46,839 check.warn(importable) 2025-11-05T20:36:46,840 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.comm.riscv64' is absent from the `packages` configuration. 2025-11-05T20:36:46,841 !! 2025-11-05T20:36:46,842 ******************************************************************************** 2025-11-05T20:36:46,842 ############################ 2025-11-05T20:36:46,843 # Package would be ignored # 2025-11-05T20:36:46,843 ############################ 2025-11-05T20:36:46,844 Python recognizes 'deepspeed.ops.csrc.cpu.comm.riscv64' as an importable package[^1], 2025-11-05T20:36:46,844 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,845 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,846 package, please make sure that 'deepspeed.ops.csrc.cpu.comm.riscv64' is explicitly added 2025-11-05T20:36:46,846 to the `packages` configuration field. 2025-11-05T20:36:46,848 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,848 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,849 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,850 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,851 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,852 If you don't want 'deepspeed.ops.csrc.cpu.comm.riscv64' to be distributed and are 2025-11-05T20:36:46,853 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm.riscv64' via 2025-11-05T20:36:46,854 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,854 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,854 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,855 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,856 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,857 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,858 even if it does not contain any `.py` files. 2025-11-05T20:36:46,858 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,859 directory, all directories are treated like packages. 2025-11-05T20:36:46,859 ******************************************************************************** 2025-11-05T20:36:46,860 !! 2025-11-05T20:36:46,861 check.warn(importable) 2025-11-05T20:36:46,861 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.comm.x86_64' is absent from the `packages` configuration. 2025-11-05T20:36:46,862 !! 2025-11-05T20:36:46,863 ******************************************************************************** 2025-11-05T20:36:46,863 ############################ 2025-11-05T20:36:46,864 # Package would be ignored # 2025-11-05T20:36:46,864 ############################ 2025-11-05T20:36:46,865 Python recognizes 'deepspeed.ops.csrc.cpu.comm.x86_64' as an importable package[^1], 2025-11-05T20:36:46,865 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,867 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,867 package, please make sure that 'deepspeed.ops.csrc.cpu.comm.x86_64' is explicitly added 2025-11-05T20:36:46,868 to the `packages` configuration field. 2025-11-05T20:36:46,869 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,870 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,871 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,872 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,873 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,875 If you don't want 'deepspeed.ops.csrc.cpu.comm.x86_64' to be distributed and are 2025-11-05T20:36:46,875 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm.x86_64' via 2025-11-05T20:36:46,876 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,877 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,877 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,878 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,880 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,881 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,882 even if it does not contain any `.py` files. 2025-11-05T20:36:46,883 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,883 directory, all directories are treated like packages. 2025-11-05T20:36:46,884 ******************************************************************************** 2025-11-05T20:36:46,886 !! 2025-11-05T20:36:46,887 check.warn(importable) 2025-11-05T20:36:46,887 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration. 2025-11-05T20:36:46,888 !! 2025-11-05T20:36:46,889 ******************************************************************************** 2025-11-05T20:36:46,889 ############################ 2025-11-05T20:36:46,890 # Package would be ignored # 2025-11-05T20:36:46,890 ############################ 2025-11-05T20:36:46,891 Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1], 2025-11-05T20:36:46,891 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,892 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,892 package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added 2025-11-05T20:36:46,893 to the `packages` configuration field. 2025-11-05T20:36:46,894 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,895 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,895 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,896 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,897 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,898 If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are 2025-11-05T20:36:46,899 already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via 2025-11-05T20:36:46,900 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,900 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,901 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,902 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,904 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,906 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,907 even if it does not contain any `.py` files. 2025-11-05T20:36:46,907 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,908 directory, all directories are treated like packages. 2025-11-05T20:36:46,909 ******************************************************************************** 2025-11-05T20:36:46,910 !! 2025-11-05T20:36:46,911 check.warn(importable) 2025-11-05T20:36:46,911 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration. 2025-11-05T20:36:46,912 !! 2025-11-05T20:36:46,913 ******************************************************************************** 2025-11-05T20:36:46,914 ############################ 2025-11-05T20:36:46,914 # Package would be ignored # 2025-11-05T20:36:46,915 ############################ 2025-11-05T20:36:46,916 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1], 2025-11-05T20:36:46,916 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,918 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,918 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added 2025-11-05T20:36:46,919 to the `packages` configuration field. 2025-11-05T20:36:46,921 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,921 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,922 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,923 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,924 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,925 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are 2025-11-05T20:36:46,925 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via 2025-11-05T20:36:46,926 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,926 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,927 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,928 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,929 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,931 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,931 even if it does not contain any `.py` files. 2025-11-05T20:36:46,932 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,932 directory, all directories are treated like packages. 2025-11-05T20:36:46,933 ******************************************************************************** 2025-11-05T20:36:46,934 !! 2025-11-05T20:36:46,934 check.warn(importable) 2025-11-05T20:36:46,935 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration. 2025-11-05T20:36:46,936 !! 2025-11-05T20:36:46,937 ******************************************************************************** 2025-11-05T20:36:46,938 ############################ 2025-11-05T20:36:46,939 # Package would be ignored # 2025-11-05T20:36:46,940 ############################ 2025-11-05T20:36:46,940 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1], 2025-11-05T20:36:46,941 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,943 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,944 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added 2025-11-05T20:36:46,944 to the `packages` configuration field. 2025-11-05T20:36:46,946 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,946 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,947 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,948 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,950 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,951 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are 2025-11-05T20:36:46,951 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via 2025-11-05T20:36:46,952 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,953 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,954 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,955 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,956 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,958 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,958 even if it does not contain any `.py` files. 2025-11-05T20:36:46,959 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,959 directory, all directories are treated like packages. 2025-11-05T20:36:46,959 ******************************************************************************** 2025-11-05T20:36:46,960 !! 2025-11-05T20:36:46,961 check.warn(importable) 2025-11-05T20:36:46,961 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration. 2025-11-05T20:36:46,961 !! 2025-11-05T20:36:46,962 ******************************************************************************** 2025-11-05T20:36:46,962 ############################ 2025-11-05T20:36:46,963 # Package would be ignored # 2025-11-05T20:36:46,963 ############################ 2025-11-05T20:36:46,964 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1], 2025-11-05T20:36:46,964 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,965 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,965 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added 2025-11-05T20:36:46,966 to the `packages` configuration field. 2025-11-05T20:36:46,967 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,967 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,968 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,969 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,970 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,971 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are 2025-11-05T20:36:46,971 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via 2025-11-05T20:36:46,972 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,973 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,973 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,974 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,975 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,977 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,977 even if it does not contain any `.py` files. 2025-11-05T20:36:46,978 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,978 directory, all directories are treated like packages. 2025-11-05T20:36:46,979 ******************************************************************************** 2025-11-05T20:36:46,980 !! 2025-11-05T20:36:46,980 check.warn(importable) 2025-11-05T20:36:46,981 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration. 2025-11-05T20:36:46,982 !! 2025-11-05T20:36:46,983 ******************************************************************************** 2025-11-05T20:36:46,983 ############################ 2025-11-05T20:36:46,984 # Package would be ignored # 2025-11-05T20:36:46,984 ############################ 2025-11-05T20:36:46,984 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1], 2025-11-05T20:36:46,985 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:46,985 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:46,986 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added 2025-11-05T20:36:46,986 to the `packages` configuration field. 2025-11-05T20:36:46,987 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:46,987 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:46,988 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:46,988 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:46,989 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:46,990 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are 2025-11-05T20:36:46,990 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via 2025-11-05T20:36:46,991 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:46,991 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:46,992 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:46,993 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:46,994 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:46,996 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:46,996 even if it does not contain any `.py` files. 2025-11-05T20:36:46,997 On the other hand, currently there is no concept of package data 2025-11-05T20:36:46,997 directory, all directories are treated like packages. 2025-11-05T20:36:46,998 ******************************************************************************** 2025-11-05T20:36:46,999 !! 2025-11-05T20:36:47,000 check.warn(importable) 2025-11-05T20:36:47,000 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration. 2025-11-05T20:36:47,001 !! 2025-11-05T20:36:47,002 ******************************************************************************** 2025-11-05T20:36:47,002 ############################ 2025-11-05T20:36:47,003 # Package would be ignored # 2025-11-05T20:36:47,003 ############################ 2025-11-05T20:36:47,004 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1], 2025-11-05T20:36:47,004 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,005 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,006 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added 2025-11-05T20:36:47,006 to the `packages` configuration field. 2025-11-05T20:36:47,007 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,008 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,009 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,010 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,010 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,011 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are 2025-11-05T20:36:47,011 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via 2025-11-05T20:36:47,012 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,012 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,012 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,013 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,014 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,016 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,016 even if it does not contain any `.py` files. 2025-11-05T20:36:47,016 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,017 directory, all directories are treated like packages. 2025-11-05T20:36:47,017 ******************************************************************************** 2025-11-05T20:36:47,018 !! 2025-11-05T20:36:47,018 check.warn(importable) 2025-11-05T20:36:47,019 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration. 2025-11-05T20:36:47,019 !! 2025-11-05T20:36:47,020 ******************************************************************************** 2025-11-05T20:36:47,021 ############################ 2025-11-05T20:36:47,021 # Package would be ignored # 2025-11-05T20:36:47,022 ############################ 2025-11-05T20:36:47,022 Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1], 2025-11-05T20:36:47,023 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,024 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,025 package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added 2025-11-05T20:36:47,025 to the `packages` configuration field. 2025-11-05T20:36:47,026 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,027 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,027 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,028 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,029 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,030 If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are 2025-11-05T20:36:47,031 already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via 2025-11-05T20:36:47,031 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,032 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,032 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,033 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,034 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,036 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,036 even if it does not contain any `.py` files. 2025-11-05T20:36:47,037 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,038 directory, all directories are treated like packages. 2025-11-05T20:36:47,038 ******************************************************************************** 2025-11-05T20:36:47,039 !! 2025-11-05T20:36:47,039 check.warn(importable) 2025-11-05T20:36:47,039 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration. 2025-11-05T20:36:47,040 !! 2025-11-05T20:36:47,040 ******************************************************************************** 2025-11-05T20:36:47,041 ############################ 2025-11-05T20:36:47,041 # Package would be ignored # 2025-11-05T20:36:47,042 ############################ 2025-11-05T20:36:47,042 Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1], 2025-11-05T20:36:47,042 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,043 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,044 package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added 2025-11-05T20:36:47,044 to the `packages` configuration field. 2025-11-05T20:36:47,045 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,045 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,046 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,047 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,048 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,049 If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are 2025-11-05T20:36:47,049 already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via 2025-11-05T20:36:47,050 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,051 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,051 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,052 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,053 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,055 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,055 even if it does not contain any `.py` files. 2025-11-05T20:36:47,056 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,056 directory, all directories are treated like packages. 2025-11-05T20:36:47,057 ******************************************************************************** 2025-11-05T20:36:47,058 !! 2025-11-05T20:36:47,058 check.warn(importable) 2025-11-05T20:36:47,059 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration. 2025-11-05T20:36:47,059 !! 2025-11-05T20:36:47,060 ******************************************************************************** 2025-11-05T20:36:47,061 ############################ 2025-11-05T20:36:47,061 # Package would be ignored # 2025-11-05T20:36:47,062 ############################ 2025-11-05T20:36:47,062 Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1], 2025-11-05T20:36:47,063 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,064 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,065 package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added 2025-11-05T20:36:47,065 to the `packages` configuration field. 2025-11-05T20:36:47,066 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,066 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,066 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,067 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,068 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,069 If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are 2025-11-05T20:36:47,069 already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via 2025-11-05T20:36:47,069 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,070 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,070 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,071 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,072 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,073 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,073 even if it does not contain any `.py` files. 2025-11-05T20:36:47,074 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,074 directory, all directories are treated like packages. 2025-11-05T20:36:47,075 ******************************************************************************** 2025-11-05T20:36:47,076 !! 2025-11-05T20:36:47,076 check.warn(importable) 2025-11-05T20:36:47,077 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2025-11-05T20:36:47,077 !! 2025-11-05T20:36:47,078 ******************************************************************************** 2025-11-05T20:36:47,079 ############################ 2025-11-05T20:36:47,080 # Package would be ignored # 2025-11-05T20:36:47,080 ############################ 2025-11-05T20:36:47,081 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2025-11-05T20:36:47,081 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,082 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,083 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2025-11-05T20:36:47,083 to the `packages` configuration field. 2025-11-05T20:36:47,084 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,085 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,085 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,086 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,087 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,088 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2025-11-05T20:36:47,089 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2025-11-05T20:36:47,089 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,090 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,091 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,091 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,092 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,093 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,094 even if it does not contain any `.py` files. 2025-11-05T20:36:47,094 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,095 directory, all directories are treated like packages. 2025-11-05T20:36:47,095 ******************************************************************************** 2025-11-05T20:36:47,096 !! 2025-11-05T20:36:47,097 check.warn(importable) 2025-11-05T20:36:47,097 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2025-11-05T20:36:47,097 !! 2025-11-05T20:36:47,098 ******************************************************************************** 2025-11-05T20:36:47,099 ############################ 2025-11-05T20:36:47,099 # Package would be ignored # 2025-11-05T20:36:47,099 ############################ 2025-11-05T20:36:47,100 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2025-11-05T20:36:47,100 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,101 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,102 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2025-11-05T20:36:47,102 to the `packages` configuration field. 2025-11-05T20:36:47,104 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,104 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,105 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,106 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,107 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,108 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2025-11-05T20:36:47,109 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2025-11-05T20:36:47,109 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,110 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,110 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,111 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,113 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,114 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,115 even if it does not contain any `.py` files. 2025-11-05T20:36:47,115 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,116 directory, all directories are treated like packages. 2025-11-05T20:36:47,116 ******************************************************************************** 2025-11-05T20:36:47,118 !! 2025-11-05T20:36:47,118 check.warn(importable) 2025-11-05T20:36:47,119 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration. 2025-11-05T20:36:47,119 !! 2025-11-05T20:36:47,121 ******************************************************************************** 2025-11-05T20:36:47,121 ############################ 2025-11-05T20:36:47,122 # Package would be ignored # 2025-11-05T20:36:47,122 ############################ 2025-11-05T20:36:47,123 Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1], 2025-11-05T20:36:47,123 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,124 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,124 package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added 2025-11-05T20:36:47,125 to the `packages` configuration field. 2025-11-05T20:36:47,126 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,126 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,126 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,127 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,128 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,129 If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are 2025-11-05T20:36:47,130 already explicitly excluding 'deepspeed.ops.csrc.lion' via 2025-11-05T20:36:47,130 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,131 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,131 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,132 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,133 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,135 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,135 even if it does not contain any `.py` files. 2025-11-05T20:36:47,136 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,136 directory, all directories are treated like packages. 2025-11-05T20:36:47,137 ******************************************************************************** 2025-11-05T20:36:47,138 !! 2025-11-05T20:36:47,139 check.warn(importable) 2025-11-05T20:36:47,139 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2025-11-05T20:36:47,140 !! 2025-11-05T20:36:47,141 ******************************************************************************** 2025-11-05T20:36:47,141 ############################ 2025-11-05T20:36:47,142 # Package would be ignored # 2025-11-05T20:36:47,142 ############################ 2025-11-05T20:36:47,143 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2025-11-05T20:36:47,144 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,145 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,145 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2025-11-05T20:36:47,146 to the `packages` configuration field. 2025-11-05T20:36:47,147 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,148 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,148 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,149 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,150 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,152 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2025-11-05T20:36:47,152 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2025-11-05T20:36:47,152 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,153 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,153 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,154 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,155 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,156 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,157 even if it does not contain any `.py` files. 2025-11-05T20:36:47,157 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,157 directory, all directories are treated like packages. 2025-11-05T20:36:47,158 ******************************************************************************** 2025-11-05T20:36:47,159 !! 2025-11-05T20:36:47,159 check.warn(importable) 2025-11-05T20:36:47,160 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2025-11-05T20:36:47,160 !! 2025-11-05T20:36:47,161 ******************************************************************************** 2025-11-05T20:36:47,161 ############################ 2025-11-05T20:36:47,162 # Package would be ignored # 2025-11-05T20:36:47,162 ############################ 2025-11-05T20:36:47,163 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2025-11-05T20:36:47,163 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,164 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,165 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2025-11-05T20:36:47,165 to the `packages` configuration field. 2025-11-05T20:36:47,166 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,167 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,167 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,168 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,169 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,171 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2025-11-05T20:36:47,171 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2025-11-05T20:36:47,172 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,172 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,173 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,174 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,175 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,176 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,177 even if it does not contain any `.py` files. 2025-11-05T20:36:47,177 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,178 directory, all directories are treated like packages. 2025-11-05T20:36:47,178 ******************************************************************************** 2025-11-05T20:36:47,179 !! 2025-11-05T20:36:47,180 check.warn(importable) 2025-11-05T20:36:47,180 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2025-11-05T20:36:47,181 !! 2025-11-05T20:36:47,181 ******************************************************************************** 2025-11-05T20:36:47,182 ############################ 2025-11-05T20:36:47,182 # Package would be ignored # 2025-11-05T20:36:47,183 ############################ 2025-11-05T20:36:47,183 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2025-11-05T20:36:47,183 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,184 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,185 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2025-11-05T20:36:47,185 to the `packages` configuration field. 2025-11-05T20:36:47,186 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,186 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,187 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,188 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,188 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,189 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2025-11-05T20:36:47,190 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2025-11-05T20:36:47,190 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,191 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,191 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,192 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,193 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,195 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,196 even if it does not contain any `.py` files. 2025-11-05T20:36:47,196 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,197 directory, all directories are treated like packages. 2025-11-05T20:36:47,197 ******************************************************************************** 2025-11-05T20:36:47,198 !! 2025-11-05T20:36:47,199 check.warn(importable) 2025-11-05T20:36:47,199 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2025-11-05T20:36:47,200 !! 2025-11-05T20:36:47,201 ******************************************************************************** 2025-11-05T20:36:47,201 ############################ 2025-11-05T20:36:47,202 # Package would be ignored # 2025-11-05T20:36:47,203 ############################ 2025-11-05T20:36:47,203 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2025-11-05T20:36:47,204 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,205 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,205 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2025-11-05T20:36:47,206 to the `packages` configuration field. 2025-11-05T20:36:47,207 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,207 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,208 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,209 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,210 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,211 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2025-11-05T20:36:47,211 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2025-11-05T20:36:47,211 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,212 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,212 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,213 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,214 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,215 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,216 even if it does not contain any `.py` files. 2025-11-05T20:36:47,216 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,216 directory, all directories are treated like packages. 2025-11-05T20:36:47,217 ******************************************************************************** 2025-11-05T20:36:47,218 !! 2025-11-05T20:36:47,218 check.warn(importable) 2025-11-05T20:36:47,219 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2025-11-05T20:36:47,219 !! 2025-11-05T20:36:47,220 ******************************************************************************** 2025-11-05T20:36:47,221 ############################ 2025-11-05T20:36:47,221 # Package would be ignored # 2025-11-05T20:36:47,222 ############################ 2025-11-05T20:36:47,222 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2025-11-05T20:36:47,223 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,224 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,225 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2025-11-05T20:36:47,225 to the `packages` configuration field. 2025-11-05T20:36:47,226 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,226 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,227 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,228 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,229 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,230 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2025-11-05T20:36:47,231 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2025-11-05T20:36:47,231 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,232 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,232 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,233 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,234 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,236 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,236 even if it does not contain any `.py` files. 2025-11-05T20:36:47,236 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,237 directory, all directories are treated like packages. 2025-11-05T20:36:47,237 ******************************************************************************** 2025-11-05T20:36:47,238 !! 2025-11-05T20:36:47,238 check.warn(importable) 2025-11-05T20:36:47,239 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2025-11-05T20:36:47,239 !! 2025-11-05T20:36:47,240 ******************************************************************************** 2025-11-05T20:36:47,240 ############################ 2025-11-05T20:36:47,241 # Package would be ignored # 2025-11-05T20:36:47,241 ############################ 2025-11-05T20:36:47,242 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2025-11-05T20:36:47,242 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,243 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,244 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2025-11-05T20:36:47,244 to the `packages` configuration field. 2025-11-05T20:36:47,245 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,246 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,246 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,247 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,248 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,249 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2025-11-05T20:36:47,250 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2025-11-05T20:36:47,250 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,251 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,251 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,252 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,253 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,255 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,255 even if it does not contain any `.py` files. 2025-11-05T20:36:47,256 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,256 directory, all directories are treated like packages. 2025-11-05T20:36:47,257 ******************************************************************************** 2025-11-05T20:36:47,258 !! 2025-11-05T20:36:47,258 check.warn(importable) 2025-11-05T20:36:47,259 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2025-11-05T20:36:47,259 !! 2025-11-05T20:36:47,260 ******************************************************************************** 2025-11-05T20:36:47,261 ############################ 2025-11-05T20:36:47,261 # Package would be ignored # 2025-11-05T20:36:47,262 ############################ 2025-11-05T20:36:47,263 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2025-11-05T20:36:47,263 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,264 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,264 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2025-11-05T20:36:47,265 to the `packages` configuration field. 2025-11-05T20:36:47,266 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,266 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,266 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,267 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,268 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,269 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2025-11-05T20:36:47,269 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2025-11-05T20:36:47,270 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,270 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,271 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,272 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,272 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,274 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,274 even if it does not contain any `.py` files. 2025-11-05T20:36:47,275 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,275 directory, all directories are treated like packages. 2025-11-05T20:36:47,276 ******************************************************************************** 2025-11-05T20:36:47,277 !! 2025-11-05T20:36:47,277 check.warn(importable) 2025-11-05T20:36:47,278 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2025-11-05T20:36:47,278 !! 2025-11-05T20:36:47,280 ******************************************************************************** 2025-11-05T20:36:47,280 ############################ 2025-11-05T20:36:47,281 # Package would be ignored # 2025-11-05T20:36:47,281 ############################ 2025-11-05T20:36:47,282 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2025-11-05T20:36:47,282 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,284 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,284 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2025-11-05T20:36:47,285 to the `packages` configuration field. 2025-11-05T20:36:47,286 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,286 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,287 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,288 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,289 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,290 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2025-11-05T20:36:47,290 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2025-11-05T20:36:47,291 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,291 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,292 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,293 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,294 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,295 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,296 even if it does not contain any `.py` files. 2025-11-05T20:36:47,296 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,296 directory, all directories are treated like packages. 2025-11-05T20:36:47,297 ******************************************************************************** 2025-11-05T20:36:47,298 !! 2025-11-05T20:36:47,298 check.warn(importable) 2025-11-05T20:36:47,298 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2025-11-05T20:36:47,299 !! 2025-11-05T20:36:47,300 ******************************************************************************** 2025-11-05T20:36:47,301 ############################ 2025-11-05T20:36:47,301 # Package would be ignored # 2025-11-05T20:36:47,302 ############################ 2025-11-05T20:36:47,302 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2025-11-05T20:36:47,303 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,304 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,304 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2025-11-05T20:36:47,305 to the `packages` configuration field. 2025-11-05T20:36:47,306 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,306 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,307 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,308 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,309 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,310 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2025-11-05T20:36:47,310 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2025-11-05T20:36:47,311 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,311 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,312 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,313 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,314 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,315 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,316 even if it does not contain any `.py` files. 2025-11-05T20:36:47,316 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,317 directory, all directories are treated like packages. 2025-11-05T20:36:47,317 ******************************************************************************** 2025-11-05T20:36:47,319 !! 2025-11-05T20:36:47,319 check.warn(importable) 2025-11-05T20:36:47,319 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration. 2025-11-05T20:36:47,320 !! 2025-11-05T20:36:47,321 ******************************************************************************** 2025-11-05T20:36:47,321 ############################ 2025-11-05T20:36:47,321 # Package would be ignored # 2025-11-05T20:36:47,322 ############################ 2025-11-05T20:36:47,322 Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1], 2025-11-05T20:36:47,323 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,324 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,324 package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added 2025-11-05T20:36:47,324 to the `packages` configuration field. 2025-11-05T20:36:47,325 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,326 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,326 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,327 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,328 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,328 If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are 2025-11-05T20:36:47,329 already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via 2025-11-05T20:36:47,329 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,330 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,330 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,331 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,332 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,334 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,335 even if it does not contain any `.py` files. 2025-11-05T20:36:47,335 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,336 directory, all directories are treated like packages. 2025-11-05T20:36:47,336 ******************************************************************************** 2025-11-05T20:36:47,337 !! 2025-11-05T20:36:47,338 check.warn(importable) 2025-11-05T20:36:47,338 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration. 2025-11-05T20:36:47,339 !! 2025-11-05T20:36:47,340 ******************************************************************************** 2025-11-05T20:36:47,341 ############################ 2025-11-05T20:36:47,342 # Package would be ignored # 2025-11-05T20:36:47,342 ############################ 2025-11-05T20:36:47,343 Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1], 2025-11-05T20:36:47,343 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,344 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,345 package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added 2025-11-05T20:36:47,346 to the `packages` configuration field. 2025-11-05T20:36:47,347 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,348 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,348 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,349 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,350 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,351 If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are 2025-11-05T20:36:47,351 already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via 2025-11-05T20:36:47,352 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,352 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,353 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,354 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,355 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,356 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,356 even if it does not contain any `.py` files. 2025-11-05T20:36:47,357 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,358 directory, all directories are treated like packages. 2025-11-05T20:36:47,358 ******************************************************************************** 2025-11-05T20:36:47,359 !! 2025-11-05T20:36:47,359 check.warn(importable) 2025-11-05T20:36:47,360 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration. 2025-11-05T20:36:47,360 !! 2025-11-05T20:36:47,362 ******************************************************************************** 2025-11-05T20:36:47,362 ############################ 2025-11-05T20:36:47,363 # Package would be ignored # 2025-11-05T20:36:47,363 ############################ 2025-11-05T20:36:47,364 Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1], 2025-11-05T20:36:47,364 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,365 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,366 package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added 2025-11-05T20:36:47,366 to the `packages` configuration field. 2025-11-05T20:36:47,368 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,368 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,369 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,370 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,371 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,372 If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are 2025-11-05T20:36:47,373 already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via 2025-11-05T20:36:47,373 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,374 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,374 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,375 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,376 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,378 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,378 even if it does not contain any `.py` files. 2025-11-05T20:36:47,379 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,379 directory, all directories are treated like packages. 2025-11-05T20:36:47,380 ******************************************************************************** 2025-11-05T20:36:47,381 !! 2025-11-05T20:36:47,381 check.warn(importable) 2025-11-05T20:36:47,381 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration. 2025-11-05T20:36:47,382 !! 2025-11-05T20:36:47,383 ******************************************************************************** 2025-11-05T20:36:47,383 ############################ 2025-11-05T20:36:47,384 # Package would be ignored # 2025-11-05T20:36:47,384 ############################ 2025-11-05T20:36:47,385 Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1], 2025-11-05T20:36:47,385 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,386 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,387 package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added 2025-11-05T20:36:47,387 to the `packages` configuration field. 2025-11-05T20:36:47,388 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,389 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,389 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,390 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,391 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,392 If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are 2025-11-05T20:36:47,393 already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via 2025-11-05T20:36:47,393 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,394 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,394 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,395 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,396 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,398 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,399 even if it does not contain any `.py` files. 2025-11-05T20:36:47,399 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,400 directory, all directories are treated like packages. 2025-11-05T20:36:47,400 ******************************************************************************** 2025-11-05T20:36:47,401 !! 2025-11-05T20:36:47,402 check.warn(importable) 2025-11-05T20:36:47,402 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration. 2025-11-05T20:36:47,403 !! 2025-11-05T20:36:47,404 ******************************************************************************** 2025-11-05T20:36:47,404 ############################ 2025-11-05T20:36:47,405 # Package would be ignored # 2025-11-05T20:36:47,405 ############################ 2025-11-05T20:36:47,406 Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1], 2025-11-05T20:36:47,406 but it is absent from setuptools' `packages` configuration. 2025-11-05T20:36:47,408 This leads to an ambiguous overall configuration. If you want to distribute this 2025-11-05T20:36:47,408 package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added 2025-11-05T20:36:47,408 to the `packages` configuration field. 2025-11-05T20:36:47,409 Alternatively, you can also rely on setuptools' discovery methods 2025-11-05T20:36:47,410 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-11-05T20:36:47,410 instead of `find_packages(...)`/`find:`). 2025-11-05T20:36:47,411 You can read more about "package discovery" on setuptools documentation page: 2025-11-05T20:36:47,412 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-11-05T20:36:47,412 If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are 2025-11-05T20:36:47,413 already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via 2025-11-05T20:36:47,413 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-11-05T20:36:47,414 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-11-05T20:36:47,414 combination with a more fine grained `package-data` configuration. 2025-11-05T20:36:47,415 You can read more about "package data files" on setuptools documentation page: 2025-11-05T20:36:47,416 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-11-05T20:36:47,417 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-11-05T20:36:47,418 even if it does not contain any `.py` files. 2025-11-05T20:36:47,418 On the other hand, currently there is no concept of package data 2025-11-05T20:36:47,419 directory, all directories are treated like packages. 2025-11-05T20:36:47,419 ******************************************************************************** 2025-11-05T20:36:47,420 !! 2025-11-05T20:36:47,421 check.warn(importable) 2025-11-05T20:36:47,421 creating build/lib/deepspeed/autotuning/config_templates 2025-11-05T20:36:47,422 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2025-11-05T20:36:47,422 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2025-11-05T20:36:47,423 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2025-11-05T20:36:47,423 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2025-11-05T20:36:47,424 creating build/lib/deepspeed/ops/csrc/adagrad 2025-11-05T20:36:47,424 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2025-11-05T20:36:47,425 creating build/lib/deepspeed/ops/csrc/adam 2025-11-05T20:36:47,425 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2025-11-05T20:36:47,426 copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam 2025-11-05T20:36:47,426 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2025-11-05T20:36:47,427 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2025-11-05T20:36:47,427 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2025-11-05T20:36:47,428 creating build/lib/deepspeed/ops/csrc/aio/common 2025-11-05T20:36:47,428 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2025-11-05T20:36:47,429 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2025-11-05T20:36:47,429 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2025-11-05T20:36:47,430 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2025-11-05T20:36:47,430 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2025-11-05T20:36:47,431 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2025-11-05T20:36:47,431 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,432 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,432 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,433 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,433 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,433 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,434 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,434 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,435 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,435 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,436 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,436 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,437 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,437 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,438 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,438 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,439 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,439 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:47,440 creating build/lib/deepspeed/ops/csrc/aio/py_test 2025-11-05T20:36:47,440 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2025-11-05T20:36:47,440 creating build/lib/deepspeed/ops/csrc/compile 2025-11-05T20:36:47,441 copying deepspeed/ops/csrc/compile/deepcompile.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-11-05T20:36:47,441 copying deepspeed/ops/csrc/compile/init.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-11-05T20:36:47,442 copying deepspeed/ops/csrc/compile/util.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-11-05T20:36:47,443 copying deepspeed/ops/csrc/compile/z1.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-11-05T20:36:47,443 copying deepspeed/ops/csrc/compile/z1.h -> build/lib/deepspeed/ops/csrc/compile 2025-11-05T20:36:47,443 copying deepspeed/ops/csrc/compile/z2.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-11-05T20:36:47,444 copying deepspeed/ops/csrc/compile/z2.h -> build/lib/deepspeed/ops/csrc/compile 2025-11-05T20:36:47,445 copying deepspeed/ops/csrc/compile/z3.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-11-05T20:36:47,445 copying deepspeed/ops/csrc/compile/z3.h -> build/lib/deepspeed/ops/csrc/compile 2025-11-05T20:36:47,446 creating build/lib/deepspeed/ops/csrc/cpu/adam 2025-11-05T20:36:47,446 copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam 2025-11-05T20:36:47,447 creating build/lib/deepspeed/ops/csrc/cpu/comm 2025-11-05T20:36:47,447 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-11-05T20:36:47,448 copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-11-05T20:36:47,448 copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-11-05T20:36:47,448 copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-11-05T20:36:47,449 creating build/lib/deepspeed/ops/csrc/cpu/comm/riscv64 2025-11-05T20:36:47,449 copying deepspeed/ops/csrc/cpu/comm/riscv64/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm/riscv64 2025-11-05T20:36:47,450 creating build/lib/deepspeed/ops/csrc/cpu/comm/x86_64 2025-11-05T20:36:47,450 copying deepspeed/ops/csrc/cpu/comm/x86_64/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm/x86_64 2025-11-05T20:36:47,450 creating build/lib/deepspeed/ops/csrc/cpu/lion 2025-11-05T20:36:47,451 copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion 2025-11-05T20:36:47,451 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-11-05T20:36:47,452 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-11-05T20:36:47,452 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-11-05T20:36:47,453 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-11-05T20:36:47,453 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-11-05T20:36:47,454 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-11-05T20:36:47,454 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-11-05T20:36:47,455 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-11-05T20:36:47,455 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-11-05T20:36:47,456 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-11-05T20:36:47,456 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-11-05T20:36:47,457 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-11-05T20:36:47,457 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-11-05T20:36:47,458 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-11-05T20:36:47,458 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-11-05T20:36:47,459 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-11-05T20:36:47,459 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-11-05T20:36:47,460 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-11-05T20:36:47,460 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-11-05T20:36:47,461 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-11-05T20:36:47,461 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-11-05T20:36:47,462 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-11-05T20:36:47,462 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-11-05T20:36:47,463 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-11-05T20:36:47,463 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-11-05T20:36:47,464 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-11-05T20:36:47,464 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-11-05T20:36:47,465 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-11-05T20:36:47,465 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-11-05T20:36:47,465 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-11-05T20:36:47,466 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-11-05T20:36:47,466 creating build/lib/deepspeed/ops/csrc/fp_quantizer 2025-11-05T20:36:47,467 copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer 2025-11-05T20:36:47,467 copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer 2025-11-05T20:36:47,468 creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2025-11-05T20:36:47,468 copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2025-11-05T20:36:47,469 copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2025-11-05T20:36:47,469 creating build/lib/deepspeed/ops/csrc/gds/py_lib 2025-11-05T20:36:47,470 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-11-05T20:36:47,470 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-11-05T20:36:47,471 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-11-05T20:36:47,471 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-11-05T20:36:47,472 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-11-05T20:36:47,472 copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-11-05T20:36:47,473 creating build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,473 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,474 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,474 copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,475 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,475 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,476 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,478 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,480 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,482 copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,485 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,487 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,490 copying deepspeed/ops/csrc/includes/deepcompile.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,492 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,495 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,497 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,500 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,502 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,504 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,506 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,509 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,511 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,514 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,517 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,519 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,522 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,524 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,527 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,530 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,532 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,535 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2025-11-05T20:36:47,537 creating build/lib/deepspeed/ops/csrc/lamb 2025-11-05T20:36:47,538 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2025-11-05T20:36:47,540 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2025-11-05T20:36:47,543 creating build/lib/deepspeed/ops/csrc/lion 2025-11-05T20:36:47,544 copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion 2025-11-05T20:36:47,546 copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion 2025-11-05T20:36:47,549 copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion 2025-11-05T20:36:47,551 copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion 2025-11-05T20:36:47,553 copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion 2025-11-05T20:36:47,556 creating build/lib/deepspeed/ops/csrc/quantization 2025-11-05T20:36:47,556 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-11-05T20:36:47,559 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-11-05T20:36:47,562 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2025-11-05T20:36:47,565 copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-11-05T20:36:47,568 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-11-05T20:36:47,570 copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-11-05T20:36:47,572 copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-11-05T20:36:47,575 creating build/lib/deepspeed/ops/csrc/random_ltd 2025-11-05T20:36:47,576 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2025-11-05T20:36:47,579 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2025-11-05T20:36:47,581 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2025-11-05T20:36:47,584 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2025-11-05T20:36:47,586 creating build/lib/deepspeed/ops/csrc/sparse_attention 2025-11-05T20:36:47,587 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2025-11-05T20:36:47,590 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2025-11-05T20:36:47,591 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2025-11-05T20:36:47,594 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2025-11-05T20:36:47,596 creating build/lib/deepspeed/ops/csrc/spatial/includes 2025-11-05T20:36:47,597 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2025-11-05T20:36:47,599 creating build/lib/deepspeed/ops/csrc/transformer 2025-11-05T20:36:47,600 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-11-05T20:36:47,603 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-11-05T20:36:47,606 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2025-11-05T20:36:47,609 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-11-05T20:36:47,612 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-11-05T20:36:47,615 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-11-05T20:36:47,618 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-11-05T20:36:47,621 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-11-05T20:36:47,624 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:47,626 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:47,628 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:47,631 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:47,634 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:47,637 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:47,639 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:47,643 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:47,645 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:47,647 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:47,650 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:47,653 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-11-05T20:36:47,654 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-11-05T20:36:47,657 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-11-05T20:36:47,660 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-11-05T20:36:47,662 creating build/lib/deepspeed/ops/csrc/utils 2025-11-05T20:36:47,663 copying deepspeed/ops/csrc/utils/py_ds_utils.cpp -> build/lib/deepspeed/ops/csrc/utils 2025-11-05T20:36:47,665 copying deepspeed/ops/csrc/utils/tensor_cast.cpp -> build/lib/deepspeed/ops/csrc/utils 2025-11-05T20:36:47,667 copying deepspeed/ops/csrc/utils/tensor_cast.h -> build/lib/deepspeed/ops/csrc/utils 2025-11-05T20:36:47,669 creating build/lib/deepspeed/ops/csrc/xpu/adagrad 2025-11-05T20:36:47,671 copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad 2025-11-05T20:36:47,674 creating build/lib/deepspeed/ops/csrc/xpu/adam 2025-11-05T20:36:47,675 copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2025-11-05T20:36:47,677 copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2025-11-05T20:36:47,679 copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2025-11-05T20:36:47,682 creating build/lib/deepspeed/ops/csrc/xpu/common 2025-11-05T20:36:47,683 copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common 2025-11-05T20:36:47,685 creating build/lib/deepspeed/ops/csrc/xpu/includes 2025-11-05T20:36:47,686 copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-11-05T20:36:47,688 copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-11-05T20:36:47,690 copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-11-05T20:36:47,693 copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-11-05T20:36:47,696 copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-11-05T20:36:47,698 creating build/lib/deepspeed/ops/csrc/xpu/packbits 2025-11-05T20:36:47,699 copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits 2025-11-05T20:36:47,702 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-11-05T20:36:47,705 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-11-05T20:36:47,707 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-11-05T20:36:47,709 creating build/lib/deepspeed/inference/v2/ragged/csrc 2025-11-05T20:36:47,710 copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc 2025-11-05T20:36:47,712 copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc 2025-11-05T20:36:47,714 creating build/lib/deepspeed/inference/v2/ragged/includes 2025-11-05T20:36:47,715 copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes 2025-11-05T20:36:47,717 creating build/lib/deepspeed/inference/v2/kernels/includes 2025-11-05T20:36:47,718 copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-11-05T20:36:47,720 copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-11-05T20:36:47,723 copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-11-05T20:36:47,725 copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-11-05T20:36:47,728 copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-11-05T20:36:47,731 copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops 2025-11-05T20:36:47,733 copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2025-11-05T20:36:47,735 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-11-05T20:36:47,736 copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-11-05T20:36:47,738 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2025-11-05T20:36:47,740 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes 2025-11-05T20:36:47,741 copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes 2025-11-05T20:36:47,744 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-11-05T20:36:47,745 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-11-05T20:36:47,747 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-11-05T20:36:47,749 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-11-05T20:36:47,751 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-11-05T20:36:47,754 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-11-05T20:36:47,756 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-11-05T20:36:47,758 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-11-05T20:36:47,761 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:47,762 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:47,764 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:47,767 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:47,769 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:47,771 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:47,774 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:47,776 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:47,779 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:47,781 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:47,783 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-11-05T20:36:47,786 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-11-05T20:36:47,788 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-11-05T20:36:47,790 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-11-05T20:36:47,793 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-11-05T20:36:47,795 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-11-05T20:36:47,798 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-11-05T20:36:47,800 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-11-05T20:36:47,803 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:47,805 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:47,807 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:47,810 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-11-05T20:36:47,813 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-11-05T20:36:47,815 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-11-05T20:36:47,817 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-11-05T20:36:47,820 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-11-05T20:36:47,822 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-11-05T20:36:47,824 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-11-05T20:36:47,826 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-11-05T20:36:47,828 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-11-05T20:36:47,831 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-11-05T20:36:47,833 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-11-05T20:36:47,835 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-11-05T20:36:47,837 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-11-05T20:36:47,839 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-11-05T20:36:47,841 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-11-05T20:36:47,843 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-11-05T20:36:47,845 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-11-05T20:36:47,848 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-11-05T20:36:47,850 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-11-05T20:36:47,852 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-11-05T20:36:47,855 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-11-05T20:36:47,857 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-11-05T20:36:47,859 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-11-05T20:36:47,861 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-11-05T20:36:47,864 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-11-05T20:36:47,866 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-11-05T20:36:47,868 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-11-05T20:36:47,871 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:47,873 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:47,875 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:47,877 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:47,880 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-11-05T20:36:47,882 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-11-05T20:36:47,884 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-11-05T20:36:47,886 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-11-05T20:36:47,889 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-11-05T20:36:47,891 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-11-05T20:36:47,893 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-11-05T20:36:47,895 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-11-05T20:36:47,953 running build_scripts 2025-11-05T20:36:47,954 creating build/scripts-3.11 2025-11-05T20:36:47,955 copying and adjusting bin/deepspeed -> build/scripts-3.11 2025-11-05T20:36:47,956 copying and adjusting bin/deepspeed.pt -> build/scripts-3.11 2025-11-05T20:36:47,958 copying and adjusting bin/ds -> build/scripts-3.11 2025-11-05T20:36:47,960 copying bin/ds_ssh -> build/scripts-3.11 2025-11-05T20:36:47,961 copying and adjusting bin/ds_report -> build/scripts-3.11 2025-11-05T20:36:47,963 copying and adjusting bin/ds_bench -> build/scripts-3.11 2025-11-05T20:36:47,964 copying and adjusting bin/dsr -> build/scripts-3.11 2025-11-05T20:36:47,966 copying and adjusting bin/ds_elastic -> build/scripts-3.11 2025-11-05T20:36:47,967 copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11 2025-11-05T20:36:47,969 copying and adjusting bin/ds_io -> build/scripts-3.11 2025-11-05T20:36:47,970 changing mode of build/scripts-3.11/deepspeed from 644 to 755 2025-11-05T20:36:47,970 changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755 2025-11-05T20:36:47,971 changing mode of build/scripts-3.11/ds from 644 to 755 2025-11-05T20:36:47,971 changing mode of build/scripts-3.11/ds_report from 644 to 755 2025-11-05T20:36:47,972 changing mode of build/scripts-3.11/ds_bench from 644 to 755 2025-11-05T20:36:47,972 changing mode of build/scripts-3.11/dsr from 644 to 755 2025-11-05T20:36:47,973 changing mode of build/scripts-3.11/ds_elastic from 644 to 755 2025-11-05T20:36:47,974 changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755 2025-11-05T20:36:47,974 changing mode of build/scripts-3.11/ds_io from 644 to 755 2025-11-05T20:36:48,000 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-11-05T20:36:48,001 !! 2025-11-05T20:36:48,002 ******************************************************************************** 2025-11-05T20:36:48,002 Please avoid running ``setup.py`` directly. 2025-11-05T20:36:48,003 Instead, use pypa/build, pypa/installer or other 2025-11-05T20:36:48,003 standards-based tools. 2025-11-05T20:36:48,004 This deprecation is overdue, please update your project and remove deprecated 2025-11-05T20:36:48,005 calls to avoid build errors in the future. 2025-11-05T20:36:48,005 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-11-05T20:36:48,006 ******************************************************************************** 2025-11-05T20:36:48,007 !! 2025-11-05T20:36:48,007 self.initialize_options() 2025-11-05T20:36:48,027 installing to build/bdist.linux-armv7l/wheel 2025-11-05T20:36:48,028 running install 2025-11-05T20:36:48,051 running install_lib 2025-11-05T20:36:48,078 creating build/bdist.linux-armv7l/wheel 2025-11-05T20:36:48,080 creating build/bdist.linux-armv7l/wheel/deepspeed 2025-11-05T20:36:48,082 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2025-11-05T20:36:48,083 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-11-05T20:36:48,086 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2025-11-05T20:36:48,087 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-11-05T20:36:48,089 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-11-05T20:36:48,091 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-11-05T20:36:48,093 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-11-05T20:36:48,095 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-11-05T20:36:48,097 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-11-05T20:36:48,099 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-11-05T20:36:48,102 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-11-05T20:36:48,105 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-11-05T20:36:48,108 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2025-11-05T20:36:48,109 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-11-05T20:36:48,112 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-11-05T20:36:48,114 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-11-05T20:36:48,117 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-11-05T20:36:48,118 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-11-05T20:36:48,121 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-11-05T20:36:48,126 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2025-11-05T20:36:48,128 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2025-11-05T20:36:48,130 copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-11-05T20:36:48,134 copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-11-05T20:36:48,137 copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-11-05T20:36:48,139 copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-11-05T20:36:48,144 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2025-11-05T20:36:48,146 copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science 2025-11-05T20:36:48,152 copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science 2025-11-05T20:36:48,161 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2025-11-05T20:36:48,164 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb 2025-11-05T20:36:48,173 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb 2025-11-05T20:36:48,180 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2025-11-05T20:36:48,182 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio 2025-11-05T20:36:48,186 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops 2025-11-05T20:36:48,205 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2025-11-05T20:36:48,211 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd 2025-11-05T20:36:48,225 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd 2025-11-05T20:36:48,241 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2025-11-05T20:36:48,245 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad 2025-11-05T20:36:48,465 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad 2025-11-05T20:36:48,468 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/compile 2025-11-05T20:36:48,469 copying build/lib/deepspeed/ops/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/compile 2025-11-05T20:36:48,473 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2025-11-05T20:36:48,475 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2025-11-05T20:36:48,477 copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-11-05T20:36:48,479 copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-11-05T20:36:48,481 copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-11-05T20:36:48,484 copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-11-05T20:36:48,486 copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-11-05T20:36:48,488 copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-11-05T20:36:48,490 copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-11-05T20:36:48,493 copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-11-05T20:36:48,496 copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-11-05T20:36:48,498 copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-11-05T20:36:48,501 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,503 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,506 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,508 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,511 copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,513 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,515 copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,518 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,521 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/sdaa 2025-11-05T20:36:48,522 copying build/lib/deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-11-05T20:36:48,525 copying build/lib/deepspeed/ops/op_builder/sdaa/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-11-05T20:36:48,527 copying build/lib/deepspeed/ops/op_builder/sdaa/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-11-05T20:36:48,530 copying build/lib/deepspeed/ops/op_builder/sdaa/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-11-05T20:36:48,532 copying build/lib/deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-11-05T20:36:48,535 copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,537 copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,540 copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,543 copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,545 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,548 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,551 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,553 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,556 copying build/lib/deepspeed/ops/op_builder/dc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,559 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2025-11-05T20:36:48,560 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-11-05T20:36:48,563 copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-11-05T20:36:48,565 copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-11-05T20:36:48,567 copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-11-05T20:36:48,570 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-11-05T20:36:48,572 copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-11-05T20:36:48,576 copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-11-05T20:36:48,578 copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-11-05T20:36:48,581 copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-11-05T20:36:48,583 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,586 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2025-11-05T20:36:48,588 copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-11-05T20:36:48,590 copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-11-05T20:36:48,592 copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-11-05T20:36:48,595 copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-11-05T20:36:48,597 copying build/lib/deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-11-05T20:36:48,599 copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-11-05T20:36:48,600 copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-11-05T20:36:48,603 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu 2025-11-05T20:36:48,604 copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-11-05T20:36:48,605 copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-11-05T20:36:48,607 copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-11-05T20:36:48,609 copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-11-05T20:36:48,610 copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-11-05T20:36:48,612 copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-11-05T20:36:48,614 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,616 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2025-11-05T20:36:48,617 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-11-05T20:36:48,619 copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-11-05T20:36:48,621 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-11-05T20:36:48,622 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-11-05T20:36:48,624 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-11-05T20:36:48,626 copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-11-05T20:36:48,628 copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-11-05T20:36:48,630 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,631 copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,633 copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,635 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,637 copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,639 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,641 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-11-05T20:36:48,643 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer 2025-11-05T20:36:48,644 copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-11-05T20:36:48,646 copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-11-05T20:36:48,648 copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-11-05T20:36:48,650 copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-11-05T20:36:48,652 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2025-11-05T20:36:48,653 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer 2025-11-05T20:36:48,655 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer 2025-11-05T20:36:48,657 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2025-11-05T20:36:48,659 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu 2025-11-05T20:36:48,660 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits 2025-11-05T20:36:48,661 copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits 2025-11-05T20:36:48,664 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad 2025-11-05T20:36:48,665 copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad 2025-11-05T20:36:48,668 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2025-11-05T20:36:48,669 copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-11-05T20:36:48,671 copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-11-05T20:36:48,673 copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-11-05T20:36:48,675 copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-11-05T20:36:48,677 copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-11-05T20:36:48,680 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam 2025-11-05T20:36:48,681 copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2025-11-05T20:36:48,684 copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2025-11-05T20:36:48,686 copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2025-11-05T20:36:48,688 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common 2025-11-05T20:36:48,689 copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common 2025-11-05T20:36:48,691 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2025-11-05T20:36:48,692 copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-11-05T20:36:48,695 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-11-05T20:36:48,697 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-11-05T20:36:48,699 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-11-05T20:36:48,701 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-11-05T20:36:48,703 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science 2025-11-05T20:36:48,705 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-11-05T20:36:48,706 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-11-05T20:36:48,708 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-11-05T20:36:48,710 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-11-05T20:36:48,714 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-11-05T20:36:48,715 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-11-05T20:36:48,718 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-11-05T20:36:48,721 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-11-05T20:36:48,722 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-11-05T20:36:48,724 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-11-05T20:36:48,727 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-11-05T20:36:48,729 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-11-05T20:36:48,732 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-11-05T20:36:48,733 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-11-05T20:36:48,737 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-11-05T20:36:48,739 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-11-05T20:36:48,742 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-11-05T20:36:48,743 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-11-05T20:36:48,746 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-11-05T20:36:48,749 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-11-05T20:36:48,753 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-11-05T20:36:48,756 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-11-05T20:36:48,759 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-11-05T20:36:48,761 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-11-05T20:36:48,762 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-11-05T20:36:48,765 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-11-05T20:36:48,767 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-11-05T20:36:48,771 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-11-05T20:36:48,774 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-11-05T20:36:48,776 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-11-05T20:36:48,778 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-11-05T20:36:48,781 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2025-11-05T20:36:48,782 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb 2025-11-05T20:36:48,785 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb 2025-11-05T20:36:48,788 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2025-11-05T20:36:48,789 copying build/lib/deepspeed/ops/csrc/utils/tensor_cast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils 2025-11-05T20:36:48,790 copying build/lib/deepspeed/ops/csrc/utils/tensor_cast.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils 2025-11-05T20:36:48,792 copying build/lib/deepspeed/ops/csrc/utils/py_ds_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils 2025-11-05T20:36:48,794 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2025-11-05T20:36:48,796 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2025-11-05T20:36:48,797 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test 2025-11-05T20:36:48,799 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2025-11-05T20:36:48,800 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-11-05T20:36:48,802 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-11-05T20:36:48,804 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-11-05T20:36:48,806 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-11-05T20:36:48,809 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-11-05T20:36:48,810 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-11-05T20:36:48,813 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,814 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,816 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,818 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,820 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,822 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,824 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,825 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,828 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,829 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,831 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,834 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,835 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,837 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,839 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,841 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,843 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,845 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-11-05T20:36:48,847 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2025-11-05T20:36:48,848 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-11-05T20:36:48,851 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-11-05T20:36:48,853 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-11-05T20:36:48,855 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-11-05T20:36:48,858 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2025-11-05T20:36:48,859 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad 2025-11-05T20:36:48,862 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2025-11-05T20:36:48,863 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,866 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,868 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,871 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,873 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,875 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,878 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,880 copying build/lib/deepspeed/ops/csrc/includes/deepcompile.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,884 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,887 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,889 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,891 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,893 copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,894 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,896 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,898 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,901 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,905 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,907 copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,909 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,911 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,913 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,915 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,916 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,919 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,920 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,923 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,925 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,927 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,929 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-11-05T20:36:48,932 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/compile 2025-11-05T20:36:48,933 copying build/lib/deepspeed/ops/csrc/compile/z2.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-11-05T20:36:48,935 copying build/lib/deepspeed/ops/csrc/compile/z3.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-11-05T20:36:48,936 copying build/lib/deepspeed/ops/csrc/compile/z1.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-11-05T20:36:48,939 copying build/lib/deepspeed/ops/csrc/compile/z2.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-11-05T20:36:48,940 copying build/lib/deepspeed/ops/csrc/compile/deepcompile.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-11-05T20:36:48,943 copying build/lib/deepspeed/ops/csrc/compile/z1.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-11-05T20:36:48,944 copying build/lib/deepspeed/ops/csrc/compile/init.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-11-05T20:36:48,947 copying build/lib/deepspeed/ops/csrc/compile/z3.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-11-05T20:36:48,949 copying build/lib/deepspeed/ops/csrc/compile/util.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-11-05T20:36:48,952 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer 2025-11-05T20:36:48,953 copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer 2025-11-05T20:36:48,956 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes 2025-11-05T20:36:48,957 copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes 2025-11-05T20:36:48,959 copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes 2025-11-05T20:36:48,961 copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer 2025-11-05T20:36:48,964 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2025-11-05T20:36:48,965 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-11-05T20:36:48,968 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-11-05T20:36:48,970 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-11-05T20:36:48,972 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-11-05T20:36:48,975 copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-11-05T20:36:48,977 copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-11-05T20:36:48,980 copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-11-05T20:36:48,983 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2025-11-05T20:36:48,984 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-11-05T20:36:48,986 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-11-05T20:36:48,988 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-11-05T20:36:48,991 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-11-05T20:36:48,993 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-11-05T20:36:48,995 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds 2025-11-05T20:36:48,997 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib 2025-11-05T20:36:48,998 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-11-05T20:36:49,000 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-11-05T20:36:49,002 copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-11-05T20:36:49,005 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-11-05T20:36:49,007 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-11-05T20:36:49,010 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-11-05T20:36:49,013 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2025-11-05T20:36:49,015 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention 2025-11-05T20:36:49,018 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2025-11-05T20:36:49,019 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-11-05T20:36:49,022 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-11-05T20:36:49,026 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2025-11-05T20:36:49,028 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2025-11-05T20:36:49,029 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2025-11-05T20:36:49,032 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2025-11-05T20:36:49,034 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2025-11-05T20:36:49,037 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:49,038 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:49,040 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:49,042 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:49,045 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:49,047 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:49,050 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:49,054 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:49,057 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:49,059 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:49,062 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-11-05T20:36:49,064 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-11-05T20:36:49,067 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-11-05T20:36:49,070 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-11-05T20:36:49,073 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-11-05T20:36:49,075 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-11-05T20:36:49,078 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-11-05T20:36:49,081 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu 2025-11-05T20:36:49,083 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2025-11-05T20:36:49,084 copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion 2025-11-05T20:36:49,086 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2025-11-05T20:36:49,087 copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam 2025-11-05T20:36:49,089 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2025-11-05T20:36:49,090 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-11-05T20:36:49,093 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-11-05T20:36:49,095 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-11-05T20:36:49,097 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm/riscv64 2025-11-05T20:36:49,098 copying build/lib/deepspeed/ops/csrc/cpu/comm/riscv64/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm/riscv64 2025-11-05T20:36:49,101 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm/x86_64 2025-11-05T20:36:49,102 copying build/lib/deepspeed/ops/csrc/cpu/comm/x86_64/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm/x86_64 2025-11-05T20:36:49,104 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-11-05T20:36:49,107 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2025-11-05T20:36:49,109 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2025-11-05T20:36:49,110 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes 2025-11-05T20:36:49,112 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2025-11-05T20:36:49,113 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc 2025-11-05T20:36:49,115 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc 2025-11-05T20:36:49,118 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2025-11-05T20:36:49,119 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-11-05T20:36:49,122 copying build/lib/deepspeed/ops/adam/zenflow_torch_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-11-05T20:36:49,125 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-11-05T20:36:49,126 copying build/lib/deepspeed/ops/adam/zenflow_cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-11-05T20:36:49,129 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-11-05T20:36:49,131 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-11-05T20:36:49,139 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds 2025-11-05T20:36:49,142 copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds 2025-11-05T20:36:49,151 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2025-11-05T20:36:49,154 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-11-05T20:36:49,157 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-11-05T20:36:49,159 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-11-05T20:36:49,161 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-11-05T20:36:49,164 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-11-05T20:36:49,172 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-11-05T20:36:49,181 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2025-11-05T20:36:49,182 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-11-05T20:36:49,184 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-11-05T20:36:49,187 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-11-05T20:36:49,189 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-11-05T20:36:49,193 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-11-05T20:36:49,197 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2025-11-05T20:36:49,199 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer 2025-11-05T20:36:49,203 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2025-11-05T20:36:49,206 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,208 copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,213 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,218 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,222 copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,224 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,226 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,228 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,230 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,232 copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,234 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,237 copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,240 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,243 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,246 copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,248 copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,252 copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,255 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,259 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,262 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,267 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,271 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,276 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,281 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-11-05T20:36:49,286 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-11-05T20:36:49,292 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-11-05T20:36:49,297 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-11-05T20:36:49,303 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-11-05T20:36:49,313 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-11-05T20:36:49,325 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-11-05T20:36:49,331 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-11-05T20:36:49,340 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-11-05T20:36:49,344 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-11-05T20:36:49,347 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-11-05T20:36:49,352 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:49,353 copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:49,356 copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:49,359 copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:49,361 copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:49,363 copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:49,366 copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:49,369 copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:49,371 copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:49,375 copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:49,378 copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-11-05T20:36:49,381 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer 2025-11-05T20:36:49,385 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-11-05T20:36:49,610 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2025-11-05T20:36:49,613 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,619 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,622 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,625 copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,629 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,631 copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,634 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,640 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,642 copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,645 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,649 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,655 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,659 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,662 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,666 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,669 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,673 copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,677 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-11-05T20:36:49,682 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2025-11-05T20:36:49,684 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-11-05T20:36:49,688 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-11-05T20:36:49,692 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-11-05T20:36:49,696 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-11-05T20:36:49,699 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-11-05T20:36:49,703 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-11-05T20:36:49,709 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-11-05T20:36:49,713 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-11-05T20:36:49,717 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-11-05T20:36:49,720 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-11-05T20:36:49,723 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2025-11-05T20:36:49,724 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2025-11-05T20:36:49,727 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2025-11-05T20:36:49,728 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler 2025-11-05T20:36:49,731 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler 2025-11-05T20:36:49,734 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2025-11-05T20:36:49,736 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2025-11-05T20:36:49,738 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2025-11-05T20:36:49,739 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-11-05T20:36:49,741 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-11-05T20:36:49,743 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-11-05T20:36:49,745 copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-11-05T20:36:49,746 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-11-05T20:36:49,748 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-11-05T20:36:49,750 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-11-05T20:36:49,752 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-11-05T20:36:49,755 creating build/bdist.linux-armv7l/wheel/deepspeed/sequence 2025-11-05T20:36:49,756 copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-11-05T20:36:49,758 copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-11-05T20:36:49,759 copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-11-05T20:36:49,762 copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-11-05T20:36:49,766 creating build/bdist.linux-armv7l/wheel/deepspeed/io 2025-11-05T20:36:49,766 copying build/lib/deepspeed/io/fast_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-11-05T20:36:49,769 copying build/lib/deepspeed/io/base_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-11-05T20:36:49,770 copying build/lib/deepspeed/io/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-11-05T20:36:49,772 copying build/lib/deepspeed/io/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-11-05T20:36:49,774 copying build/lib/deepspeed/io/double_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-11-05T20:36:49,776 copying build/lib/deepspeed/io/base_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-11-05T20:36:49,777 copying build/lib/deepspeed/io/single_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-11-05T20:36:49,779 copying build/lib/deepspeed/io/py_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-11-05T20:36:49,781 copying build/lib/deepspeed/io/mock_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-11-05T20:36:49,783 copying build/lib/deepspeed/io/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-11-05T20:36:49,785 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2025-11-05T20:36:49,786 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-11-05T20:36:49,788 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-11-05T20:36:49,790 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-11-05T20:36:49,792 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-11-05T20:36:49,794 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-11-05T20:36:49,796 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-11-05T20:36:49,799 creating build/bdist.linux-armv7l/wheel/deepspeed/nvme 2025-11-05T20:36:49,800 copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-11-05T20:36:49,802 copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-11-05T20:36:49,804 copying build/lib/deepspeed/nvme/ds_aio_constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-11-05T20:36:49,806 copying build/lib/deepspeed/nvme/torch_fastio_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-11-05T20:36:49,807 copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-11-05T20:36:49,809 copying build/lib/deepspeed/nvme/io_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-11-05T20:36:49,811 copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-11-05T20:36:49,813 copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-11-05T20:36:49,815 copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-11-05T20:36:49,817 copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-11-05T20:36:49,819 copying build/lib/deepspeed/nvme/torch_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-11-05T20:36:49,821 copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-11-05T20:36:49,822 copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-11-05T20:36:49,825 copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-11-05T20:36:49,827 copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-11-05T20:36:49,829 copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-11-05T20:36:49,832 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2025-11-05T20:36:49,833 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2025-11-05T20:36:49,835 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2025-11-05T20:36:49,840 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2025-11-05T20:36:49,842 copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-11-05T20:36:49,846 copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-11-05T20:36:49,851 copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-11-05T20:36:49,856 copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-11-05T20:36:49,861 copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-11-05T20:36:49,868 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2025-11-05T20:36:49,871 copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-11-05T20:36:49,876 copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-11-05T20:36:49,882 copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-11-05T20:36:49,890 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2025-11-05T20:36:49,893 copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-11-05T20:36:49,902 copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-11-05T20:36:49,911 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2025-11-05T20:36:49,914 copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes 2025-11-05T20:36:49,923 copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-11-05T20:36:49,936 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2025-11-05T20:36:49,940 copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc 2025-11-05T20:36:49,952 copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc 2025-11-05T20:36:49,962 copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-11-05T20:36:49,971 copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-11-05T20:36:49,973 copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-11-05T20:36:49,975 copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-11-05T20:36:49,977 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2025-11-05T20:36:49,979 copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-11-05T20:36:49,980 copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-11-05T20:36:49,982 copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-11-05T20:36:49,984 copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-11-05T20:36:49,986 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2025-11-05T20:36:49,987 copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels 2025-11-05T20:36:49,989 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2025-11-05T20:36:49,990 copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-11-05T20:36:49,993 copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-11-05T20:36:49,995 copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-11-05T20:36:49,997 copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-11-05T20:36:50,000 copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-11-05T20:36:50,002 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2025-11-05T20:36:50,003 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-11-05T20:36:50,004 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-11-05T20:36:50,006 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-11-05T20:36:50,009 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-11-05T20:36:50,011 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-11-05T20:36:50,013 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-11-05T20:36:50,015 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-11-05T20:36:50,017 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:50,018 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:50,020 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:50,023 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:50,025 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:50,027 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:50,029 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:50,031 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:50,033 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:50,035 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-11-05T20:36:50,037 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-11-05T20:36:50,038 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-11-05T20:36:50,040 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-11-05T20:36:50,042 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-11-05T20:36:50,044 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-11-05T20:36:50,046 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-11-05T20:36:50,047 copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops 2025-11-05T20:36:50,050 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-11-05T20:36:50,051 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-11-05T20:36:50,052 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-11-05T20:36:50,055 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-11-05T20:36:50,057 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-11-05T20:36:50,058 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-11-05T20:36:50,060 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-11-05T20:36:50,062 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-11-05T20:36:50,065 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-11-05T20:36:50,066 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-11-05T20:36:50,068 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-11-05T20:36:50,070 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-11-05T20:36:50,072 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-11-05T20:36:50,074 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:50,075 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:50,077 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:50,079 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:50,081 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:50,082 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:50,085 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:50,087 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:50,089 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-11-05T20:36:50,091 copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops 2025-11-05T20:36:50,093 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-11-05T20:36:50,094 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-11-05T20:36:50,096 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-11-05T20:36:50,098 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-11-05T20:36:50,099 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-11-05T20:36:50,102 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-11-05T20:36:50,104 copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels 2025-11-05T20:36:50,106 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2025-11-05T20:36:50,107 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-11-05T20:36:50,108 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-11-05T20:36:50,110 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-11-05T20:36:50,112 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-11-05T20:36:50,114 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-11-05T20:36:50,116 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-11-05T20:36:50,118 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops 2025-11-05T20:36:50,120 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-11-05T20:36:50,121 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-11-05T20:36:50,123 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops 2025-11-05T20:36:50,125 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-11-05T20:36:50,126 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-11-05T20:36:50,128 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-11-05T20:36:50,129 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-11-05T20:36:50,131 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-11-05T20:36:50,133 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-11-05T20:36:50,135 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-11-05T20:36:50,138 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2025-11-05T20:36:50,139 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops 2025-11-05T20:36:50,141 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-11-05T20:36:50,142 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-11-05T20:36:50,144 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-11-05T20:36:50,146 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-11-05T20:36:50,148 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-11-05T20:36:50,149 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-11-05T20:36:50,151 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-11-05T20:36:50,153 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops 2025-11-05T20:36:50,155 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes 2025-11-05T20:36:50,156 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes 2025-11-05T20:36:50,159 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-11-05T20:36:50,160 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-11-05T20:36:50,161 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-11-05T20:36:50,164 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-11-05T20:36:50,165 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-11-05T20:36:50,167 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-11-05T20:36:50,169 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-11-05T20:36:50,171 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-11-05T20:36:50,172 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-11-05T20:36:50,174 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-11-05T20:36:50,176 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-11-05T20:36:50,178 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-11-05T20:36:50,180 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-11-05T20:36:50,181 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-11-05T20:36:50,184 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-11-05T20:36:50,185 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-11-05T20:36:50,187 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-11-05T20:36:50,188 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-11-05T20:36:50,190 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-11-05T20:36:50,193 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-11-05T20:36:50,194 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-11-05T20:36:50,196 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-11-05T20:36:50,197 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-11-05T20:36:50,200 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-11-05T20:36:50,201 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-11-05T20:36:50,203 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-11-05T20:36:50,206 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:50,207 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:50,209 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:50,211 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:50,213 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:50,215 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:50,217 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:50,219 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:50,221 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-11-05T20:36:50,224 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-11-05T20:36:50,225 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-11-05T20:36:50,227 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-11-05T20:36:50,228 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-11-05T20:36:50,231 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-11-05T20:36:50,232 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-11-05T20:36:50,234 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-11-05T20:36:50,235 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-11-05T20:36:50,237 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-11-05T20:36:50,239 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-11-05T20:36:50,241 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-11-05T20:36:50,243 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-11-05T20:36:50,244 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-11-05T20:36:50,246 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-11-05T20:36:50,248 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-11-05T20:36:50,250 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-11-05T20:36:50,252 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-11-05T20:36:50,254 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-11-05T20:36:50,256 copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-11-05T20:36:50,259 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2025-11-05T20:36:50,260 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2025-11-05T20:36:50,262 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2025-11-05T20:36:50,264 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2025-11-05T20:36:50,266 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2025-11-05T20:36:50,268 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2025-11-05T20:36:50,270 copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations 2025-11-05T20:36:50,272 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2025-11-05T20:36:50,273 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention 2025-11-05T20:36:50,276 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention 2025-11-05T20:36:50,279 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2025-11-05T20:36:50,280 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding 2025-11-05T20:36:50,282 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding 2025-11-05T20:36:50,285 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2025-11-05T20:36:50,286 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe 2025-11-05T20:36:50,288 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe 2025-11-05T20:36:50,292 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2025-11-05T20:36:50,294 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm 2025-11-05T20:36:50,297 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm 2025-11-05T20:36:50,301 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2025-11-05T20:36:50,303 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2025-11-05T20:36:50,307 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2025-11-05T20:36:50,312 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2025-11-05T20:36:50,318 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2025-11-05T20:36:50,320 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed 2025-11-05T20:36:50,330 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed 2025-11-05T20:36:50,338 copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-11-05T20:36:50,348 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2025-11-05T20:36:50,352 copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-11-05T20:36:50,363 copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-11-05T20:36:50,586 copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-11-05T20:36:50,589 copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-11-05T20:36:50,592 copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-11-05T20:36:50,595 copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-11-05T20:36:50,598 copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-11-05T20:36:50,601 copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-11-05T20:36:50,604 copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-11-05T20:36:50,608 copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-11-05T20:36:50,612 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:50,614 copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:50,617 copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:50,620 copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:50,623 copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:50,627 copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:50,630 copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:50,633 copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:50,636 copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-11-05T20:36:50,639 copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-11-05T20:36:50,643 copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-11-05T20:36:50,646 copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-11-05T20:36:50,648 copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-11-05T20:36:50,651 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2025-11-05T20:36:50,653 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-11-05T20:36:50,655 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-11-05T20:36:50,658 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-11-05T20:36:50,661 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-11-05T20:36:50,663 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-11-05T20:36:50,666 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2025-11-05T20:36:50,667 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-11-05T20:36:50,670 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-11-05T20:36:50,672 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-11-05T20:36:50,675 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-11-05T20:36:50,677 copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-11-05T20:36:50,680 copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-11-05T20:36:50,683 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:50,685 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:50,687 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:50,690 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:50,692 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:50,696 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:50,698 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:50,700 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:50,703 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:50,706 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-11-05T20:36:50,709 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2025-11-05T20:36:50,710 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-11-05T20:36:50,713 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-11-05T20:36:50,716 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-11-05T20:36:50,718 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-11-05T20:36:50,721 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi 2025-11-05T20:36:50,723 copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-11-05T20:36:50,726 copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-11-05T20:36:50,728 copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-11-05T20:36:50,730 copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-11-05T20:36:50,733 copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-11-05T20:36:50,737 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2 2025-11-05T20:36:50,738 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-11-05T20:36:50,741 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-11-05T20:36:50,743 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-11-05T20:36:50,746 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-11-05T20:36:50,748 copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-11-05T20:36:50,751 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:50,751 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:50,753 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:50,755 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:50,757 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:50,759 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:50,761 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:50,762 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:50,764 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:50,766 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-11-05T20:36:50,767 copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-11-05T20:36:50,770 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen 2025-11-05T20:36:50,771 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-11-05T20:36:50,773 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-11-05T20:36:50,775 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-11-05T20:36:50,777 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-11-05T20:36:50,779 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3 2025-11-05T20:36:50,780 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-11-05T20:36:50,782 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-11-05T20:36:50,784 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-11-05T20:36:50,786 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-11-05T20:36:50,788 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2025-11-05T20:36:50,789 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-11-05T20:36:50,791 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-11-05T20:36:50,793 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-11-05T20:36:50,795 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-11-05T20:36:50,797 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral 2025-11-05T20:36:50,798 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-11-05T20:36:50,800 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-11-05T20:36:50,802 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-11-05T20:36:50,804 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-11-05T20:36:50,806 copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-11-05T20:36:50,808 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2025-11-05T20:36:50,809 copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-11-05T20:36:50,812 copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-11-05T20:36:50,813 copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-11-05T20:36:50,815 copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-11-05T20:36:50,817 copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-11-05T20:36:50,820 copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-11-05T20:36:50,823 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2025-11-05T20:36:50,825 creating build/bdist.linux-armv7l/wheel/deepspeed/compile 2025-11-05T20:36:50,826 copying build/lib/deepspeed/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-11-05T20:36:50,829 creating build/bdist.linux-armv7l/wheel/deepspeed/compile/passes 2025-11-05T20:36:50,830 copying build/lib/deepspeed/compile/passes/zero1_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-11-05T20:36:50,832 copying build/lib/deepspeed/compile/passes/offload_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-11-05T20:36:50,834 copying build/lib/deepspeed/compile/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-11-05T20:36:50,835 copying build/lib/deepspeed/compile/passes/prefetch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-11-05T20:36:50,838 copying build/lib/deepspeed/compile/passes/offload_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-11-05T20:36:50,839 copying build/lib/deepspeed/compile/passes/selective_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-11-05T20:36:50,842 copying build/lib/deepspeed/compile/passes/zero3_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-11-05T20:36:50,844 copying build/lib/deepspeed/compile/passes/offload_adam_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-11-05T20:36:50,847 copying build/lib/deepspeed/compile/init_z3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-11-05T20:36:50,848 copying build/lib/deepspeed/compile/patch_fake_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-11-05T20:36:50,851 creating build/bdist.linux-armv7l/wheel/deepspeed/compile/profilers 2025-11-05T20:36:50,852 copying build/lib/deepspeed/compile/profilers/comm_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers 2025-11-05T20:36:50,854 copying build/lib/deepspeed/compile/profilers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers 2025-11-05T20:36:50,855 copying build/lib/deepspeed/compile/profilers/graph_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers 2025-11-05T20:36:50,858 copying build/lib/deepspeed/compile/input_storage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-11-05T20:36:50,860 copying build/lib/deepspeed/compile/patch_compiled_func.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-11-05T20:36:50,861 copying build/lib/deepspeed/compile/list_schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-11-05T20:36:50,864 copying build/lib/deepspeed/compile/inductor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-11-05T20:36:50,866 copying build/lib/deepspeed/compile/fx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-11-05T20:36:50,868 copying build/lib/deepspeed/compile/graph_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-11-05T20:36:50,870 copying build/lib/deepspeed/compile/util.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-11-05T20:36:50,873 copying build/lib/deepspeed/compile/init_z1.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-11-05T20:36:50,875 copying build/lib/deepspeed/compile/partitioner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-11-05T20:36:50,877 copying build/lib/deepspeed/compile/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-11-05T20:36:50,878 copying build/lib/deepspeed/compile/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-11-05T20:36:50,881 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2025-11-05T20:36:50,882 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-11-05T20:36:50,885 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-11-05T20:36:50,887 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-11-05T20:36:50,889 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-11-05T20:36:50,891 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-11-05T20:36:50,893 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-11-05T20:36:50,895 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-11-05T20:36:50,897 copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-11-05T20:36:50,899 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-11-05T20:36:50,901 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-11-05T20:36:50,904 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2025-11-05T20:36:50,905 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-11-05T20:36:50,907 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-11-05T20:36:50,909 copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-11-05T20:36:50,911 copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-11-05T20:36:50,913 copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-11-05T20:36:50,916 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-11-05T20:36:50,918 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-11-05T20:36:50,920 copying build/lib/deepspeed/accelerator/sdaa_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-11-05T20:36:50,923 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-11-05T20:36:50,925 copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-11-05T20:36:50,927 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-11-05T20:36:50,930 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2025-11-05T20:36:50,931 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-11-05T20:36:50,933 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-11-05T20:36:50,935 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-11-05T20:36:50,938 copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-11-05T20:36:50,939 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-11-05T20:36:50,942 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-11-05T20:36:50,944 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2025-11-05T20:36:50,945 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-11-05T20:36:50,948 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-11-05T20:36:50,949 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-11-05T20:36:50,951 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-11-05T20:36:50,953 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-11-05T20:36:50,956 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-11-05T20:36:50,959 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2025-11-05T20:36:50,960 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-11-05T20:36:50,962 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-11-05T20:36:50,965 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-11-05T20:36:50,967 copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-11-05T20:36:50,969 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-11-05T20:36:50,971 copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-11-05T20:36:50,974 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-11-05T20:36:50,977 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-11-05T20:36:50,979 copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-11-05T20:36:50,981 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-11-05T20:36:50,984 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2025-11-05T20:36:50,985 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:50,987 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:50,989 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:50,990 copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:50,993 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:50,995 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:50,997 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:50,999 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:51,001 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:51,003 copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:51,005 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:51,007 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:51,010 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:51,012 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:51,014 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:51,016 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:51,019 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:51,021 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:51,023 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-11-05T20:36:51,025 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2025-11-05T20:36:51,026 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-11-05T20:36:51,028 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-11-05T20:36:51,031 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-11-05T20:36:51,033 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-11-05T20:36:51,035 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-11-05T20:36:51,037 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-11-05T20:36:51,039 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-11-05T20:36:51,041 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-11-05T20:36:51,043 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-11-05T20:36:51,045 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-11-05T20:36:51,048 creating build/bdist.linux-armv7l/wheel/deepspeed/datastates 2025-11-05T20:36:51,048 copying build/lib/deepspeed/datastates/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/datastates 2025-11-05T20:36:51,050 copying build/lib/deepspeed/datastates/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/datastates 2025-11-05T20:36:51,052 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-11-05T20:36:51,054 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2025-11-05T20:36:51,055 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations 2025-11-05T20:36:51,057 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2025-11-05T20:36:51,058 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-11-05T20:36:51,060 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-11-05T20:36:51,062 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-11-05T20:36:51,064 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-11-05T20:36:51,066 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-11-05T20:36:51,067 copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-11-05T20:36:51,069 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-11-05T20:36:51,071 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-11-05T20:36:51,072 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-11-05T20:36:51,075 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-11-05T20:36:51,077 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2025-11-05T20:36:51,078 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2025-11-05T20:36:51,080 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2025-11-05T20:36:51,082 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2025-11-05T20:36:51,084 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2025-11-05T20:36:51,085 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features 2025-11-05T20:36:51,087 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features 2025-11-05T20:36:51,089 creating build/bdist.linux-armv7l/wheel/deepspeed/linear 2025-11-05T20:36:51,090 copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-11-05T20:36:51,093 copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-11-05T20:36:51,094 copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-11-05T20:36:51,096 copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-11-05T20:36:51,098 copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-11-05T20:36:51,101 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2025-11-05T20:36:51,102 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe 2025-11-05T20:36:51,104 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2025-11-05T20:36:51,105 copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,108 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/sequence_parallel 2025-11-05T20:36:51,109 copying build/lib/deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel 2025-11-05T20:36:51,111 copying build/lib/deepspeed/runtime/sequence_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel 2025-11-05T20:36:51,112 copying build/lib/deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel 2025-11-05T20:36:51,116 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,119 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,122 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2025-11-05T20:36:51,123 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression 2025-11-05T20:36:51,125 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression 2025-11-05T20:36:51,126 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,128 copying build/lib/deepspeed/runtime/torch_autocast.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,131 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2025-11-05T20:36:51,132 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-11-05T20:36:51,134 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2025-11-05T20:36:51,135 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-11-05T20:36:51,138 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-11-05T20:36:51,140 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-11-05T20:36:51,141 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-11-05T20:36:51,143 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-11-05T20:36:51,145 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-11-05T20:36:51,148 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2025-11-05T20:36:51,149 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-11-05T20:36:51,151 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-11-05T20:36:51,153 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-11-05T20:36:51,155 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-11-05T20:36:51,158 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-11-05T20:36:51,161 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-11-05T20:36:51,163 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-11-05T20:36:51,166 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-11-05T20:36:51,168 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,171 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/superoffload 2025-11-05T20:36:51,172 copying build/lib/deepspeed/runtime/superoffload/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/superoffload 2025-11-05T20:36:51,174 copying build/lib/deepspeed/runtime/superoffload/superoffload_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/superoffload 2025-11-05T20:36:51,176 copying build/lib/deepspeed/runtime/superoffload/superoffload_stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/superoffload 2025-11-05T20:36:51,179 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:51,180 copying build/lib/deepspeed/runtime/checkpoint_engine/datastates_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:51,182 copying build/lib/deepspeed/runtime/checkpoint_engine/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:51,184 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:51,186 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:51,188 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:51,190 copying build/lib/deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:51,192 copying build/lib/deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:51,194 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-11-05T20:36:51,196 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,199 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2025-11-05T20:36:51,200 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2025-11-05T20:36:51,202 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2025-11-05T20:36:51,205 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2025-11-05T20:36:51,207 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino 2025-11-05T20:36:51,208 copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino 2025-11-05T20:36:51,210 copying build/lib/deepspeed/runtime/domino/async_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino 2025-11-05T20:36:51,212 copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino 2025-11-05T20:36:51,215 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2025-11-05T20:36:51,216 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,219 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,220 copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,222 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,227 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,230 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,234 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,237 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,239 copying build/lib/deepspeed/runtime/zero/leaf_module_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,241 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,243 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,245 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,247 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,250 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,253 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,257 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,260 copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,262 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-11-05T20:36:51,265 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero/muon 2025-11-05T20:36:51,265 copying build/lib/deepspeed/runtime/zero/muon/original_muon.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero/muon 2025-11-05T20:36:51,268 copying build/lib/deepspeed/runtime/zero/muon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero/muon 2025-11-05T20:36:51,270 copying build/lib/deepspeed/runtime/zero/muon/muon_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero/muon 2025-11-05T20:36:51,272 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,277 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/tensor_parallel 2025-11-05T20:36:51,278 copying build/lib/deepspeed/runtime/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2025-11-05T20:36:51,280 copying build/lib/deepspeed/runtime/tensor_parallel/tp_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2025-11-05T20:36:51,282 copying build/lib/deepspeed/runtime/tensor_parallel/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2025-11-05T20:36:51,283 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,285 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,288 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,291 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,294 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2025-11-05T20:36:51,295 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-11-05T20:36:51,297 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-11-05T20:36:51,299 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-11-05T20:36:51,301 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-11-05T20:36:51,303 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-11-05T20:36:51,306 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-11-05T20:36:51,308 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-11-05T20:36:51,310 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-11-05T20:36:51,312 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-11-05T20:36:51,315 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,317 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zenflow 2025-11-05T20:36:51,318 copying build/lib/deepspeed/runtime/zenflow/zenflow_stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2025-11-05T20:36:51,321 copying build/lib/deepspeed/runtime/zenflow/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2025-11-05T20:36:51,323 copying build/lib/deepspeed/runtime/zenflow/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2025-11-05T20:36:51,325 copying build/lib/deepspeed/runtime/zenflow/zenflow_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2025-11-05T20:36:51,327 copying build/lib/deepspeed/runtime/zenflow/engine_stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2025-11-05T20:36:51,330 copying build/lib/deepspeed/runtime/zenflow/zenflow_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2025-11-05T20:36:51,332 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,334 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,337 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2025-11-05T20:36:51,338 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-11-05T20:36:51,341 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-11-05T20:36:51,343 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-11-05T20:36:51,345 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-11-05T20:36:51,349 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-11-05T20:36:51,351 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-11-05T20:36:51,354 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/model_checkpointing 2025-11-05T20:36:51,355 copying build/lib/deepspeed/runtime/model_checkpointing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-11-05T20:36:51,357 copying build/lib/deepspeed/runtime/model_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-11-05T20:36:51,359 copying build/lib/deepspeed/runtime/model_checkpointing/writer_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-11-05T20:36:51,361 copying build/lib/deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-11-05T20:36:51,363 copying build/lib/deepspeed/runtime/model_checkpointing/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-11-05T20:36:51,365 copying build/lib/deepspeed/runtime/model_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-11-05T20:36:51,368 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2025-11-05T20:36:51,369 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-11-05T20:36:51,370 copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-11-05T20:36:51,373 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-11-05T20:36:51,375 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-11-05T20:36:51,377 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-11-05T20:36:51,379 copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-11-05T20:36:51,382 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,384 copying build/lib/deepspeed/runtime/precision_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,386 copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,389 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2025-11-05T20:36:51,390 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-11-05T20:36:51,391 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-11-05T20:36:51,394 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-11-05T20:36:51,397 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2025-11-05T20:36:51,398 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-11-05T20:36:51,400 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-11-05T20:36:51,402 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-11-05T20:36:51,405 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-11-05T20:36:51,407 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-11-05T20:36:51,410 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,413 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-11-05T20:36:51,415 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2025-11-05T20:36:51,416 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-11-05T20:36:51,419 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-11-05T20:36:51,422 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-11-05T20:36:51,423 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-11-05T20:36:51,425 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-11-05T20:36:51,428 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-11-05T20:36:51,430 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-11-05T20:36:51,432 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-11-05T20:36:51,433 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-11-05T20:36:51,436 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2025-11-05T20:36:51,437 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2025-11-05T20:36:51,439 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2025-11-05T20:36:51,440 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2025-11-05T20:36:51,442 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-11-05T20:36:51,444 running install_egg_info 2025-11-05T20:36:51,479 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.18.2-py3.11.egg-info 2025-11-05T20:36:51,497 running install_scripts 2025-11-05T20:36:51,498 creating build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts 2025-11-05T20:36:51,500 copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts 2025-11-05T20:36:51,502 copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts 2025-11-05T20:36:51,503 copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts 2025-11-05T20:36:51,505 copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts 2025-11-05T20:36:51,507 copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts 2025-11-05T20:36:51,509 copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts 2025-11-05T20:36:51,511 copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts 2025-11-05T20:36:51,512 copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts 2025-11-05T20:36:51,514 copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts 2025-11-05T20:36:51,516 copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts 2025-11-05T20:36:51,517 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts/dsr to 755 2025-11-05T20:36:51,518 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts/ds_elastic to 755 2025-11-05T20:36:51,518 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts/ds_io to 755 2025-11-05T20:36:51,519 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts/ds_report to 755 2025-11-05T20:36:51,519 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts/ds_nvme_tune to 755 2025-11-05T20:36:51,520 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts/ds_bench to 755 2025-11-05T20:36:51,520 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts/ds_ssh to 755 2025-11-05T20:36:51,521 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts/deepspeed to 755 2025-11-05T20:36:51,521 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts/deepspeed.pt to 755 2025-11-05T20:36:51,522 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.data/scripts/ds to 755 2025-11-05T20:36:51,537 creating build/bdist.linux-armv7l/wheel/deepspeed-0.18.2.dist-info/WHEEL 2025-11-05T20:36:51,539 creating '/tmp/pip-wheel-fi8eux_0/deepspeed-0.18.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-11-05T20:36:51,543 adding 'deepspeed/__init__.py' 2025-11-05T20:36:51,545 adding 'deepspeed/constants.py' 2025-11-05T20:36:51,547 adding 'deepspeed/env_report.py' 2025-11-05T20:36:51,548 adding 'deepspeed/git_version_info.py' 2025-11-05T20:36:51,550 adding 'deepspeed/git_version_info_installed.py' 2025-11-05T20:36:51,551 adding 'deepspeed/accelerator/__init__.py' 2025-11-05T20:36:51,553 adding 'deepspeed/accelerator/abstract_accelerator.py' 2025-11-05T20:36:51,555 adding 'deepspeed/accelerator/cpu_accelerator.py' 2025-11-05T20:36:51,557 adding 'deepspeed/accelerator/cuda_accelerator.py' 2025-11-05T20:36:51,559 adding 'deepspeed/accelerator/hpu_accelerator.py' 2025-11-05T20:36:51,561 adding 'deepspeed/accelerator/mlu_accelerator.py' 2025-11-05T20:36:51,562 adding 'deepspeed/accelerator/mps_accelerator.py' 2025-11-05T20:36:51,564 adding 'deepspeed/accelerator/npu_accelerator.py' 2025-11-05T20:36:51,566 adding 'deepspeed/accelerator/real_accelerator.py' 2025-11-05T20:36:51,568 adding 'deepspeed/accelerator/sdaa_accelerator.py' 2025-11-05T20:36:51,570 adding 'deepspeed/accelerator/xpu_accelerator.py' 2025-11-05T20:36:51,571 adding 'deepspeed/autotuning/__init__.py' 2025-11-05T20:36:51,576 adding 'deepspeed/autotuning/autotuner.py' 2025-11-05T20:36:51,578 adding 'deepspeed/autotuning/config.py' 2025-11-05T20:36:51,580 adding 'deepspeed/autotuning/constants.py' 2025-11-05T20:36:51,582 adding 'deepspeed/autotuning/scheduler.py' 2025-11-05T20:36:51,584 adding 'deepspeed/autotuning/utils.py' 2025-11-05T20:36:51,586 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2025-11-05T20:36:51,587 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2025-11-05T20:36:51,588 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2025-11-05T20:36:51,589 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2025-11-05T20:36:51,591 adding 'deepspeed/autotuning/tuner/__init__.py' 2025-11-05T20:36:51,592 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2025-11-05T20:36:51,593 adding 'deepspeed/autotuning/tuner/cost_model.py' 2025-11-05T20:36:51,595 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2025-11-05T20:36:51,596 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2025-11-05T20:36:51,598 adding 'deepspeed/autotuning/tuner/utils.py' 2025-11-05T20:36:51,599 adding 'deepspeed/checkpoint/__init__.py' 2025-11-05T20:36:51,601 adding 'deepspeed/checkpoint/constants.py' 2025-11-05T20:36:51,603 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2025-11-05T20:36:51,606 adding 'deepspeed/checkpoint/ds_to_universal.py' 2025-11-05T20:36:51,608 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2025-11-05T20:36:51,610 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2025-11-05T20:36:51,611 adding 'deepspeed/checkpoint/reshape_utils.py' 2025-11-05T20:36:51,612 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2025-11-05T20:36:51,614 adding 'deepspeed/checkpoint/utils.py' 2025-11-05T20:36:51,615 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2025-11-05T20:36:51,617 adding 'deepspeed/comm/__init__.py' 2025-11-05T20:36:51,619 adding 'deepspeed/comm/backend.py' 2025-11-05T20:36:51,620 adding 'deepspeed/comm/ccl.py' 2025-11-05T20:36:51,624 adding 'deepspeed/comm/comm.py' 2025-11-05T20:36:51,626 adding 'deepspeed/comm/config.py' 2025-11-05T20:36:51,627 adding 'deepspeed/comm/constants.py' 2025-11-05T20:36:51,628 adding 'deepspeed/comm/reduce_op.py' 2025-11-05T20:36:51,631 adding 'deepspeed/comm/torch.py' 2025-11-05T20:36:51,632 adding 'deepspeed/comm/utils.py' 2025-11-05T20:36:51,634 adding 'deepspeed/compile/__init__.py' 2025-11-05T20:36:51,636 adding 'deepspeed/compile/backend.py' 2025-11-05T20:36:51,637 adding 'deepspeed/compile/config.py' 2025-11-05T20:36:51,639 adding 'deepspeed/compile/fx.py' 2025-11-05T20:36:51,640 adding 'deepspeed/compile/graph_param.py' 2025-11-05T20:36:51,642 adding 'deepspeed/compile/inductor.py' 2025-11-05T20:36:51,643 adding 'deepspeed/compile/init_z1.py' 2025-11-05T20:36:51,645 adding 'deepspeed/compile/init_z3.py' 2025-11-05T20:36:51,647 adding 'deepspeed/compile/input_storage.py' 2025-11-05T20:36:51,649 adding 'deepspeed/compile/list_schedule.py' 2025-11-05T20:36:51,650 adding 'deepspeed/compile/partitioner.py' 2025-11-05T20:36:51,652 adding 'deepspeed/compile/patch_compiled_func.py' 2025-11-05T20:36:51,653 adding 'deepspeed/compile/patch_fake_tensor.py' 2025-11-05T20:36:51,656 adding 'deepspeed/compile/util.py' 2025-11-05T20:36:51,658 adding 'deepspeed/compile/passes/__init__.py' 2025-11-05T20:36:51,659 adding 'deepspeed/compile/passes/offload_activation.py' 2025-11-05T20:36:51,662 adding 'deepspeed/compile/passes/offload_adam_states.py' 2025-11-05T20:36:51,663 adding 'deepspeed/compile/passes/offload_parameters.py' 2025-11-05T20:36:51,665 adding 'deepspeed/compile/passes/prefetch.py' 2025-11-05T20:36:51,666 adding 'deepspeed/compile/passes/selective_gather.py' 2025-11-05T20:36:51,668 adding 'deepspeed/compile/passes/zero1_compile.py' 2025-11-05T20:36:51,670 adding 'deepspeed/compile/passes/zero3_compile.py' 2025-11-05T20:36:51,672 adding 'deepspeed/compile/profilers/__init__.py' 2025-11-05T20:36:51,673 adding 'deepspeed/compile/profilers/comm_profile.py' 2025-11-05T20:36:51,675 adding 'deepspeed/compile/profilers/graph_profile.py' 2025-11-05T20:36:51,677 adding 'deepspeed/compression/__init__.py' 2025-11-05T20:36:51,680 adding 'deepspeed/compression/basic_layer.py' 2025-11-05T20:36:51,682 adding 'deepspeed/compression/compress.py' 2025-11-05T20:36:51,684 adding 'deepspeed/compression/config.py' 2025-11-05T20:36:51,686 adding 'deepspeed/compression/constants.py' 2025-11-05T20:36:51,688 adding 'deepspeed/compression/helper.py' 2025-11-05T20:36:51,689 adding 'deepspeed/compression/scheduler.py' 2025-11-05T20:36:51,691 adding 'deepspeed/compression/utils.py' 2025-11-05T20:36:51,693 adding 'deepspeed/datastates/__init__.py' 2025-11-05T20:36:51,694 adding 'deepspeed/datastates/config.py' 2025-11-05T20:36:51,695 adding 'deepspeed/elasticity/__init__.py' 2025-11-05T20:36:51,697 adding 'deepspeed/elasticity/config.py' 2025-11-05T20:36:51,698 adding 'deepspeed/elasticity/constants.py' 2025-11-05T20:36:51,700 adding 'deepspeed/elasticity/elastic_agent.py' 2025-11-05T20:36:51,702 adding 'deepspeed/elasticity/elasticity.py' 2025-11-05T20:36:51,704 adding 'deepspeed/elasticity/utils.py' 2025-11-05T20:36:51,705 adding 'deepspeed/inference/__init__.py' 2025-11-05T20:36:51,708 adding 'deepspeed/inference/config.py' 2025-11-05T20:36:51,711 adding 'deepspeed/inference/engine.py' 2025-11-05T20:36:51,713 adding 'deepspeed/inference/quantization/__init__.py' 2025-11-05T20:36:51,714 adding 'deepspeed/inference/quantization/layers.py' 2025-11-05T20:36:51,716 adding 'deepspeed/inference/quantization/quantization.py' 2025-11-05T20:36:51,717 adding 'deepspeed/inference/quantization/quantization_context.py' 2025-11-05T20:36:51,719 adding 'deepspeed/inference/quantization/utils.py' 2025-11-05T20:36:51,721 adding 'deepspeed/inference/v2/__init__.py' 2025-11-05T20:36:51,722 adding 'deepspeed/inference/v2/allocator.py' 2025-11-05T20:36:51,723 adding 'deepspeed/inference/v2/config_v2.py' 2025-11-05T20:36:51,725 adding 'deepspeed/inference/v2/engine_factory.py' 2025-11-05T20:36:51,727 adding 'deepspeed/inference/v2/engine_v2.py' 2025-11-05T20:36:51,728 adding 'deepspeed/inference/v2/inference_parameter.py' 2025-11-05T20:36:51,729 adding 'deepspeed/inference/v2/inference_utils.py' 2025-11-05T20:36:51,731 adding 'deepspeed/inference/v2/logging.py' 2025-11-05T20:36:51,732 adding 'deepspeed/inference/v2/scheduling_utils.py' 2025-11-05T20:36:51,734 adding 'deepspeed/inference/v2/checkpoint/__init__.py' 2025-11-05T20:36:51,735 adding 'deepspeed/inference/v2/checkpoint/base_engine.py' 2025-11-05T20:36:51,736 adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py' 2025-11-05T20:36:51,738 adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py' 2025-11-05T20:36:51,740 adding 'deepspeed/inference/v2/kernels/__init__.py' 2025-11-05T20:36:51,741 adding 'deepspeed/inference/v2/kernels/ds_kernel.py' 2025-11-05T20:36:51,743 adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py' 2025-11-05T20:36:51,745 adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp' 2025-11-05T20:36:51,746 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py' 2025-11-05T20:36:51,748 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp' 2025-11-05T20:36:51,749 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h' 2025-11-05T20:36:51,751 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py' 2025-11-05T20:36:51,752 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu' 2025-11-05T20:36:51,754 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py' 2025-11-05T20:36:51,756 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h' 2025-11-05T20:36:51,757 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py' 2025-11-05T20:36:51,759 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h' 2025-11-05T20:36:51,761 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py' 2025-11-05T20:36:51,762 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py' 2025-11-05T20:36:51,763 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py' 2025-11-05T20:36:51,764 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py' 2025-11-05T20:36:51,765 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py' 2025-11-05T20:36:51,767 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp' 2025-11-05T20:36:51,768 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h' 2025-11-05T20:36:51,770 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu' 2025-11-05T20:36:51,772 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py' 2025-11-05T20:36:51,773 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py' 2025-11-05T20:36:51,775 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp' 2025-11-05T20:36:51,776 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h' 2025-11-05T20:36:51,778 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu' 2025-11-05T20:36:51,780 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h' 2025-11-05T20:36:51,782 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h' 2025-11-05T20:36:51,784 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh' 2025-11-05T20:36:51,785 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh' 2025-11-05T20:36:51,786 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh' 2025-11-05T20:36:51,788 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh' 2025-11-05T20:36:51,789 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh' 2025-11-05T20:36:51,791 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh' 2025-11-05T20:36:51,792 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh' 2025-11-05T20:36:51,794 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h' 2025-11-05T20:36:51,795 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py' 2025-11-05T20:36:51,797 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp' 2025-11-05T20:36:51,798 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h' 2025-11-05T20:36:51,799 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py' 2025-11-05T20:36:51,801 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py' 2025-11-05T20:36:51,802 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu' 2025-11-05T20:36:51,804 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py' 2025-11-05T20:36:51,805 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py' 2025-11-05T20:36:51,807 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py' 2025-11-05T20:36:51,808 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp' 2025-11-05T20:36:51,809 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h' 2025-11-05T20:36:51,811 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu' 2025-11-05T20:36:51,812 adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py' 2025-11-05T20:36:51,814 adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp' 2025-11-05T20:36:51,815 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py' 2025-11-05T20:36:51,817 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu' 2025-11-05T20:36:51,818 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h' 2025-11-05T20:36:51,819 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py' 2025-11-05T20:36:51,820 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h' 2025-11-05T20:36:51,822 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py' 2025-11-05T20:36:51,823 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py' 2025-11-05T20:36:51,825 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu' 2025-11-05T20:36:51,826 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h' 2025-11-05T20:36:51,827 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py' 2025-11-05T20:36:51,828 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h' 2025-11-05T20:36:51,830 adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h' 2025-11-05T20:36:51,832 adding 'deepspeed/inference/v2/kernels/includes/activation_type.h' 2025-11-05T20:36:51,833 adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h' 2025-11-05T20:36:51,834 adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h' 2025-11-05T20:36:51,837 adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h' 2025-11-05T20:36:51,840 adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h' 2025-11-05T20:36:51,841 adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py' 2025-11-05T20:36:51,843 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp' 2025-11-05T20:36:51,845 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py' 2025-11-05T20:36:51,846 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp' 2025-11-05T20:36:51,847 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h' 2025-11-05T20:36:51,848 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py' 2025-11-05T20:36:51,850 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py' 2025-11-05T20:36:51,851 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h' 2025-11-05T20:36:51,853 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp' 2025-11-05T20:36:51,854 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h' 2025-11-05T20:36:51,855 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py' 2025-11-05T20:36:51,857 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h' 2025-11-05T20:36:51,858 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py' 2025-11-05T20:36:51,860 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp' 2025-11-05T20:36:51,861 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh' 2025-11-05T20:36:51,862 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h' 2025-11-05T20:36:51,864 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py' 2025-11-05T20:36:51,865 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu' 2025-11-05T20:36:51,867 adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h' 2025-11-05T20:36:51,869 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py' 2025-11-05T20:36:51,870 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp' 2025-11-05T20:36:51,871 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh' 2025-11-05T20:36:51,873 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h' 2025-11-05T20:36:51,874 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py' 2025-11-05T20:36:51,876 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu' 2025-11-05T20:36:51,877 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py' 2025-11-05T20:36:51,879 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py' 2025-11-05T20:36:51,880 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py' 2025-11-05T20:36:51,881 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp' 2025-11-05T20:36:51,883 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh' 2025-11-05T20:36:51,884 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h' 2025-11-05T20:36:51,885 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py' 2025-11-05T20:36:51,886 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu' 2025-11-05T20:36:51,888 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py' 2025-11-05T20:36:51,889 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp' 2025-11-05T20:36:51,890 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh' 2025-11-05T20:36:51,891 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h' 2025-11-05T20:36:51,893 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py' 2025-11-05T20:36:51,894 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu' 2025-11-05T20:36:51,896 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py' 2025-11-05T20:36:51,897 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp' 2025-11-05T20:36:51,898 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh' 2025-11-05T20:36:51,899 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h' 2025-11-05T20:36:51,901 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py' 2025-11-05T20:36:51,902 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu' 2025-11-05T20:36:51,904 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h' 2025-11-05T20:36:51,905 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp' 2025-11-05T20:36:51,906 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h' 2025-11-05T20:36:51,908 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py' 2025-11-05T20:36:51,909 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp' 2025-11-05T20:36:51,910 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh' 2025-11-05T20:36:51,912 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h' 2025-11-05T20:36:51,913 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py' 2025-11-05T20:36:51,914 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu' 2025-11-05T20:36:51,916 adding 'deepspeed/inference/v2/model_implementations/__init__.py' 2025-11-05T20:36:51,918 adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py' 2025-11-05T20:36:51,920 adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py' 2025-11-05T20:36:51,922 adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py' 2025-11-05T20:36:51,924 adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py' 2025-11-05T20:36:51,927 adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py' 2025-11-05T20:36:51,929 adding 'deepspeed/inference/v2/model_implementations/parameter_base.py' 2025-11-05T20:36:51,930 adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py' 2025-11-05T20:36:51,932 adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py' 2025-11-05T20:36:51,933 adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py' 2025-11-05T20:36:51,934 adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py' 2025-11-05T20:36:51,935 adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py' 2025-11-05T20:36:51,937 adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py' 2025-11-05T20:36:51,938 adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py' 2025-11-05T20:36:51,939 adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py' 2025-11-05T20:36:51,940 adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py' 2025-11-05T20:36:51,942 adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py' 2025-11-05T20:36:51,943 adding 'deepspeed/inference/v2/model_implementations/falcon/container.py' 2025-11-05T20:36:51,945 adding 'deepspeed/inference/v2/model_implementations/falcon/model.py' 2025-11-05T20:36:51,946 adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py' 2025-11-05T20:36:51,948 adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py' 2025-11-05T20:36:51,949 adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py' 2025-11-05T20:36:51,951 adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py' 2025-11-05T20:36:51,952 adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py' 2025-11-05T20:36:51,954 adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py' 2025-11-05T20:36:51,955 adding 'deepspeed/inference/v2/model_implementations/mistral/container.py' 2025-11-05T20:36:51,957 adding 'deepspeed/inference/v2/model_implementations/mistral/model.py' 2025-11-05T20:36:51,958 adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py' 2025-11-05T20:36:51,960 adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py' 2025-11-05T20:36:51,961 adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py' 2025-11-05T20:36:51,963 adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py' 2025-11-05T20:36:51,964 adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py' 2025-11-05T20:36:51,965 adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py' 2025-11-05T20:36:51,967 adding 'deepspeed/inference/v2/model_implementations/opt/container.py' 2025-11-05T20:36:51,968 adding 'deepspeed/inference/v2/model_implementations/opt/model.py' 2025-11-05T20:36:51,970 adding 'deepspeed/inference/v2/model_implementations/opt/policy.py' 2025-11-05T20:36:51,971 adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py' 2025-11-05T20:36:51,973 adding 'deepspeed/inference/v2/model_implementations/phi/containers.py' 2025-11-05T20:36:51,974 adding 'deepspeed/inference/v2/model_implementations/phi/model.py' 2025-11-05T20:36:51,976 adding 'deepspeed/inference/v2/model_implementations/phi/policy.py' 2025-11-05T20:36:51,978 adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py' 2025-11-05T20:36:51,979 adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py' 2025-11-05T20:36:51,981 adding 'deepspeed/inference/v2/model_implementations/phi3/model.py' 2025-11-05T20:36:51,982 adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py' 2025-11-05T20:36:51,984 adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py' 2025-11-05T20:36:51,985 adding 'deepspeed/inference/v2/model_implementations/qwen/container.py' 2025-11-05T20:36:51,987 adding 'deepspeed/inference/v2/model_implementations/qwen/model.py' 2025-11-05T20:36:51,988 adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py' 2025-11-05T20:36:51,990 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py' 2025-11-05T20:36:51,991 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py' 2025-11-05T20:36:51,993 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py' 2025-11-05T20:36:51,994 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py' 2025-11-05T20:36:51,996 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py' 2025-11-05T20:36:51,997 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py' 2025-11-05T20:36:51,999 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py' 2025-11-05T20:36:52,001 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py' 2025-11-05T20:36:52,002 adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py' 2025-11-05T20:36:52,004 adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py' 2025-11-05T20:36:52,005 adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py' 2025-11-05T20:36:52,006 adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py' 2025-11-05T20:36:52,007 adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py' 2025-11-05T20:36:52,009 adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py' 2025-11-05T20:36:52,010 adding 'deepspeed/inference/v2/model_implementations/sharding/types.py' 2025-11-05T20:36:52,012 adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py' 2025-11-05T20:36:52,013 adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py' 2025-11-05T20:36:52,015 adding 'deepspeed/inference/v2/modules/__init__.py' 2025-11-05T20:36:52,016 adding 'deepspeed/inference/v2/modules/ds_module.py' 2025-11-05T20:36:52,018 adding 'deepspeed/inference/v2/modules/heuristics.py' 2025-11-05T20:36:52,019 adding 'deepspeed/inference/v2/modules/module_registry.py' 2025-11-05T20:36:52,021 adding 'deepspeed/inference/v2/modules/configs/__init__.py' 2025-11-05T20:36:52,022 adding 'deepspeed/inference/v2/modules/configs/attention_configs.py' 2025-11-05T20:36:52,024 adding 'deepspeed/inference/v2/modules/configs/embedding_config.py' 2025-11-05T20:36:52,025 adding 'deepspeed/inference/v2/modules/configs/linear_config.py' 2025-11-05T20:36:52,026 adding 'deepspeed/inference/v2/modules/configs/moe_config.py' 2025-11-05T20:36:52,027 adding 'deepspeed/inference/v2/modules/configs/norm_config.py' 2025-11-05T20:36:52,029 adding 'deepspeed/inference/v2/modules/configs/unembed_config.py' 2025-11-05T20:36:52,030 adding 'deepspeed/inference/v2/modules/implementations/__init__.py' 2025-11-05T20:36:52,032 adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py' 2025-11-05T20:36:52,033 adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py' 2025-11-05T20:36:52,035 adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py' 2025-11-05T20:36:52,036 adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py' 2025-11-05T20:36:52,038 adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py' 2025-11-05T20:36:52,039 adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py' 2025-11-05T20:36:52,041 adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py' 2025-11-05T20:36:52,043 adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py' 2025-11-05T20:36:52,045 adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py' 2025-11-05T20:36:52,047 adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py' 2025-11-05T20:36:52,048 adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py' 2025-11-05T20:36:52,050 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py' 2025-11-05T20:36:52,051 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py' 2025-11-05T20:36:52,052 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py' 2025-11-05T20:36:52,054 adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py' 2025-11-05T20:36:52,056 adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py' 2025-11-05T20:36:52,057 adding 'deepspeed/inference/v2/modules/interfaces/__init__.py' 2025-11-05T20:36:52,059 adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py' 2025-11-05T20:36:52,060 adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py' 2025-11-05T20:36:52,061 adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py' 2025-11-05T20:36:52,062 adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py' 2025-11-05T20:36:52,063 adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py' 2025-11-05T20:36:52,065 adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py' 2025-11-05T20:36:52,066 adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py' 2025-11-05T20:36:52,068 adding 'deepspeed/inference/v2/ragged/__init__.py' 2025-11-05T20:36:52,069 adding 'deepspeed/inference/v2/ragged/blocked_allocator.py' 2025-11-05T20:36:52,071 adding 'deepspeed/inference/v2/ragged/kv_cache.py' 2025-11-05T20:36:52,072 adding 'deepspeed/inference/v2/ragged/manager_configs.py' 2025-11-05T20:36:52,074 adding 'deepspeed/inference/v2/ragged/ragged_manager.py' 2025-11-05T20:36:52,076 adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py' 2025-11-05T20:36:52,078 adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py' 2025-11-05T20:36:52,080 adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu' 2025-11-05T20:36:52,081 adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp' 2025-11-05T20:36:52,083 adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h' 2025-11-05T20:36:52,084 adding 'deepspeed/io/__init__.py' 2025-11-05T20:36:52,086 adding 'deepspeed/io/base_file_writer.py' 2025-11-05T20:36:52,087 adding 'deepspeed/io/base_io_buffer.py' 2025-11-05T20:36:52,088 adding 'deepspeed/io/constants.py' 2025-11-05T20:36:52,089 adding 'deepspeed/io/double_io_buffer.py' 2025-11-05T20:36:52,091 adding 'deepspeed/io/fast_file_writer.py' 2025-11-05T20:36:52,093 adding 'deepspeed/io/mock_file_writer.py' 2025-11-05T20:36:52,094 adding 'deepspeed/io/py_file_writer.py' 2025-11-05T20:36:52,095 adding 'deepspeed/io/single_io_buffer.py' 2025-11-05T20:36:52,096 adding 'deepspeed/io/utils.py' 2025-11-05T20:36:52,098 adding 'deepspeed/launcher/__init__.py' 2025-11-05T20:36:52,099 adding 'deepspeed/launcher/constants.py' 2025-11-05T20:36:52,101 adding 'deepspeed/launcher/launch.py' 2025-11-05T20:36:52,103 adding 'deepspeed/launcher/launcher_helper.py' 2025-11-05T20:36:52,105 adding 'deepspeed/launcher/multinode_runner.py' 2025-11-05T20:36:52,108 adding 'deepspeed/launcher/runner.py' 2025-11-05T20:36:52,110 adding 'deepspeed/linear/__init__.py' 2025-11-05T20:36:52,111 adding 'deepspeed/linear/config.py' 2025-11-05T20:36:52,113 adding 'deepspeed/linear/context_manager.py' 2025-11-05T20:36:52,114 adding 'deepspeed/linear/optimized_linear.py' 2025-11-05T20:36:52,116 adding 'deepspeed/linear/quantization.py' 2025-11-05T20:36:52,118 adding 'deepspeed/model_implementations/__init__.py' 2025-11-05T20:36:52,119 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2025-11-05T20:36:52,121 adding 'deepspeed/model_implementations/diffusers/unet.py' 2025-11-05T20:36:52,122 adding 'deepspeed/model_implementations/diffusers/vae.py' 2025-11-05T20:36:52,124 adding 'deepspeed/model_implementations/features/__init__.py' 2025-11-05T20:36:52,125 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2025-11-05T20:36:52,127 adding 'deepspeed/model_implementations/transformers/__init__.py' 2025-11-05T20:36:52,128 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2025-11-05T20:36:52,129 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2025-11-05T20:36:52,130 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2025-11-05T20:36:52,132 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2025-11-05T20:36:52,133 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2025-11-05T20:36:52,134 adding 'deepspeed/model_implementations/transformers/ds_llama2.py' 2025-11-05T20:36:52,135 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2025-11-05T20:36:52,136 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2025-11-05T20:36:52,138 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2025-11-05T20:36:52,140 adding 'deepspeed/module_inject/__init__.py' 2025-11-05T20:36:52,142 adding 'deepspeed/module_inject/auto_tp.py' 2025-11-05T20:36:52,144 adding 'deepspeed/module_inject/auto_tp_model_utils.py' 2025-11-05T20:36:52,146 adding 'deepspeed/module_inject/fusedqkv_utils.py' 2025-11-05T20:36:52,147 adding 'deepspeed/module_inject/inject.py' 2025-11-05T20:36:52,150 adding 'deepspeed/module_inject/layers.py' 2025-11-05T20:36:52,152 adding 'deepspeed/module_inject/load_checkpoint.py' 2025-11-05T20:36:52,154 adding 'deepspeed/module_inject/module_quantize.py' 2025-11-05T20:36:52,155 adding 'deepspeed/module_inject/policy.py' 2025-11-05T20:36:52,159 adding 'deepspeed/module_inject/replace_module.py' 2025-11-05T20:36:52,160 adding 'deepspeed/module_inject/replace_policy.py' 2025-11-05T20:36:52,161 adding 'deepspeed/module_inject/tp_shard.py' 2025-11-05T20:36:52,162 adding 'deepspeed/module_inject/utils.py' 2025-11-05T20:36:52,165 adding 'deepspeed/module_inject/containers/__init__.py' 2025-11-05T20:36:52,167 adding 'deepspeed/module_inject/containers/base.py' 2025-11-05T20:36:52,168 adding 'deepspeed/module_inject/containers/base_moe.py' 2025-11-05T20:36:52,169 adding 'deepspeed/module_inject/containers/bert.py' 2025-11-05T20:36:52,171 adding 'deepspeed/module_inject/containers/bloom.py' 2025-11-05T20:36:52,172 adding 'deepspeed/module_inject/containers/clip.py' 2025-11-05T20:36:52,174 adding 'deepspeed/module_inject/containers/distil_bert.py' 2025-11-05T20:36:52,175 adding 'deepspeed/module_inject/containers/gpt2.py' 2025-11-05T20:36:52,176 adding 'deepspeed/module_inject/containers/gptj.py' 2025-11-05T20:36:52,178 adding 'deepspeed/module_inject/containers/gptneo.py' 2025-11-05T20:36:52,179 adding 'deepspeed/module_inject/containers/gptneox.py' 2025-11-05T20:36:52,181 adding 'deepspeed/module_inject/containers/internlm.py' 2025-11-05T20:36:52,182 adding 'deepspeed/module_inject/containers/llama.py' 2025-11-05T20:36:52,184 adding 'deepspeed/module_inject/containers/llama2.py' 2025-11-05T20:36:52,185 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2025-11-05T20:36:52,187 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2025-11-05T20:36:52,188 adding 'deepspeed/module_inject/containers/opt.py' 2025-11-05T20:36:52,190 adding 'deepspeed/module_inject/containers/unet.py' 2025-11-05T20:36:52,191 adding 'deepspeed/module_inject/containers/vae.py' 2025-11-05T20:36:52,193 adding 'deepspeed/module_inject/containers/features/__init__.py' 2025-11-05T20:36:52,195 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2025-11-05T20:36:52,196 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2025-11-05T20:36:52,198 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2025-11-05T20:36:52,199 adding 'deepspeed/module_inject/containers/features/megatron.py' 2025-11-05T20:36:52,200 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2025-11-05T20:36:52,202 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2025-11-05T20:36:52,204 adding 'deepspeed/moe/__init__.py' 2025-11-05T20:36:52,205 adding 'deepspeed/moe/experts.py' 2025-11-05T20:36:52,206 adding 'deepspeed/moe/layer.py' 2025-11-05T20:36:52,208 adding 'deepspeed/moe/mappings.py' 2025-11-05T20:36:52,211 adding 'deepspeed/moe/sharded_moe.py' 2025-11-05T20:36:52,213 adding 'deepspeed/moe/utils.py' 2025-11-05T20:36:52,215 adding 'deepspeed/monitor/__init__.py' 2025-11-05T20:36:52,216 adding 'deepspeed/monitor/comet.py' 2025-11-05T20:36:52,217 adding 'deepspeed/monitor/config.py' 2025-11-05T20:36:52,219 adding 'deepspeed/monitor/csv_monitor.py' 2025-11-05T20:36:52,220 adding 'deepspeed/monitor/monitor.py' 2025-11-05T20:36:52,221 adding 'deepspeed/monitor/tensorboard.py' 2025-11-05T20:36:52,222 adding 'deepspeed/monitor/utils.py' 2025-11-05T20:36:52,223 adding 'deepspeed/monitor/wandb.py' 2025-11-05T20:36:52,225 adding 'deepspeed/nebula/__init__.py' 2025-11-05T20:36:52,226 adding 'deepspeed/nebula/config.py' 2025-11-05T20:36:52,227 adding 'deepspeed/nebula/constants.py' 2025-11-05T20:36:52,229 adding 'deepspeed/nvme/__init__.py' 2025-11-05T20:36:52,231 adding 'deepspeed/nvme/ds_aio_args.py' 2025-11-05T20:36:52,232 adding 'deepspeed/nvme/ds_aio_basic.py' 2025-11-05T20:36:52,233 adding 'deepspeed/nvme/ds_aio_constants.py' 2025-11-05T20:36:52,235 adding 'deepspeed/nvme/ds_aio_handle.py' 2025-11-05T20:36:52,236 adding 'deepspeed/nvme/ds_aio_job.py' 2025-11-05T20:36:52,237 adding 'deepspeed/nvme/io_engine.py' 2025-11-05T20:36:52,239 adding 'deepspeed/nvme/parse_nvme_stats.py' 2025-11-05T20:36:52,240 adding 'deepspeed/nvme/perf_generate_param.py' 2025-11-05T20:36:52,242 adding 'deepspeed/nvme/perf_run_sweep.py' 2025-11-05T20:36:52,243 adding 'deepspeed/nvme/perf_sweep_utils.py' 2025-11-05T20:36:52,244 adding 'deepspeed/nvme/test_ds_aio.py' 2025-11-05T20:36:52,246 adding 'deepspeed/nvme/test_ds_aio_utils.py' 2025-11-05T20:36:52,247 adding 'deepspeed/nvme/torch_fastio_engine.py' 2025-11-05T20:36:52,248 adding 'deepspeed/nvme/torch_io.py' 2025-11-05T20:36:52,249 adding 'deepspeed/nvme/validate_async_io.py' 2025-11-05T20:36:52,251 adding 'deepspeed/ops/__init__.py' 2025-11-05T20:36:52,252 adding 'deepspeed/ops/adagrad/__init__.py' 2025-11-05T20:36:52,254 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2025-11-05T20:36:52,256 adding 'deepspeed/ops/adam/__init__.py' 2025-11-05T20:36:52,258 adding 'deepspeed/ops/adam/cpu_adam.py' 2025-11-05T20:36:52,259 adding 'deepspeed/ops/adam/fused_adam.py' 2025-11-05T20:36:52,260 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2025-11-05T20:36:52,262 adding 'deepspeed/ops/adam/zenflow_cpu_adam.py' 2025-11-05T20:36:52,266 adding 'deepspeed/ops/adam/zenflow_torch_adam.py' 2025-11-05T20:36:52,267 adding 'deepspeed/ops/aio/__init__.py' 2025-11-05T20:36:52,269 adding 'deepspeed/ops/compile/__init__.py' 2025-11-05T20:36:52,271 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2025-11-05T20:36:52,273 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2025-11-05T20:36:52,275 adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp' 2025-11-05T20:36:52,276 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2025-11-05T20:36:52,278 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2025-11-05T20:36:52,279 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2025-11-05T20:36:52,282 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2025-11-05T20:36:52,283 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2025-11-05T20:36:52,285 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2025-11-05T20:36:52,286 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2025-11-05T20:36:52,288 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2025-11-05T20:36:52,289 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2025-11-05T20:36:52,291 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp' 2025-11-05T20:36:52,292 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h' 2025-11-05T20:36:52,293 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2025-11-05T20:36:52,295 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2025-11-05T20:36:52,296 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp' 2025-11-05T20:36:52,297 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h' 2025-11-05T20:36:52,299 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2025-11-05T20:36:52,300 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2025-11-05T20:36:52,301 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2025-11-05T20:36:52,302 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2025-11-05T20:36:52,303 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2025-11-05T20:36:52,305 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2025-11-05T20:36:52,306 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2025-11-05T20:36:52,307 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2025-11-05T20:36:52,309 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp' 2025-11-05T20:36:52,310 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h' 2025-11-05T20:36:52,312 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2025-11-05T20:36:52,314 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2025-11-05T20:36:52,316 adding 'deepspeed/ops/csrc/compile/deepcompile.cpp' 2025-11-05T20:36:52,317 adding 'deepspeed/ops/csrc/compile/init.cpp' 2025-11-05T20:36:52,318 adding 'deepspeed/ops/csrc/compile/util.cpp' 2025-11-05T20:36:52,320 adding 'deepspeed/ops/csrc/compile/z1.cpp' 2025-11-05T20:36:52,321 adding 'deepspeed/ops/csrc/compile/z1.h' 2025-11-05T20:36:52,323 adding 'deepspeed/ops/csrc/compile/z2.cpp' 2025-11-05T20:36:52,324 adding 'deepspeed/ops/csrc/compile/z2.h' 2025-11-05T20:36:52,327 adding 'deepspeed/ops/csrc/compile/z3.cpp' 2025-11-05T20:36:52,328 adding 'deepspeed/ops/csrc/compile/z3.h' 2025-11-05T20:36:52,330 adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp' 2025-11-05T20:36:52,333 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2025-11-05T20:36:52,336 adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp' 2025-11-05T20:36:52,337 adding 'deepspeed/ops/csrc/cpu/comm/shm.h' 2025-11-05T20:36:52,339 adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp' 2025-11-05T20:36:52,341 adding 'deepspeed/ops/csrc/cpu/comm/riscv64/shm.h' 2025-11-05T20:36:52,343 adding 'deepspeed/ops/csrc/cpu/comm/x86_64/shm.h' 2025-11-05T20:36:52,345 adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp' 2025-11-05T20:36:52,347 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp' 2025-11-05T20:36:52,348 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu' 2025-11-05T20:36:52,350 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu' 2025-11-05T20:36:52,352 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h' 2025-11-05T20:36:52,360 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h' 2025-11-05T20:36:52,365 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h' 2025-11-05T20:36:52,367 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h' 2025-11-05T20:36:52,370 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h' 2025-11-05T20:36:52,372 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h' 2025-11-05T20:36:52,373 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h' 2025-11-05T20:36:52,375 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h' 2025-11-05T20:36:52,377 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h' 2025-11-05T20:36:52,380 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h' 2025-11-05T20:36:52,383 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h' 2025-11-05T20:36:52,385 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h' 2025-11-05T20:36:52,387 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h' 2025-11-05T20:36:52,394 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h' 2025-11-05T20:36:52,398 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h' 2025-11-05T20:36:52,399 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h' 2025-11-05T20:36:52,403 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h' 2025-11-05T20:36:52,406 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h' 2025-11-05T20:36:52,410 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h' 2025-11-05T20:36:52,412 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h' 2025-11-05T20:36:52,414 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h' 2025-11-05T20:36:52,416 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h' 2025-11-05T20:36:52,417 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h' 2025-11-05T20:36:52,419 adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp' 2025-11-05T20:36:52,422 adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu' 2025-11-05T20:36:52,423 adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h' 2025-11-05T20:36:52,425 adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h' 2025-11-05T20:36:52,427 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp' 2025-11-05T20:36:52,429 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h' 2025-11-05T20:36:52,430 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h' 2025-11-05T20:36:52,431 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp' 2025-11-05T20:36:52,433 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h' 2025-11-05T20:36:52,434 adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp' 2025-11-05T20:36:52,436 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2025-11-05T20:36:52,438 adding 'deepspeed/ops/csrc/includes/Timer.h' 2025-11-05T20:36:52,439 adding 'deepspeed/ops/csrc/includes/activation_type.h' 2025-11-05T20:36:52,440 adding 'deepspeed/ops/csrc/includes/compat.h' 2025-11-05T20:36:52,441 adding 'deepspeed/ops/csrc/includes/context.h' 2025-11-05T20:36:52,443 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2025-11-05T20:36:52,445 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2025-11-05T20:36:52,446 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2025-11-05T20:36:52,448 adding 'deepspeed/ops/csrc/includes/cpu_lion.h' 2025-11-05T20:36:52,449 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2025-11-05T20:36:52,451 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2025-11-05T20:36:52,454 adding 'deepspeed/ops/csrc/includes/deepcompile.h' 2025-11-05T20:36:52,456 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2025-11-05T20:36:52,457 adding 'deepspeed/ops/csrc/includes/dropout.h' 2025-11-05T20:36:52,459 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2025-11-05T20:36:52,460 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2025-11-05T20:36:52,462 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2025-11-05T20:36:52,463 adding 'deepspeed/ops/csrc/includes/gelu.h' 2025-11-05T20:36:52,465 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2025-11-05T20:36:52,466 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2025-11-05T20:36:52,469 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2025-11-05T20:36:52,471 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2025-11-05T20:36:52,472 adding 'deepspeed/ops/csrc/includes/quantization.h' 2025-11-05T20:36:52,474 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2025-11-05T20:36:52,476 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2025-11-05T20:36:52,478 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2025-11-05T20:36:52,480 adding 'deepspeed/ops/csrc/includes/simd.h' 2025-11-05T20:36:52,482 adding 'deepspeed/ops/csrc/includes/softmax.h' 2025-11-05T20:36:52,483 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2025-11-05T20:36:52,485 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2025-11-05T20:36:52,486 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2025-11-05T20:36:52,488 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2025-11-05T20:36:52,490 adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp' 2025-11-05T20:36:52,492 adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp' 2025-11-05T20:36:52,493 adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp' 2025-11-05T20:36:52,495 adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh' 2025-11-05T20:36:52,496 adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu' 2025-11-05T20:36:52,498 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2025-11-05T20:36:52,501 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2025-11-05T20:36:52,503 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2025-11-05T20:36:52,505 adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu' 2025-11-05T20:36:52,507 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2025-11-05T20:36:52,508 adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu' 2025-11-05T20:36:52,510 adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu' 2025-11-05T20:36:52,513 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2025-11-05T20:36:52,514 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2025-11-05T20:36:52,515 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2025-11-05T20:36:52,517 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2025-11-05T20:36:52,519 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2025-11-05T20:36:52,522 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2025-11-05T20:36:52,523 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2025-11-05T20:36:52,525 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2025-11-05T20:36:52,527 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2025-11-05T20:36:52,529 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2025-11-05T20:36:52,533 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2025-11-05T20:36:52,535 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2025-11-05T20:36:52,537 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2025-11-05T20:36:52,541 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2025-11-05T20:36:52,544 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2025-11-05T20:36:52,547 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2025-11-05T20:36:52,549 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2025-11-05T20:36:52,551 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2025-11-05T20:36:52,554 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2025-11-05T20:36:52,556 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2025-11-05T20:36:52,557 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2025-11-05T20:36:52,563 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2025-11-05T20:36:52,565 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2025-11-05T20:36:52,566 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2025-11-05T20:36:52,569 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2025-11-05T20:36:52,572 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2025-11-05T20:36:52,575 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2025-11-05T20:36:52,576 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2025-11-05T20:36:52,578 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2025-11-05T20:36:52,580 adding 'deepspeed/ops/csrc/utils/py_ds_utils.cpp' 2025-11-05T20:36:52,581 adding 'deepspeed/ops/csrc/utils/tensor_cast.cpp' 2025-11-05T20:36:52,582 adding 'deepspeed/ops/csrc/utils/tensor_cast.h' 2025-11-05T20:36:52,585 adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp' 2025-11-05T20:36:52,587 adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp' 2025-11-05T20:36:52,588 adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp' 2025-11-05T20:36:52,590 adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp' 2025-11-05T20:36:52,591 adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp' 2025-11-05T20:36:52,593 adding 'deepspeed/ops/csrc/xpu/includes/compat.h' 2025-11-05T20:36:52,595 adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h' 2025-11-05T20:36:52,596 adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h' 2025-11-05T20:36:52,597 adding 'deepspeed/ops/csrc/xpu/includes/simd.h' 2025-11-05T20:36:52,599 adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h' 2025-11-05T20:36:52,601 adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp' 2025-11-05T20:36:52,602 adding 'deepspeed/ops/deepspeed4science/__init__.py' 2025-11-05T20:36:52,604 adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py' 2025-11-05T20:36:52,605 adding 'deepspeed/ops/fp_quantizer/__init__.py' 2025-11-05T20:36:52,606 adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py' 2025-11-05T20:36:52,608 adding 'deepspeed/ops/fp_quantizer/fp8_gemm_triton.py' 2025-11-05T20:36:52,609 adding 'deepspeed/ops/fp_quantizer/quantize.py' 2025-11-05T20:36:52,611 adding 'deepspeed/ops/gds/__init__.py' 2025-11-05T20:36:52,613 adding 'deepspeed/ops/lamb/__init__.py' 2025-11-05T20:36:52,614 adding 'deepspeed/ops/lamb/fused_lamb.py' 2025-11-05T20:36:52,616 adding 'deepspeed/ops/lion/__init__.py' 2025-11-05T20:36:52,618 adding 'deepspeed/ops/lion/cpu_lion.py' 2025-11-05T20:36:52,619 adding 'deepspeed/ops/lion/fused_lion.py' 2025-11-05T20:36:52,620 adding 'deepspeed/ops/lion/multi_tensor_apply.py' 2025-11-05T20:36:52,622 adding 'deepspeed/ops/op_builder/__init__.py' 2025-11-05T20:36:52,624 adding 'deepspeed/ops/op_builder/all_ops.py' 2025-11-05T20:36:52,625 adding 'deepspeed/ops/op_builder/async_io.py' 2025-11-05T20:36:52,629 adding 'deepspeed/ops/op_builder/builder.py' 2025-11-05T20:36:52,630 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2025-11-05T20:36:52,632 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2025-11-05T20:36:52,633 adding 'deepspeed/ops/op_builder/cpu_lion.py' 2025-11-05T20:36:52,634 adding 'deepspeed/ops/op_builder/dc.py' 2025-11-05T20:36:52,635 adding 'deepspeed/ops/op_builder/evoformer_attn.py' 2025-11-05T20:36:52,637 adding 'deepspeed/ops/op_builder/fp_quantizer.py' 2025-11-05T20:36:52,638 adding 'deepspeed/ops/op_builder/fused_adam.py' 2025-11-05T20:36:52,639 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2025-11-05T20:36:52,641 adding 'deepspeed/ops/op_builder/fused_lion.py' 2025-11-05T20:36:52,642 adding 'deepspeed/ops/op_builder/gds.py' 2025-11-05T20:36:52,643 adding 'deepspeed/ops/op_builder/inference_core_ops.py' 2025-11-05T20:36:52,645 adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py' 2025-11-05T20:36:52,646 adding 'deepspeed/ops/op_builder/quantizer.py' 2025-11-05T20:36:52,647 adding 'deepspeed/ops/op_builder/ragged_ops.py' 2025-11-05T20:36:52,649 adding 'deepspeed/ops/op_builder/ragged_utils.py' 2025-11-05T20:36:52,650 adding 'deepspeed/ops/op_builder/random_ltd.py' 2025-11-05T20:36:52,651 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2025-11-05T20:36:52,653 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2025-11-05T20:36:52,654 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2025-11-05T20:36:52,655 adding 'deepspeed/ops/op_builder/transformer.py' 2025-11-05T20:36:52,656 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2025-11-05T20:36:52,658 adding 'deepspeed/ops/op_builder/utils.py' 2025-11-05T20:36:52,659 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2025-11-05T20:36:52,661 adding 'deepspeed/ops/op_builder/cpu/async_io.py' 2025-11-05T20:36:52,662 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2025-11-05T20:36:52,663 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2025-11-05T20:36:52,664 adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py' 2025-11-05T20:36:52,666 adding 'deepspeed/ops/op_builder/cpu/fused_adam.py' 2025-11-05T20:36:52,667 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2025-11-05T20:36:52,668 adding 'deepspeed/ops/op_builder/hpu/__init__.py' 2025-11-05T20:36:52,669 adding 'deepspeed/ops/op_builder/hpu/builder.py' 2025-11-05T20:36:52,671 adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py' 2025-11-05T20:36:52,672 adding 'deepspeed/ops/op_builder/hpu/fp_quantizer.py' 2025-11-05T20:36:52,673 adding 'deepspeed/ops/op_builder/hpu/fused_adam.py' 2025-11-05T20:36:52,675 adding 'deepspeed/ops/op_builder/hpu/no_impl.py' 2025-11-05T20:36:52,676 adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py' 2025-11-05T20:36:52,678 adding 'deepspeed/ops/op_builder/mlu/__init__.py' 2025-11-05T20:36:52,679 adding 'deepspeed/ops/op_builder/mlu/builder.py' 2025-11-05T20:36:52,680 adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py' 2025-11-05T20:36:52,681 adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py' 2025-11-05T20:36:52,683 adding 'deepspeed/ops/op_builder/mlu/fused_adam.py' 2025-11-05T20:36:52,684 adding 'deepspeed/ops/op_builder/mlu/no_impl.py' 2025-11-05T20:36:52,686 adding 'deepspeed/ops/op_builder/npu/__init__.py' 2025-11-05T20:36:52,687 adding 'deepspeed/ops/op_builder/npu/async_io.py' 2025-11-05T20:36:52,688 adding 'deepspeed/ops/op_builder/npu/builder.py' 2025-11-05T20:36:52,690 adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py' 2025-11-05T20:36:52,691 adding 'deepspeed/ops/op_builder/npu/cpu_adam.py' 2025-11-05T20:36:52,692 adding 'deepspeed/ops/op_builder/npu/cpu_lion.py' 2025-11-05T20:36:52,693 adding 'deepspeed/ops/op_builder/npu/fused_adam.py' 2025-11-05T20:36:52,695 adding 'deepspeed/ops/op_builder/npu/inference.py' 2025-11-05T20:36:52,696 adding 'deepspeed/ops/op_builder/npu/no_impl.py' 2025-11-05T20:36:52,698 adding 'deepspeed/ops/op_builder/sdaa/__init__.py' 2025-11-05T20:36:52,700 adding 'deepspeed/ops/op_builder/sdaa/builder.py' 2025-11-05T20:36:52,701 adding 'deepspeed/ops/op_builder/sdaa/cpu_adam.py' 2025-11-05T20:36:52,702 adding 'deepspeed/ops/op_builder/sdaa/fused_adam.py' 2025-11-05T20:36:52,704 adding 'deepspeed/ops/op_builder/sdaa/no_impl.py' 2025-11-05T20:36:52,706 adding 'deepspeed/ops/op_builder/xpu/__init__.py' 2025-11-05T20:36:52,707 adding 'deepspeed/ops/op_builder/xpu/async_io.py' 2025-11-05T20:36:52,709 adding 'deepspeed/ops/op_builder/xpu/builder.py' 2025-11-05T20:36:52,710 adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py' 2025-11-05T20:36:52,711 adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py' 2025-11-05T20:36:52,712 adding 'deepspeed/ops/op_builder/xpu/flash_attn.py' 2025-11-05T20:36:52,713 adding 'deepspeed/ops/op_builder/xpu/fused_adam.py' 2025-11-05T20:36:52,715 adding 'deepspeed/ops/op_builder/xpu/inference.py' 2025-11-05T20:36:52,716 adding 'deepspeed/ops/op_builder/xpu/no_impl.py' 2025-11-05T20:36:52,717 adding 'deepspeed/ops/op_builder/xpu/packbits.py' 2025-11-05T20:36:52,719 adding 'deepspeed/ops/quantizer/__init__.py' 2025-11-05T20:36:52,720 adding 'deepspeed/ops/quantizer/quantizer.py' 2025-11-05T20:36:52,722 adding 'deepspeed/ops/random_ltd/__init__.py' 2025-11-05T20:36:52,723 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2025-11-05T20:36:52,725 adding 'deepspeed/ops/sparse_attention/__init__.py' 2025-11-05T20:36:52,727 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2025-11-05T20:36:52,731 adding 'deepspeed/ops/sparse_attention/matmul.py' 2025-11-05T20:36:52,733 adding 'deepspeed/ops/sparse_attention/softmax.py' 2025-11-05T20:36:52,735 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2025-11-05T20:36:52,737 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2025-11-05T20:36:52,740 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2025-11-05T20:36:52,742 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2025-11-05T20:36:52,744 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2025-11-05T20:36:52,745 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2025-11-05T20:36:52,746 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2025-11-05T20:36:52,748 adding 'deepspeed/ops/transformer/__init__.py' 2025-11-05T20:36:52,750 adding 'deepspeed/ops/transformer/transformer.py' 2025-11-05T20:36:52,752 adding 'deepspeed/ops/transformer/inference/__init__.py' 2025-11-05T20:36:52,753 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2025-11-05T20:36:52,755 adding 'deepspeed/ops/transformer/inference/config.py' 2025-11-05T20:36:52,756 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2025-11-05T20:36:52,757 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2025-11-05T20:36:52,759 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2025-11-05T20:36:52,761 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2025-11-05T20:36:52,762 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2025-11-05T20:36:52,764 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2025-11-05T20:36:52,766 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2025-11-05T20:36:52,768 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2025-11-05T20:36:52,769 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2025-11-05T20:36:52,770 adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py' 2025-11-05T20:36:52,771 adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py' 2025-11-05T20:36:52,772 adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py' 2025-11-05T20:36:52,773 adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py' 2025-11-05T20:36:52,775 adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py' 2025-11-05T20:36:52,776 adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py' 2025-11-05T20:36:52,777 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2025-11-05T20:36:52,778 adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py' 2025-11-05T20:36:52,780 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2025-11-05T20:36:52,781 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2025-11-05T20:36:52,782 adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py' 2025-11-05T20:36:52,783 adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py' 2025-11-05T20:36:52,785 adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py' 2025-11-05T20:36:52,786 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2025-11-05T20:36:52,787 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2025-11-05T20:36:52,789 adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py' 2025-11-05T20:36:52,790 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2025-11-05T20:36:52,792 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2025-11-05T20:36:52,793 adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py' 2025-11-05T20:36:52,794 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2025-11-05T20:36:52,796 adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py' 2025-11-05T20:36:52,798 adding 'deepspeed/ops/transformer/inference/triton/__init__.py' 2025-11-05T20:36:52,800 adding 'deepspeed/ops/transformer/inference/triton/attention.py' 2025-11-05T20:36:52,801 adding 'deepspeed/ops/transformer/inference/triton/gelu.py' 2025-11-05T20:36:52,803 adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py' 2025-11-05T20:36:52,805 adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py' 2025-11-05T20:36:52,806 adding 'deepspeed/ops/transformer/inference/triton/mlp.py' 2025-11-05T20:36:52,808 adding 'deepspeed/ops/transformer/inference/triton/ops.py' 2025-11-05T20:36:52,809 adding 'deepspeed/ops/transformer/inference/triton/residual_add.py' 2025-11-05T20:36:52,810 adding 'deepspeed/ops/transformer/inference/triton/softmax.py' 2025-11-05T20:36:52,812 adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py' 2025-11-05T20:36:52,814 adding 'deepspeed/pipe/__init__.py' 2025-11-05T20:36:52,815 adding 'deepspeed/profiling/__init__.py' 2025-11-05T20:36:52,817 adding 'deepspeed/profiling/config.py' 2025-11-05T20:36:52,818 adding 'deepspeed/profiling/constants.py' 2025-11-05T20:36:52,819 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2025-11-05T20:36:52,825 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2025-11-05T20:36:52,827 adding 'deepspeed/runtime/__init__.py' 2025-11-05T20:36:52,829 adding 'deepspeed/runtime/base_optimizer.py' 2025-11-05T20:36:52,832 adding 'deepspeed/runtime/bf16_optimizer.py' 2025-11-05T20:36:52,833 adding 'deepspeed/runtime/compiler.py' 2025-11-05T20:36:52,837 adding 'deepspeed/runtime/config.py' 2025-11-05T20:36:52,839 adding 'deepspeed/runtime/config_utils.py' 2025-11-05T20:36:52,841 adding 'deepspeed/runtime/constants.py' 2025-11-05T20:36:52,843 adding 'deepspeed/runtime/dataloader.py' 2025-11-05T20:36:52,844 adding 'deepspeed/runtime/eigenvalue.py' 2025-11-05T20:36:52,866 adding 'deepspeed/runtime/engine.py' 2025-11-05T20:36:52,870 adding 'deepspeed/runtime/hybrid_engine.py' 2025-11-05T20:36:52,874 adding 'deepspeed/runtime/lr_schedules.py' 2025-11-05T20:36:52,875 adding 'deepspeed/runtime/precision_config.py' 2025-11-05T20:36:52,877 adding 'deepspeed/runtime/progressive_layer_drop.py' 2025-11-05T20:36:52,878 adding 'deepspeed/runtime/quantize.py' 2025-11-05T20:36:52,879 adding 'deepspeed/runtime/sparse_tensor.py' 2025-11-05T20:36:52,882 adding 'deepspeed/runtime/state_dict_factory.py' 2025-11-05T20:36:52,883 adding 'deepspeed/runtime/torch_autocast.py' 2025-11-05T20:36:52,889 adding 'deepspeed/runtime/utils.py' 2025-11-05T20:36:52,891 adding 'deepspeed/runtime/weight_quantizer.py' 2025-11-05T20:36:52,892 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2025-11-05T20:36:52,897 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2025-11-05T20:36:52,899 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2025-11-05T20:36:52,901 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2025-11-05T20:36:52,902 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2025-11-05T20:36:52,903 adding 'deepspeed/runtime/checkpoint_engine/datastates_checkpoint_engine.py' 2025-11-05T20:36:52,905 adding 'deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py' 2025-11-05T20:36:52,907 adding 'deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py' 2025-11-05T20:36:52,908 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2025-11-05T20:36:52,910 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2025-11-05T20:36:52,911 adding 'deepspeed/runtime/checkpoint_engine/utils.py' 2025-11-05T20:36:52,913 adding 'deepspeed/runtime/comm/__init__.py' 2025-11-05T20:36:52,915 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2025-11-05T20:36:52,916 adding 'deepspeed/runtime/comm/compressed.py' 2025-11-05T20:36:52,918 adding 'deepspeed/runtime/comm/hccl.py' 2025-11-05T20:36:52,919 adding 'deepspeed/runtime/comm/mpi.py' 2025-11-05T20:36:52,921 adding 'deepspeed/runtime/comm/nccl.py' 2025-11-05T20:36:52,923 adding 'deepspeed/runtime/compression/__init__.py' 2025-11-05T20:36:52,924 adding 'deepspeed/runtime/compression/cupy.py' 2025-11-05T20:36:52,926 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2025-11-05T20:36:52,927 adding 'deepspeed/runtime/data_pipeline/config.py' 2025-11-05T20:36:52,929 adding 'deepspeed/runtime/data_pipeline/constants.py' 2025-11-05T20:36:52,930 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2025-11-05T20:36:52,932 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2025-11-05T20:36:52,934 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2025-11-05T20:36:52,935 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2025-11-05T20:36:52,936 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2025-11-05T20:36:52,938 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2025-11-05T20:36:52,939 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2025-11-05T20:36:52,945 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2025-11-05T20:36:52,947 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2025-11-05T20:36:52,950 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2025-11-05T20:36:52,951 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2025-11-05T20:36:52,954 adding 'deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py' 2025-11-05T20:36:52,956 adding 'deepspeed/runtime/domino/__init__.py' 2025-11-05T20:36:52,957 adding 'deepspeed/runtime/domino/async_linear.py' 2025-11-05T20:36:52,960 adding 'deepspeed/runtime/domino/transformer.py' 2025-11-05T20:36:52,962 adding 'deepspeed/runtime/fp16/__init__.py' 2025-11-05T20:36:52,964 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2025-11-05T20:36:52,966 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2025-11-05T20:36:52,969 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2025-11-05T20:36:52,970 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2025-11-05T20:36:52,972 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2025-11-05T20:36:52,975 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2025-11-05T20:36:52,978 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2025-11-05T20:36:52,980 adding 'deepspeed/runtime/model_checkpointing/__init__.py' 2025-11-05T20:36:52,981 adding 'deepspeed/runtime/model_checkpointing/config.py' 2025-11-05T20:36:52,982 adding 'deepspeed/runtime/model_checkpointing/constants.py' 2025-11-05T20:36:52,984 adding 'deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py' 2025-11-05T20:36:52,985 adding 'deepspeed/runtime/model_checkpointing/utils.py' 2025-11-05T20:36:52,987 adding 'deepspeed/runtime/model_checkpointing/writer_factory.py' 2025-11-05T20:36:52,988 adding 'deepspeed/runtime/pipe/__init__.py' 2025-11-05T20:36:52,995 adding 'deepspeed/runtime/pipe/engine.py' 2025-11-05T20:36:52,999 adding 'deepspeed/runtime/pipe/module.py' 2025-11-05T20:36:53,001 adding 'deepspeed/runtime/pipe/p2p.py' 2025-11-05T20:36:53,003 adding 'deepspeed/runtime/pipe/schedule.py' 2025-11-05T20:36:53,005 adding 'deepspeed/runtime/pipe/topology.py' 2025-11-05T20:36:53,007 adding 'deepspeed/runtime/sequence_parallel/__init__.py' 2025-11-05T20:36:53,008 adding 'deepspeed/runtime/sequence_parallel/parallel_state_sp.py' 2025-11-05T20:36:53,016 adding 'deepspeed/runtime/sequence_parallel/ulysses_sp.py' 2025-11-05T20:36:53,018 adding 'deepspeed/runtime/superoffload/__init__.py' 2025-11-05T20:36:53,020 adding 'deepspeed/runtime/superoffload/superoffload_stage3.py' 2025-11-05T20:36:53,022 adding 'deepspeed/runtime/superoffload/superoffload_utils.py' 2025-11-05T20:36:53,024 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2025-11-05T20:36:53,025 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2025-11-05T20:36:53,027 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2025-11-05T20:36:53,028 adding 'deepspeed/runtime/swap_tensor/constants.py' 2025-11-05T20:36:53,031 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2025-11-05T20:36:53,033 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2025-11-05T20:36:53,035 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2025-11-05T20:36:53,037 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2025-11-05T20:36:53,038 adding 'deepspeed/runtime/swap_tensor/utils.py' 2025-11-05T20:36:53,040 adding 'deepspeed/runtime/tensor_parallel/__init__.py' 2025-11-05T20:36:53,041 adding 'deepspeed/runtime/tensor_parallel/config.py' 2025-11-05T20:36:53,043 adding 'deepspeed/runtime/tensor_parallel/tp_manager.py' 2025-11-05T20:36:53,044 adding 'deepspeed/runtime/zenflow/__init__.py' 2025-11-05T20:36:53,046 adding 'deepspeed/runtime/zenflow/engine.py' 2025-11-05T20:36:53,049 adding 'deepspeed/runtime/zenflow/engine_stage3.py' 2025-11-05T20:36:53,051 adding 'deepspeed/runtime/zenflow/zenflow_config.py' 2025-11-05T20:36:53,055 adding 'deepspeed/runtime/zenflow/zenflow_stage_1_and_2.py' 2025-11-05T20:36:53,057 adding 'deepspeed/runtime/zenflow/zenflow_utils.py' 2025-11-05T20:36:53,058 adding 'deepspeed/runtime/zero/__init__.py' 2025-11-05T20:36:53,061 adding 'deepspeed/runtime/zero/config.py' 2025-11-05T20:36:53,063 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2025-11-05T20:36:53,064 adding 'deepspeed/runtime/zero/leaf_module_config.py' 2025-11-05T20:36:53,066 adding 'deepspeed/runtime/zero/linear.py' 2025-11-05T20:36:53,069 adding 'deepspeed/runtime/zero/mics.py' 2025-11-05T20:36:53,070 adding 'deepspeed/runtime/zero/mics_utils.py' 2025-11-05T20:36:53,072 adding 'deepspeed/runtime/zero/offload_config.py' 2025-11-05T20:36:53,073 adding 'deepspeed/runtime/zero/offload_states.py' 2025-11-05T20:36:53,076 adding 'deepspeed/runtime/zero/parameter_offload.py' 2025-11-05T20:36:53,088 adding 'deepspeed/runtime/zero/partition_parameters.py' 2025-11-05T20:36:53,093 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2025-11-05T20:36:53,094 adding 'deepspeed/runtime/zero/partitioned_param_profiler.py' 2025-11-05T20:36:53,111 adding 'deepspeed/runtime/zero/stage3.py' 2025-11-05T20:36:53,127 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2025-11-05T20:36:53,129 adding 'deepspeed/runtime/zero/test.py' 2025-11-05T20:36:53,131 adding 'deepspeed/runtime/zero/tiling.py' 2025-11-05T20:36:53,133 adding 'deepspeed/runtime/zero/utils.py' 2025-11-05T20:36:53,135 adding 'deepspeed/runtime/zero/muon/__init__.py' 2025-11-05T20:36:53,136 adding 'deepspeed/runtime/zero/muon/muon_optimizer.py' 2025-11-05T20:36:53,138 adding 'deepspeed/runtime/zero/muon/original_muon.py' 2025-11-05T20:36:53,140 adding 'deepspeed/sequence/__init__.py' 2025-11-05T20:36:53,141 adding 'deepspeed/sequence/cross_entropy.py' 2025-11-05T20:36:53,146 adding 'deepspeed/sequence/fpdt_layer.py' 2025-11-05T20:36:53,149 adding 'deepspeed/sequence/layer.py' 2025-11-05T20:36:53,151 adding 'deepspeed/utils/__init__.py' 2025-11-05T20:36:53,152 adding 'deepspeed/utils/bwc.py' 2025-11-05T20:36:53,154 adding 'deepspeed/utils/comms_logging.py' 2025-11-05T20:36:53,155 adding 'deepspeed/utils/config.py' 2025-11-05T20:36:53,157 adding 'deepspeed/utils/debug.py' 2025-11-05T20:36:53,158 adding 'deepspeed/utils/exceptions.py' 2025-11-05T20:36:53,161 adding 'deepspeed/utils/groups.py' 2025-11-05T20:36:53,163 adding 'deepspeed/utils/init_on_device.py' 2025-11-05T20:36:53,165 adding 'deepspeed/utils/logging.py' 2025-11-05T20:36:53,166 adding 'deepspeed/utils/mixed_precision_linkage.py' 2025-11-05T20:36:53,168 adding 'deepspeed/utils/numa.py' 2025-11-05T20:36:53,170 adding 'deepspeed/utils/nvtx.py' 2025-11-05T20:36:53,172 adding 'deepspeed/utils/tensor_fragment.py' 2025-11-05T20:36:53,174 adding 'deepspeed/utils/timer.py' 2025-11-05T20:36:53,175 adding 'deepspeed/utils/torch.py' 2025-11-05T20:36:53,176 adding 'deepspeed/utils/types.py' 2025-11-05T20:36:53,178 adding 'deepspeed/utils/z3_leaf_module.py' 2025-11-05T20:36:53,182 adding 'deepspeed/utils/zero_to_fp32.py' 2025-11-05T20:36:53,184 adding 'deepspeed-0.18.2.data/scripts/deepspeed' 2025-11-05T20:36:53,186 adding 'deepspeed-0.18.2.data/scripts/deepspeed.pt' 2025-11-05T20:36:53,187 adding 'deepspeed-0.18.2.data/scripts/ds' 2025-11-05T20:36:53,188 adding 'deepspeed-0.18.2.data/scripts/ds_bench' 2025-11-05T20:36:53,189 adding 'deepspeed-0.18.2.data/scripts/ds_elastic' 2025-11-05T20:36:53,190 adding 'deepspeed-0.18.2.data/scripts/ds_io' 2025-11-05T20:36:53,192 adding 'deepspeed-0.18.2.data/scripts/ds_nvme_tune' 2025-11-05T20:36:53,193 adding 'deepspeed-0.18.2.data/scripts/ds_report' 2025-11-05T20:36:53,194 adding 'deepspeed-0.18.2.data/scripts/ds_ssh' 2025-11-05T20:36:53,195 adding 'deepspeed-0.18.2.data/scripts/dsr' 2025-11-05T20:36:53,198 adding 'deepspeed-0.18.2.dist-info/licenses/LICENSE' 2025-11-05T20:36:53,202 adding 'deepspeed-0.18.2.dist-info/METADATA' 2025-11-05T20:36:53,203 adding 'deepspeed-0.18.2.dist-info/WHEEL' 2025-11-05T20:36:53,204 adding 'deepspeed-0.18.2.dist-info/entry_points.txt' 2025-11-05T20:36:53,205 adding 'deepspeed-0.18.2.dist-info/top_level.txt' 2025-11-05T20:36:53,222 adding 'deepspeed-0.18.2.dist-info/RECORD' 2025-11-05T20:36:53,257 removing build/bdist.linux-armv7l/wheel 2025-11-05T20:36:53,513 deepspeed build time = 13.625250816345215 secs 2025-11-05T20:36:53,638 Building wheel for deepspeed (setup.py): finished with status 'done' 2025-11-05T20:36:53,658 Created wheel for deepspeed: filename=deepspeed-0.18.2-py3-none-any.whl size=1763310 sha256=5dba331b1bed4f81b2efcdebf44168cc0b4bd0aa818c07b73c6299918439c570 2025-11-05T20:36:53,659 Stored in directory: /tmp/pip-ephem-wheel-cache-9c4lff35/wheels/80/2b/fe/f2625302f25976b9828a27d3d2567bdc1d587a1ff0ab42c8a9 2025-11-05T20:36:53,704 Successfully built deepspeed 2025-11-05T20:36:53,752 Removed build tracker: '/tmp/pip-build-tracker-wuez3bjp'