2025-08-31T04:50:44,073 Created temporary directory: /tmp/pip-build-tracker-wvik5ri8 2025-08-31T04:50:44,074 Initialized build tracking at /tmp/pip-build-tracker-wvik5ri8 2025-08-31T04:50:44,075 Created build tracker: /tmp/pip-build-tracker-wvik5ri8 2025-08-31T04:50:44,075 Entered build tracker: /tmp/pip-build-tracker-wvik5ri8 2025-08-31T04:50:44,076 Created temporary directory: /tmp/pip-wheel-zmsqvqvk 2025-08-31T04:50:44,080 Created temporary directory: /tmp/pip-ephem-wheel-cache-es298r37 2025-08-31T04:50:44,127 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-08-31T04:50:44,129 2 location(s) to search for versions of deepspeed: 2025-08-31T04:50:44,129 * https://pypi.org/simple/deepspeed/ 2025-08-31T04:50:44,129 * https://www.piwheels.org/simple/deepspeed/ 2025-08-31T04:50:44,130 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2025-08-31T04:50:44,131 Getting page https://pypi.org/simple/deepspeed/ 2025-08-31T04:50:44,132 Found index url https://pypi.org/simple/ 2025-08-31T04:50:44,365 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2025-08-31T04:50:44,379 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-08-31T04:50:44,381 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2025-08-31T04:50:44,383 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-08-31T04:50:44,384 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2025-08-31T04:50:44,387 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-08-31T04:50:44,389 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2025-08-31T04:50:44,392 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-08-31T04:50:44,394 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2025-08-31T04:50:44,396 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-08-31T04:50:44,398 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2025-08-31T04:50:44,400 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2025-08-31T04:50:44,402 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2025-08-31T04:50:44,405 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2025-08-31T04:50:44,409 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2025-08-31T04:50:44,410 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2025-08-31T04:50:44,410 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2025-08-31T04:50:44,411 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2025-08-31T04:50:44,411 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2025-08-31T04:50:44,412 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2025-08-31T04:50:44,413 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2025-08-31T04:50:44,413 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2025-08-31T04:50:44,414 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2025-08-31T04:50:44,415 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2025-08-31T04:50:44,415 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2025-08-31T04:50:44,416 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2025-08-31T04:50:44,417 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2025-08-31T04:50:44,418 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2025-08-31T04:50:44,418 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2025-08-31T04:50:44,419 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2025-08-31T04:50:44,420 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2025-08-31T04:50:44,421 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2025-08-31T04:50:44,421 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2025-08-31T04:50:44,422 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2025-08-31T04:50:44,423 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2025-08-31T04:50:44,423 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2025-08-31T04:50:44,424 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2025-08-31T04:50:44,424 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2025-08-31T04:50:44,425 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2025-08-31T04:50:44,426 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2025-08-31T04:50:44,426 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2025-08-31T04:50:44,427 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2025-08-31T04:50:44,428 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2025-08-31T04:50:44,429 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2025-08-31T04:50:44,430 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2025-08-31T04:50:44,431 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2025-08-31T04:50:44,431 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2025-08-31T04:50:44,432 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2025-08-31T04:50:44,433 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2025-08-31T04:50:44,433 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2025-08-31T04:50:44,434 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2025-08-31T04:50:44,435 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2025-08-31T04:50:44,436 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2025-08-31T04:50:44,436 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2025-08-31T04:50:44,437 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2025-08-31T04:50:44,438 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2025-08-31T04:50:44,438 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2025-08-31T04:50:44,439 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2025-08-31T04:50:44,440 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2025-08-31T04:50:44,442 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2025-08-31T04:50:44,445 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2025-08-31T04:50:44,448 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2025-08-31T04:50:44,450 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2025-08-31T04:50:44,453 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2025-08-31T04:50:44,456 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2025-08-31T04:50:44,458 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2025-08-31T04:50:44,461 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2025-08-31T04:50:44,463 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2025-08-31T04:50:44,465 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2025-08-31T04:50:44,468 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2025-08-31T04:50:44,469 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2025-08-31T04:50:44,471 Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5 2025-08-31T04:50:44,472 Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0 2025-08-31T04:50:44,473 Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1 2025-08-31T04:50:44,475 Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2 2025-08-31T04:50:44,476 Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3 2025-08-31T04:50:44,478 Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0 2025-08-31T04:50:44,480 Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1 2025-08-31T04:50:44,482 Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2 2025-08-31T04:50:44,483 Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0 2025-08-31T04:50:44,485 Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1 2025-08-31T04:50:44,487 Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2 2025-08-31T04:50:44,489 Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3 2025-08-31T04:50:44,491 Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4 2025-08-31T04:50:44,494 Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5 2025-08-31T04:50:44,496 Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6 2025-08-31T04:50:44,499 Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0 2025-08-31T04:50:44,502 Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1 2025-08-31T04:50:44,504 Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2 2025-08-31T04:50:44,505 Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3 2025-08-31T04:50:44,507 Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4 2025-08-31T04:50:44,509 Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5 2025-08-31T04:50:44,510 Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0 2025-08-31T04:50:44,511 Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1 2025-08-31T04:50:44,512 Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2 2025-08-31T04:50:44,514 Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3 2025-08-31T04:50:44,515 Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4 2025-08-31T04:50:44,516 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-08-31T04:50:44,517 Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5 2025-08-31T04:50:44,518 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-08-31T04:50:44,519 Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0 2025-08-31T04:50:44,520 Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1 2025-08-31T04:50:44,521 Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2 2025-08-31T04:50:44,523 Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3 2025-08-31T04:50:44,524 Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4 2025-08-31T04:50:44,526 Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0 2025-08-31T04:50:44,527 Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1 2025-08-31T04:50:44,528 Found link https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.2 2025-08-31T04:50:44,529 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/52/23/cfe2166f06f1817b73b8695addd2fded55f4189322bcf181cfb7feaba550/deepspeed-0.16.3-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-08-31T04:50:44,530 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/ce/92/853de2a32b3f9c0945e0c9e145eddac98e570c1faebcd58aa85e6dcd89ba/deepspeed-0.16.3-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-08-31T04:50:44,531 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/55/8f/57ee424e114478a667c604b2f3f05bbc1addc0afc089b9ab6a64b233063d/deepspeed-0.16.3-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-08-31T04:50:44,533 Found link https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.3 2025-08-31T04:50:44,535 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/3d/65/1a6394f5d6dee851e9ea59e385f6d6428e3bfe36f83c06e0336e14dcfd11/deepspeed-0.16.4-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-08-31T04:50:44,536 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a3/aa/bb67b63cc25c5e29e4ca3f8b155e0faf74d5a33acf2ec67e249206a36b0f/deepspeed-0.16.4-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-08-31T04:50:44,537 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d4/59/fd251661b78b049eed7ee46f0d8d51c69ae7fbb710716a1ebcc796a6b0fd/deepspeed-0.16.4-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-08-31T04:50:44,539 Found link https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.4 2025-08-31T04:50:44,540 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/15/b0/be6cc74fd1e23da20d6c34db923858a8ae5017d39a13dedc188a935c646a/deepspeed-0.16.5-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-08-31T04:50:44,541 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/0b/78/9a87d137f83f53dd57f425ac174723c746c53029bf6cdce22eb9e805e3f0/deepspeed-0.16.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-08-31T04:50:44,542 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/80/f8/a9b1fca237fe8ea25f866956778280d0b735350f29fb6f4e0b548aa02a5f/deepspeed-0.16.5-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-08-31T04:50:44,543 Found link https://files.pythonhosted.org/packages/0d/88/96569b2acb3219c9c72068f9b952c59beffe366e7d1edd9e922e5c68f08b/deepspeed-0.16.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.5 2025-08-31T04:50:44,545 Found link https://files.pythonhosted.org/packages/cb/a3/1d758fcbcdb3f5ecf4e71907e293f17bae8a9f448b112e65c6195e90c2d3/deepspeed-0.16.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.6 2025-08-31T04:50:44,547 Found link https://files.pythonhosted.org/packages/06/b3/a3903de5c5b707170c5c27e1a40f4ef613f14d241bd84d8b151a2a8786f6/deepspeed-0.16.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.7 2025-08-31T04:50:44,548 Found link https://files.pythonhosted.org/packages/e1/27/f857569546dc97f64169df1cc35d1ec5161766c4a0ec32f2af5d39614a51/deepspeed-0.16.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.8 2025-08-31T04:50:44,549 Found link https://files.pythonhosted.org/packages/4f/5c/7542904cddfaa50a9a7ae6770349d468773359f5af1718865452cea8729d/deepspeed-0.16.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.9 2025-08-31T04:50:44,550 Found link https://files.pythonhosted.org/packages/1e/35/eef570f4da4a39d0e7f2e72757295fdba3718a8eca60d8d6dcfeb9e6f26d/deepspeed-0.17.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.0 2025-08-31T04:50:44,551 Found link https://files.pythonhosted.org/packages/38/10/a7f63e086c1e1c12e290c98363c748ef5ddd6313fde739d2aeccd5ed0cd4/deepspeed-0.17.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.1 2025-08-31T04:50:44,552 Found link https://files.pythonhosted.org/packages/8c/45/1ddcf8f8500d90fad9f3396bfb1295462d46a747ddcbfafcd7714d46827e/deepspeed-0.17.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.2 2025-08-31T04:50:44,554 Found link https://files.pythonhosted.org/packages/9e/6b/89faa30a38405cd2d7a81790b262673ca4c8e8ec97c2f8c433da04d7a002/deepspeed-0.17.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.3 2025-08-31T04:50:44,555 Found link https://files.pythonhosted.org/packages/84/b3/02d000bfd0d6f0ba3f5dac487e4151b3e9b4b3ee71336882102dc9ad79ad/deepspeed-0.17.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.4 2025-08-31T04:50:44,556 Found link https://files.pythonhosted.org/packages/46/e7/bc1e5868d85cb8e21c43915023e462b9a147f739f26d8584e3c46771ec67/deepspeed-0.17.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.5 2025-08-31T04:50:44,558 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2025-08-31T04:50:44,559 Getting page https://www.piwheels.org/simple/deepspeed/ 2025-08-31T04:50:44,562 Found index url https://www.piwheels.org/simple/ 2025-08-31T04:50:44,748 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2025-08-31T04:50:44,763 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.17.3-py3-none-any.whl#sha256=3a1f3c5148ccffdb4f7b2663159aa9f4b400b1705731ae98b26ae9469875a138 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,764 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.17.2-py3-none-any.whl#sha256=009db2687461691ee6dd5edfc2ed43c0196c6413460b1975e27cba0386a9057e (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,765 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.1-py3-none-any.whl#sha256=317c4287d7bc03d677f5153dbc7225b5f6920c800dbbf1714eb61e2a5495b2b1 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,765 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.0-py3-none-any.whl#sha256=f7797218bb80761d1f3b1827d0ab50254edb3eeb189f8823bd9d02421c965acb (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,766 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.9-py3-none-any.whl#sha256=92e997f08ef2dfe72ce84292b8747f4dee177f80704f7a7191712a35da9cd095 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,766 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.8-py3-none-any.whl#sha256=a9a578ecf810f68bb8113342e3cfd5cfddaeadb101f9c1241dae35ed1078f6b3 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,767 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.7-py3-none-any.whl#sha256=390b2019766f00b87f17ec77236c987f6852ba1ee233be5b1a2a330f50fcf246 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,767 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.6-py3-none-any.whl#sha256=af190f747f3e6a5537f0bbfb35b97d076f3d15e240e1800404dd193133843e1d (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,768 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.5-py3-none-any.whl#sha256=b65b62a7d371ef56c8cd0c38c09ad930ab3a2441eb27d9e7636dfea16d4bf6fc (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,768 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.4-py3-none-any.whl#sha256=f7e7f46731a9413aa0993e9ee9416b6a9855dffe584e16f0bbd4194a018748b2 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,769 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.3-py3-none-any.whl#sha256=054c0fa6b98d59faf0968749e9d119504df57dd8334791a44ecb60427ea29b4a (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,769 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.2-py3-none-any.whl#sha256=6cabfff7c8a552345ac3b9fbcc500f4465315c7650be5b5f7e3009539cbabd73 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,770 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.1-py3-none-any.whl#sha256=45cadca45ee75892b02c00b75da09cd965b62e17a660bca28dcb1bcbc400fc7f (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,770 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.0-py3-none-any.whl#sha256=21568f469c01b32303030bf470a2d8bc65df4f428bf96f73c9d85be6b0b9fac4 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,771 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.4-py3-none-any.whl#sha256=d01cb59961fa1b3eb47d6b5035f4a925d418b537f005094898ad48678170a378 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,771 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.3-py3-none-any.whl#sha256=ac1d6ef48f043e3e1858cf241195baf309d54215928b0322ca299679e7794bc8 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,772 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.2-py3-none-any.whl#sha256=16ea51d88f40735af0a091c9c35469be928a90803f396d6fd6dc0ff8a49add7e (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,773 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.1-py3-none-any.whl#sha256=8bca1a074d792f19189c2b1b8b8c9962858ce647bc47f35bff3d87b5ee95a598 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,773 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.0-py3-none-any.whl#sha256=e2d59c9f87cb64d1319e530f7b1098888cd22efd72cbc53a63869967507e2cda (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,774 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.5-py3-none-any.whl#sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,774 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,775 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,775 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,776 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,776 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,776 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,777 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,777 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,778 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,779 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,779 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,780 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,780 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,781 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,781 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,782 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,783 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,783 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,784 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,784 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,784 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,785 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,785 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,786 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,786 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,787 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,787 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,788 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,788 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,789 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,789 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,790 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,790 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,791 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,791 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,791 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,792 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,793 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,793 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,794 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,794 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,795 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,795 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,796 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,796 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,797 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,797 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,798 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,798 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,799 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,799 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,800 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,800 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,801 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,801 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,802 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,802 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,803 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,803 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,804 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,805 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,805 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,805 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,806 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,806 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,807 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2025-08-31T04:50:44,808 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2025-08-31T04:50:44,808 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2025-08-31T04:50:44,837 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2025-08-31T04:50:44,839 Collecting deepspeed==0.17.4 2025-08-31T04:50:44,842 Created temporary directory: /tmp/pip-unpack-e6912_8v 2025-08-31T04:50:45,067 Downloading deepspeed-0.17.4.tar.gz (1.6 MB) 2025-08-31T04:50:47,745 Added deepspeed==0.17.4 from https://files.pythonhosted.org/packages/84/b3/02d000bfd0d6f0ba3f5dac487e4151b3e9b4b3ee71336882102dc9ad79ad/deepspeed-0.17.4.tar.gz to build tracker '/tmp/pip-build-tracker-wvik5ri8' 2025-08-31T04:50:47,747 Running setup.py (path:/tmp/pip-wheel-zmsqvqvk/deepspeed_23661a786d894101a51cd74c23447deb/setup.py) egg_info for package deepspeed 2025-08-31T04:50:47,748 Created temporary directory: /tmp/pip-pip-egg-info-yrl57yww 2025-08-31T04:50:47,748 Preparing metadata (setup.py): started 2025-08-31T04:50:47,750 Running command python setup.py egg_info 2025-08-31T04:50:48,729 fatal: not a git repository (or any of the parent directories): .git 2025-08-31T04:50:49,171 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2025-08-31T04:50:49,172  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2025-08-31T04:50:49,173 DS_BUILD_OPS=0 2025-08-31T04:50:49,173 Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False} 2025-08-31T04:50:49,174 version=0.17.4, git_hash=unknown, git_branch=unknown 2025-08-31T04:50:49,175 install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm'] 2025-08-31T04:50:49,175 ext_modules=[] 2025-08-31T04:50:49,176 running egg_info 2025-08-31T04:50:49,200 creating /tmp/pip-pip-egg-info-yrl57yww/deepspeed.egg-info 2025-08-31T04:50:49,201 writing /tmp/pip-pip-egg-info-yrl57yww/deepspeed.egg-info/PKG-INFO 2025-08-31T04:50:49,234 writing dependency_links to /tmp/pip-pip-egg-info-yrl57yww/deepspeed.egg-info/dependency_links.txt 2025-08-31T04:50:49,236 writing entry points to /tmp/pip-pip-egg-info-yrl57yww/deepspeed.egg-info/entry_points.txt 2025-08-31T04:50:49,254 writing requirements to /tmp/pip-pip-egg-info-yrl57yww/deepspeed.egg-info/requires.txt 2025-08-31T04:50:49,255 writing top-level names to /tmp/pip-pip-egg-info-yrl57yww/deepspeed.egg-info/top_level.txt 2025-08-31T04:50:49,256 writing manifest file '/tmp/pip-pip-egg-info-yrl57yww/deepspeed.egg-info/SOURCES.txt' 2025-08-31T04:50:49,510 reading manifest file '/tmp/pip-pip-egg-info-yrl57yww/deepspeed.egg-info/SOURCES.txt' 2025-08-31T04:50:49,511 reading manifest template 'MANIFEST.in' 2025-08-31T04:50:49,513 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2025-08-31T04:50:49,514 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2025-08-31T04:50:51,243 warning: no files found matching '*.hip' under directory 'deepspeed' 2025-08-31T04:50:52,290 warning: no files found matching '*.cc' under directory 'deepspeed' 2025-08-31T04:50:53,040 warning: no files found matching '*.tr' under directory 'csrc' 2025-08-31T04:50:53,176 warning: no files found matching '*.cc' under directory 'csrc' 2025-08-31T04:50:53,245 warning: no files found matching '*.py' under directory 'benchmarks' 2025-08-31T04:50:53,252 adding license file 'LICENSE' 2025-08-31T04:50:53,297 writing manifest file '/tmp/pip-pip-egg-info-yrl57yww/deepspeed.egg-info/SOURCES.txt' 2025-08-31T04:50:53,302 deepspeed build time = 4.569037437438965 secs 2025-08-31T04:50:53,422 Preparing metadata (setup.py): finished with status 'done' 2025-08-31T04:50:53,430 Source in /tmp/pip-wheel-zmsqvqvk/deepspeed_23661a786d894101a51cd74c23447deb has version 0.17.4, which satisfies requirement deepspeed==0.17.4 from https://files.pythonhosted.org/packages/84/b3/02d000bfd0d6f0ba3f5dac487e4151b3e9b4b3ee71336882102dc9ad79ad/deepspeed-0.17.4.tar.gz 2025-08-31T04:50:53,432 Removed deepspeed==0.17.4 from https://files.pythonhosted.org/packages/84/b3/02d000bfd0d6f0ba3f5dac487e4151b3e9b4b3ee71336882102dc9ad79ad/deepspeed-0.17.4.tar.gz from build tracker '/tmp/pip-build-tracker-wvik5ri8' 2025-08-31T04:50:53,508 Created temporary directory: /tmp/pip-unpack-u5bp4wq_ 2025-08-31T04:50:53,510 Created temporary directory: /tmp/pip-unpack-5djbbv4b 2025-08-31T04:50:53,510 Building wheels for collected packages: deepspeed 2025-08-31T04:50:53,514 Created temporary directory: /tmp/pip-wheel-duvj1gas 2025-08-31T04:50:53,515 DEPRECATION: Building 'deepspeed' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'deepspeed'. Discussion can be found at https://github.com/pypa/pip/issues/6334 2025-08-31T04:50:53,516 Building wheel for deepspeed (setup.py): started 2025-08-31T04:50:53,517 Destination directory: /tmp/pip-wheel-duvj1gas 2025-08-31T04:50:53,518 Running command python setup.py bdist_wheel 2025-08-31T04:50:54,000 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2025-08-31T04:50:54,003  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2025-08-31T04:50:54,130 DS_BUILD_OPS=0 2025-08-31T04:50:54,242 Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False} 2025-08-31T04:50:54,261 fatal: not a git repository (or any of the parent directories): .git 2025-08-31T04:50:54,262 version=0.17.4, git_hash=unknown, git_branch=unknown 2025-08-31T04:50:54,263 install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm'] 2025-08-31T04:50:54,264 ext_modules=[] 2025-08-31T04:50:54,647 running bdist_wheel 2025-08-31T04:50:54,775 running build 2025-08-31T04:50:54,776 running build_py 2025-08-31T04:50:54,805 creating build/lib/deepspeed 2025-08-31T04:50:54,806 copying deepspeed/env_report.py -> build/lib/deepspeed 2025-08-31T04:50:54,809 copying deepspeed/__init__.py -> build/lib/deepspeed 2025-08-31T04:50:54,811 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2025-08-31T04:50:54,813 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2025-08-31T04:50:54,815 copying deepspeed/constants.py -> build/lib/deepspeed 2025-08-31T04:50:54,817 creating build/lib/deepspeed/moe 2025-08-31T04:50:54,818 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2025-08-31T04:50:54,820 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2025-08-31T04:50:54,822 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2025-08-31T04:50:54,824 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2025-08-31T04:50:54,827 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2025-08-31T04:50:54,828 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2025-08-31T04:50:54,832 creating build/lib/deepspeed/sequence 2025-08-31T04:50:54,833 copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence 2025-08-31T04:50:54,835 copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence 2025-08-31T04:50:54,838 copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence 2025-08-31T04:50:54,839 copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence 2025-08-31T04:50:54,843 creating build/lib/deepspeed/accelerator 2025-08-31T04:50:54,844 copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator 2025-08-31T04:50:54,846 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2025-08-31T04:50:54,848 copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator 2025-08-31T04:50:54,850 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2025-08-31T04:50:54,852 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2025-08-31T04:50:54,855 copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator 2025-08-31T04:50:54,857 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2025-08-31T04:50:54,859 copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator 2025-08-31T04:50:54,862 copying deepspeed/accelerator/sdaa_accelerator.py -> build/lib/deepspeed/accelerator 2025-08-31T04:50:54,864 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2025-08-31T04:50:54,866 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2025-08-31T04:50:54,869 creating build/lib/deepspeed/utils 2025-08-31T04:50:54,870 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,873 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,875 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,877 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,879 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,882 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,884 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,886 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,888 copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,890 copying deepspeed/utils/config.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,892 copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,894 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,896 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,897 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,900 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,902 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,904 copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,906 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2025-08-31T04:50:54,910 creating build/lib/deepspeed/pipe 2025-08-31T04:50:54,911 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2025-08-31T04:50:54,913 creating build/lib/deepspeed/monitor 2025-08-31T04:50:54,914 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2025-08-31T04:50:54,916 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2025-08-31T04:50:54,918 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2025-08-31T04:50:54,920 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2025-08-31T04:50:54,922 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2025-08-31T04:50:54,924 copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor 2025-08-31T04:50:54,926 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2025-08-31T04:50:54,928 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2025-08-31T04:50:54,930 creating build/lib/deepspeed/elasticity 2025-08-31T04:50:54,931 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2025-08-31T04:50:54,934 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2025-08-31T04:50:54,935 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2025-08-31T04:50:54,937 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2025-08-31T04:50:54,939 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2025-08-31T04:50:54,942 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2025-08-31T04:50:54,945 creating build/lib/deepspeed/io 2025-08-31T04:50:54,946 copying deepspeed/io/fast_file_writer.py -> build/lib/deepspeed/io 2025-08-31T04:50:54,948 copying deepspeed/io/__init__.py -> build/lib/deepspeed/io 2025-08-31T04:50:54,950 copying deepspeed/io/single_io_buffer.py -> build/lib/deepspeed/io 2025-08-31T04:50:54,952 copying deepspeed/io/utils.py -> build/lib/deepspeed/io 2025-08-31T04:50:54,954 copying deepspeed/io/py_file_writer.py -> build/lib/deepspeed/io 2025-08-31T04:50:54,956 copying deepspeed/io/base_file_writer.py -> build/lib/deepspeed/io 2025-08-31T04:50:54,958 copying deepspeed/io/constants.py -> build/lib/deepspeed/io 2025-08-31T04:50:54,959 copying deepspeed/io/double_io_buffer.py -> build/lib/deepspeed/io 2025-08-31T04:50:54,961 copying deepspeed/io/base_io_buffer.py -> build/lib/deepspeed/io 2025-08-31T04:50:54,963 copying deepspeed/io/mock_file_writer.py -> build/lib/deepspeed/io 2025-08-31T04:50:54,966 creating build/lib/deepspeed/autotuning 2025-08-31T04:50:54,967 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2025-08-31T04:50:54,969 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2025-08-31T04:50:54,972 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2025-08-31T04:50:54,975 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2025-08-31T04:50:54,978 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2025-08-31T04:50:54,980 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2025-08-31T04:50:54,983 creating build/lib/deepspeed/launcher 2025-08-31T04:50:54,984 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2025-08-31T04:50:54,987 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2025-08-31T04:50:54,989 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2025-08-31T04:50:54,991 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2025-08-31T04:50:54,994 copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher 2025-08-31T04:50:54,996 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2025-08-31T04:50:54,998 creating build/lib/deepspeed/compression 2025-08-31T04:50:55,000 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2025-08-31T04:50:55,002 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2025-08-31T04:50:55,004 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2025-08-31T04:50:55,006 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2025-08-31T04:50:55,009 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2025-08-31T04:50:55,012 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2025-08-31T04:50:55,014 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2025-08-31T04:50:55,016 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2025-08-31T04:50:55,020 creating build/lib/deepspeed/nebula 2025-08-31T04:50:55,021 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2025-08-31T04:50:55,023 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2025-08-31T04:50:55,025 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2025-08-31T04:50:55,028 creating build/lib/deepspeed/profiling 2025-08-31T04:50:55,029 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2025-08-31T04:50:55,031 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2025-08-31T04:50:55,033 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2025-08-31T04:50:55,036 creating build/lib/deepspeed/runtime 2025-08-31T04:50:55,037 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,040 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,041 copying deepspeed/runtime/precision_config.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,043 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,045 copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,047 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,050 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,056 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,059 copying deepspeed/runtime/torch_autocast.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,061 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,063 copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,065 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,067 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,070 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,073 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,075 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,078 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,081 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,084 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,086 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2025-08-31T04:50:55,090 creating build/lib/deepspeed/compile 2025-08-31T04:50:55,091 copying deepspeed/compile/init_z1.py -> build/lib/deepspeed/compile 2025-08-31T04:50:55,093 copying deepspeed/compile/__init__.py -> build/lib/deepspeed/compile 2025-08-31T04:50:55,095 copying deepspeed/compile/util.py -> build/lib/deepspeed/compile 2025-08-31T04:50:55,097 copying deepspeed/compile/fx.py -> build/lib/deepspeed/compile 2025-08-31T04:50:55,099 copying deepspeed/compile/patch_fake_tensor.py -> build/lib/deepspeed/compile 2025-08-31T04:50:55,101 copying deepspeed/compile/init_z3.py -> build/lib/deepspeed/compile 2025-08-31T04:50:55,103 copying deepspeed/compile/partitioner.py -> build/lib/deepspeed/compile 2025-08-31T04:50:55,105 copying deepspeed/compile/input_storage.py -> build/lib/deepspeed/compile 2025-08-31T04:50:55,107 copying deepspeed/compile/config.py -> build/lib/deepspeed/compile 2025-08-31T04:50:55,109 copying deepspeed/compile/list_schedule.py -> build/lib/deepspeed/compile 2025-08-31T04:50:55,112 copying deepspeed/compile/backend.py -> build/lib/deepspeed/compile 2025-08-31T04:50:55,114 copying deepspeed/compile/graph_param.py -> build/lib/deepspeed/compile 2025-08-31T04:50:55,116 copying deepspeed/compile/patch_compiled_func.py -> build/lib/deepspeed/compile 2025-08-31T04:50:55,118 copying deepspeed/compile/inductor.py -> build/lib/deepspeed/compile 2025-08-31T04:50:55,121 creating build/lib/deepspeed/ops 2025-08-31T04:50:55,122 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2025-08-31T04:50:55,124 creating build/lib/deepspeed/comm 2025-08-31T04:50:55,125 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2025-08-31T04:50:55,127 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2025-08-31T04:50:55,129 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2025-08-31T04:50:55,131 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2025-08-31T04:50:55,134 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2025-08-31T04:50:55,136 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2025-08-31T04:50:55,138 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2025-08-31T04:50:55,140 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2025-08-31T04:50:55,142 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2025-08-31T04:50:55,145 creating build/lib/deepspeed/module_inject 2025-08-31T04:50:55,146 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2025-08-31T04:50:55,149 copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject 2025-08-31T04:50:55,151 copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject 2025-08-31T04:50:55,153 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2025-08-31T04:50:55,155 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2025-08-31T04:50:55,158 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2025-08-31T04:50:55,160 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2025-08-31T04:50:55,161 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2025-08-31T04:50:55,164 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2025-08-31T04:50:55,167 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2025-08-31T04:50:55,169 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2025-08-31T04:50:55,172 copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject 2025-08-31T04:50:55,173 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2025-08-31T04:50:55,176 creating build/lib/deepspeed/linear 2025-08-31T04:50:55,177 copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear 2025-08-31T04:50:55,179 copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear 2025-08-31T04:50:55,181 copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear 2025-08-31T04:50:55,183 copying deepspeed/linear/config.py -> build/lib/deepspeed/linear 2025-08-31T04:50:55,185 copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear 2025-08-31T04:50:55,187 creating build/lib/deepspeed/model_implementations 2025-08-31T04:50:55,188 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2025-08-31T04:50:55,190 creating build/lib/deepspeed/inference 2025-08-31T04:50:55,191 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2025-08-31T04:50:55,193 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2025-08-31T04:50:55,196 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2025-08-31T04:50:55,199 creating build/lib/deepspeed/nvme 2025-08-31T04:50:55,200 copying deepspeed/nvme/io_engine.py -> build/lib/deepspeed/nvme 2025-08-31T04:50:55,202 copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme 2025-08-31T04:50:55,204 copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme 2025-08-31T04:50:55,206 copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme 2025-08-31T04:50:55,208 copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme 2025-08-31T04:50:55,210 copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme 2025-08-31T04:50:55,212 copying deepspeed/nvme/torch_io.py -> build/lib/deepspeed/nvme 2025-08-31T04:50:55,214 copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme 2025-08-31T04:50:55,216 copying deepspeed/nvme/ds_aio_constants.py -> build/lib/deepspeed/nvme 2025-08-31T04:50:55,218 copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme 2025-08-31T04:50:55,220 copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme 2025-08-31T04:50:55,222 copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme 2025-08-31T04:50:55,223 copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme 2025-08-31T04:50:55,225 copying deepspeed/nvme/torch_fastio_engine.py -> build/lib/deepspeed/nvme 2025-08-31T04:50:55,227 copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme 2025-08-31T04:50:55,229 copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme 2025-08-31T04:50:55,232 creating build/lib/deepspeed/checkpoint 2025-08-31T04:50:55,233 copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint 2025-08-31T04:50:55,236 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2025-08-31T04:50:55,237 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2025-08-31T04:50:55,239 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2025-08-31T04:50:55,241 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2025-08-31T04:50:55,244 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2025-08-31T04:50:55,246 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2025-08-31T04:50:55,248 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2025-08-31T04:50:55,250 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2025-08-31T04:50:55,253 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2025-08-31T04:50:55,256 creating build/lib/deepspeed/autotuning/tuner 2025-08-31T04:50:55,257 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2025-08-31T04:50:55,259 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2025-08-31T04:50:55,260 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2025-08-31T04:50:55,262 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2025-08-31T04:50:55,264 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2025-08-31T04:50:55,266 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2025-08-31T04:50:55,269 creating build/lib/deepspeed/profiling/flops_profiler 2025-08-31T04:50:55,270 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2025-08-31T04:50:55,271 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2025-08-31T04:50:55,275 creating build/lib/deepspeed/runtime/sequence_parallel 2025-08-31T04:50:55,276 copying deepspeed/runtime/sequence_parallel/__init__.py -> build/lib/deepspeed/runtime/sequence_parallel 2025-08-31T04:50:55,278 copying deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/lib/deepspeed/runtime/sequence_parallel 2025-08-31T04:50:55,281 copying deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/lib/deepspeed/runtime/sequence_parallel 2025-08-31T04:50:55,284 creating build/lib/deepspeed/runtime/model_checkpointing 2025-08-31T04:50:55,285 copying deepspeed/runtime/model_checkpointing/__init__.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-08-31T04:50:55,287 copying deepspeed/runtime/model_checkpointing/writer_factory.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-08-31T04:50:55,289 copying deepspeed/runtime/model_checkpointing/utils.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-08-31T04:50:55,291 copying deepspeed/runtime/model_checkpointing/config.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-08-31T04:50:55,294 copying deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-08-31T04:50:55,296 copying deepspeed/runtime/model_checkpointing/constants.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-08-31T04:50:55,299 creating build/lib/deepspeed/runtime/pipe 2025-08-31T04:50:55,300 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2025-08-31T04:50:55,302 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2025-08-31T04:50:55,305 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2025-08-31T04:50:55,308 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2025-08-31T04:50:55,311 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2025-08-31T04:50:55,313 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2025-08-31T04:50:55,316 creating build/lib/deepspeed/runtime/data_pipeline 2025-08-31T04:50:55,317 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2025-08-31T04:50:55,320 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2025-08-31T04:50:55,322 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2025-08-31T04:50:55,324 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2025-08-31T04:50:55,327 creating build/lib/deepspeed/runtime/activation_checkpointing 2025-08-31T04:50:55,328 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2025-08-31T04:50:55,330 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2025-08-31T04:50:55,332 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2025-08-31T04:50:55,336 creating build/lib/deepspeed/runtime/checkpoint_engine 2025-08-31T04:50:55,336 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-08-31T04:50:55,338 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-08-31T04:50:55,340 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-08-31T04:50:55,343 copying deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-08-31T04:50:55,345 copying deepspeed/runtime/checkpoint_engine/utils.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-08-31T04:50:55,347 copying deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-08-31T04:50:55,349 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-08-31T04:50:55,351 creating build/lib/deepspeed/runtime/tensor_parallel 2025-08-31T04:50:55,352 copying deepspeed/runtime/tensor_parallel/__init__.py -> build/lib/deepspeed/runtime/tensor_parallel 2025-08-31T04:50:55,354 copying deepspeed/runtime/tensor_parallel/config.py -> build/lib/deepspeed/runtime/tensor_parallel 2025-08-31T04:50:55,356 copying deepspeed/runtime/tensor_parallel/tp_manager.py -> build/lib/deepspeed/runtime/tensor_parallel 2025-08-31T04:50:55,359 creating build/lib/deepspeed/runtime/compression 2025-08-31T04:50:55,360 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2025-08-31T04:50:55,362 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2025-08-31T04:50:55,365 creating build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,366 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,369 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,371 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,374 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,379 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,382 copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,383 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,386 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,390 copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,393 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,397 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,399 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,402 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,405 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,408 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,411 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,414 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2025-08-31T04:50:55,417 creating build/lib/deepspeed/runtime/domino 2025-08-31T04:50:55,418 copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino 2025-08-31T04:50:55,421 copying deepspeed/runtime/domino/async_linear.py -> build/lib/deepspeed/runtime/domino 2025-08-31T04:50:55,424 copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino 2025-08-31T04:50:55,427 creating build/lib/deepspeed/runtime/comm 2025-08-31T04:50:55,429 copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm 2025-08-31T04:50:55,431 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2025-08-31T04:50:55,434 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2025-08-31T04:50:55,437 copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm 2025-08-31T04:50:55,439 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2025-08-31T04:50:55,442 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2025-08-31T04:50:55,446 creating build/lib/deepspeed/runtime/swap_tensor 2025-08-31T04:50:55,447 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2025-08-31T04:50:55,450 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2025-08-31T04:50:55,452 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2025-08-31T04:50:55,455 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-08-31T04:50:55,457 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2025-08-31T04:50:55,460 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-08-31T04:50:55,463 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-08-31T04:50:55,466 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2025-08-31T04:50:55,468 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-08-31T04:50:55,471 creating build/lib/deepspeed/runtime/fp16 2025-08-31T04:50:55,473 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2025-08-31T04:50:55,475 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2025-08-31T04:50:55,478 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2025-08-31T04:50:55,481 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2025-08-31T04:50:55,485 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-08-31T04:50:55,486 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-08-31T04:50:55,490 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-08-31T04:50:55,492 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-08-31T04:50:55,496 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-08-31T04:50:55,498 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-08-31T04:50:55,501 copying deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-08-31T04:50:55,505 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-08-31T04:50:55,506 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-08-31T04:50:55,508 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-08-31T04:50:55,511 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-08-31T04:50:55,514 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-08-31T04:50:55,516 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-08-31T04:50:55,519 creating build/lib/deepspeed/runtime/fp16/onebit 2025-08-31T04:50:55,520 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-08-31T04:50:55,523 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-08-31T04:50:55,526 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-08-31T04:50:55,529 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-08-31T04:50:55,532 creating build/lib/deepspeed/compile/passes 2025-08-31T04:50:55,534 copying deepspeed/compile/passes/__init__.py -> build/lib/deepspeed/compile/passes 2025-08-31T04:50:55,536 copying deepspeed/compile/passes/selective_gather.py -> build/lib/deepspeed/compile/passes 2025-08-31T04:50:55,538 copying deepspeed/compile/passes/prefetch.py -> build/lib/deepspeed/compile/passes 2025-08-31T04:50:55,541 copying deepspeed/compile/passes/zero1_compile.py -> build/lib/deepspeed/compile/passes 2025-08-31T04:50:55,543 copying deepspeed/compile/passes/offload_activation.py -> build/lib/deepspeed/compile/passes 2025-08-31T04:50:55,546 copying deepspeed/compile/passes/offload_parameters.py -> build/lib/deepspeed/compile/passes 2025-08-31T04:50:55,548 copying deepspeed/compile/passes/zero3_compile.py -> build/lib/deepspeed/compile/passes 2025-08-31T04:50:55,551 copying deepspeed/compile/passes/offload_adam_states.py -> build/lib/deepspeed/compile/passes 2025-08-31T04:50:55,555 creating build/lib/deepspeed/compile/profilers 2025-08-31T04:50:55,556 copying deepspeed/compile/profilers/__init__.py -> build/lib/deepspeed/compile/profilers 2025-08-31T04:50:55,558 copying deepspeed/compile/profilers/comm_profile.py -> build/lib/deepspeed/compile/profilers 2025-08-31T04:50:55,561 copying deepspeed/compile/profilers/graph_profile.py -> build/lib/deepspeed/compile/profilers 2025-08-31T04:50:55,564 creating build/lib/deepspeed/ops/deepspeed4science 2025-08-31T04:50:55,566 copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science 2025-08-31T04:50:55,568 copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science 2025-08-31T04:50:55,571 creating build/lib/deepspeed/ops/sparse_attention 2025-08-31T04:50:55,573 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2025-08-31T04:50:55,576 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2025-08-31T04:50:55,578 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2025-08-31T04:50:55,581 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2025-08-31T04:50:55,584 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2025-08-31T04:50:55,587 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2025-08-31T04:50:55,590 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2025-08-31T04:50:55,593 creating build/lib/deepspeed/ops/random_ltd 2025-08-31T04:50:55,594 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2025-08-31T04:50:55,596 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2025-08-31T04:50:55,600 creating build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,602 copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,604 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,606 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,609 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,612 copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,614 copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,617 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,619 copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,621 copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,624 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,626 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,628 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,631 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,633 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,635 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,637 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,640 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,642 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,645 copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,647 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,650 copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,652 copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,654 copying deepspeed/ops/op_builder/dc.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,656 copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,658 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,660 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2025-08-31T04:50:55,662 creating build/lib/deepspeed/ops/adam 2025-08-31T04:50:55,663 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2025-08-31T04:50:55,665 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2025-08-31T04:50:55,667 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2025-08-31T04:50:55,670 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2025-08-31T04:50:55,673 creating build/lib/deepspeed/ops/aio 2025-08-31T04:50:55,674 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2025-08-31T04:50:55,676 creating build/lib/deepspeed/ops/fp_quantizer 2025-08-31T04:50:55,678 copying deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/lib/deepspeed/ops/fp_quantizer 2025-08-31T04:50:55,680 copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer 2025-08-31T04:50:55,682 copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer 2025-08-31T04:50:55,684 copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer 2025-08-31T04:50:55,687 creating build/lib/deepspeed/ops/lamb 2025-08-31T04:50:55,688 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2025-08-31T04:50:55,690 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2025-08-31T04:50:55,692 creating build/lib/deepspeed/ops/transformer 2025-08-31T04:50:55,693 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2025-08-31T04:50:55,695 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2025-08-31T04:50:55,698 creating build/lib/deepspeed/ops/lion 2025-08-31T04:50:55,699 copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion 2025-08-31T04:50:55,702 copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion 2025-08-31T04:50:55,704 copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion 2025-08-31T04:50:55,705 copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion 2025-08-31T04:50:55,708 creating build/lib/deepspeed/ops/compile 2025-08-31T04:50:55,709 copying deepspeed/ops/compile/__init__.py -> build/lib/deepspeed/ops/compile 2025-08-31T04:50:55,711 creating build/lib/deepspeed/ops/gds 2025-08-31T04:50:55,712 copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds 2025-08-31T04:50:55,715 creating build/lib/deepspeed/ops/quantizer 2025-08-31T04:50:55,716 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2025-08-31T04:50:55,718 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2025-08-31T04:50:55,720 creating build/lib/deepspeed/ops/adagrad 2025-08-31T04:50:55,721 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2025-08-31T04:50:55,723 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2025-08-31T04:50:55,726 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2025-08-31T04:50:55,727 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-08-31T04:50:55,729 creating build/lib/deepspeed/ops/op_builder/npu 2025-08-31T04:50:55,730 copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu 2025-08-31T04:50:55,732 copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu 2025-08-31T04:50:55,734 copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu 2025-08-31T04:50:55,736 copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu 2025-08-31T04:50:55,738 copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu 2025-08-31T04:50:55,740 copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu 2025-08-31T04:50:55,742 copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2025-08-31T04:50:55,744 copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2025-08-31T04:50:55,746 copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu 2025-08-31T04:50:55,749 creating build/lib/deepspeed/ops/op_builder/mlu 2025-08-31T04:50:55,750 copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-08-31T04:50:55,752 copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-08-31T04:50:55,754 copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-08-31T04:50:55,756 copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-08-31T04:50:55,758 copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-08-31T04:50:55,760 copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-08-31T04:50:55,763 creating build/lib/deepspeed/ops/op_builder/sdaa 2025-08-31T04:50:55,764 copying deepspeed/ops/op_builder/sdaa/builder.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-08-31T04:50:55,766 copying deepspeed/ops/op_builder/sdaa/__init__.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-08-31T04:50:55,768 copying deepspeed/ops/op_builder/sdaa/no_impl.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-08-31T04:50:55,770 copying deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-08-31T04:50:55,772 copying deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-08-31T04:50:55,774 creating build/lib/deepspeed/ops/op_builder/xpu 2025-08-31T04:50:55,775 copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-08-31T04:50:55,777 copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-08-31T04:50:55,780 copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-08-31T04:50:55,782 copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-08-31T04:50:55,783 copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-08-31T04:50:55,785 copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-08-31T04:50:55,787 copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-08-31T04:50:55,789 copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-08-31T04:50:55,791 copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-08-31T04:50:55,793 copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-08-31T04:50:55,796 creating build/lib/deepspeed/ops/op_builder/cpu 2025-08-31T04:50:55,798 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-08-31T04:50:55,800 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-08-31T04:50:55,803 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-08-31T04:50:55,805 copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-08-31T04:50:55,808 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-08-31T04:50:55,810 copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-08-31T04:50:55,813 copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-08-31T04:50:55,816 creating build/lib/deepspeed/ops/op_builder/hpu 2025-08-31T04:50:55,817 copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-08-31T04:50:55,820 copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-08-31T04:50:55,823 copying deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-08-31T04:50:55,825 copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-08-31T04:50:55,827 copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-08-31T04:50:55,830 copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-08-31T04:50:55,832 copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-08-31T04:50:55,836 creating build/lib/deepspeed/ops/transformer/inference 2025-08-31T04:50:55,837 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2025-08-31T04:50:55,840 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2025-08-31T04:50:55,843 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2025-08-31T04:50:55,845 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2025-08-31T04:50:55,848 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2025-08-31T04:50:55,850 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2025-08-31T04:50:55,853 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2025-08-31T04:50:55,856 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2025-08-31T04:50:55,859 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2025-08-31T04:50:55,861 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2025-08-31T04:50:55,866 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,867 copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,869 copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,872 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,874 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,876 copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,879 copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,881 copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,884 copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,886 copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,889 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,891 copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,894 copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,896 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,898 copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,900 copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,901 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,904 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,906 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,908 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,910 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,912 copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,914 copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,916 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:50:55,918 creating build/lib/deepspeed/ops/transformer/inference/triton 2025-08-31T04:50:55,919 copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-08-31T04:50:55,921 copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-08-31T04:50:55,923 copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-08-31T04:50:55,926 copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-08-31T04:50:55,928 copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-08-31T04:50:55,930 copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-08-31T04:50:55,932 copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-08-31T04:50:55,934 copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-08-31T04:50:55,936 copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-08-31T04:50:55,939 copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-08-31T04:50:55,941 creating build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,943 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,945 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,947 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,949 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,951 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,953 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,956 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,958 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,960 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,962 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,964 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,967 copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,970 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,972 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,975 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,977 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,979 copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,982 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,984 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2025-08-31T04:50:55,986 creating build/lib/deepspeed/module_inject/containers/features 2025-08-31T04:50:55,987 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2025-08-31T04:50:55,990 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2025-08-31T04:50:55,991 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2025-08-31T04:50:55,994 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2025-08-31T04:50:55,996 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2025-08-31T04:50:55,998 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2025-08-31T04:50:55,999 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2025-08-31T04:50:56,003 creating build/lib/deepspeed/model_implementations/transformers 2025-08-31T04:50:56,004 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2025-08-31T04:50:56,006 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2025-08-31T04:50:56,008 copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers 2025-08-31T04:50:56,010 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2025-08-31T04:50:56,012 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2025-08-31T04:50:56,014 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2025-08-31T04:50:56,016 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2025-08-31T04:50:56,018 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2025-08-31T04:50:56,020 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2025-08-31T04:50:56,022 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2025-08-31T04:50:56,024 creating build/lib/deepspeed/model_implementations/diffusers 2025-08-31T04:50:56,025 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2025-08-31T04:50:56,027 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2025-08-31T04:50:56,029 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2025-08-31T04:50:56,032 creating build/lib/deepspeed/model_implementations/features 2025-08-31T04:50:56,033 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2025-08-31T04:50:56,035 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2025-08-31T04:50:56,037 creating build/lib/deepspeed/inference/v2 2025-08-31T04:50:56,038 copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2 2025-08-31T04:50:56,040 copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2 2025-08-31T04:50:56,042 copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2 2025-08-31T04:50:56,044 copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2 2025-08-31T04:50:56,047 copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2 2025-08-31T04:50:56,049 copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2 2025-08-31T04:50:56,050 copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2 2025-08-31T04:50:56,053 copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2 2025-08-31T04:50:56,054 copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2 2025-08-31T04:50:56,057 creating build/lib/deepspeed/inference/quantization 2025-08-31T04:50:56,058 copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization 2025-08-31T04:50:56,060 copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization 2025-08-31T04:50:56,062 copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization 2025-08-31T04:50:56,064 copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization 2025-08-31T04:50:56,067 copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization 2025-08-31T04:50:56,069 creating build/lib/deepspeed/inference/v2/ragged 2025-08-31T04:50:56,070 copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged 2025-08-31T04:50:56,073 copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged 2025-08-31T04:50:56,075 copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged 2025-08-31T04:50:56,078 copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged 2025-08-31T04:50:56,080 copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged 2025-08-31T04:50:56,083 copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged 2025-08-31T04:50:56,085 copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged 2025-08-31T04:50:56,088 creating build/lib/deepspeed/inference/v2/model_implementations 2025-08-31T04:50:56,089 copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-08-31T04:50:56,092 copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-08-31T04:50:56,094 copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-08-31T04:50:56,096 copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-08-31T04:50:56,099 copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-08-31T04:50:56,101 copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-08-31T04:50:56,104 copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-08-31T04:50:56,107 creating build/lib/deepspeed/inference/v2/modules 2025-08-31T04:50:56,109 copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules 2025-08-31T04:50:56,111 copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules 2025-08-31T04:50:56,114 copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules 2025-08-31T04:50:56,116 copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules 2025-08-31T04:50:56,119 creating build/lib/deepspeed/inference/v2/checkpoint 2025-08-31T04:50:56,120 copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-08-31T04:50:56,122 copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-08-31T04:50:56,124 copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-08-31T04:50:56,126 copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-08-31T04:50:56,129 creating build/lib/deepspeed/inference/v2/kernels 2025-08-31T04:50:56,129 copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels 2025-08-31T04:50:56,132 copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels 2025-08-31T04:50:56,134 creating build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-08-31T04:50:56,135 copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-08-31T04:50:56,137 copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-08-31T04:50:56,140 copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-08-31T04:50:56,142 copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-08-31T04:50:56,144 creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-08-31T04:50:56,145 copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-08-31T04:50:56,147 copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-08-31T04:50:56,149 copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-08-31T04:50:56,152 copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-08-31T04:50:56,155 creating build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-08-31T04:50:56,157 copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-08-31T04:50:56,159 copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-08-31T04:50:56,161 copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-08-31T04:50:56,164 copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-08-31T04:50:56,166 creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:50:56,167 copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:50:56,169 copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:50:56,171 copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:50:56,174 copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:50:56,176 copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:50:56,179 copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:50:56,181 copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:50:56,183 copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:50:56,186 copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:50:56,189 creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-08-31T04:50:56,190 copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-08-31T04:50:56,193 copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-08-31T04:50:56,195 copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-08-31T04:50:56,198 copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-08-31T04:50:56,200 creating build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-08-31T04:50:56,202 copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-08-31T04:50:56,204 copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-08-31T04:50:56,206 copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-08-31T04:50:56,208 copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-08-31T04:50:56,211 creating build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-08-31T04:50:56,212 copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-08-31T04:50:56,215 copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-08-31T04:50:56,216 copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-08-31T04:50:56,219 copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-08-31T04:50:56,221 creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-08-31T04:50:56,223 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-08-31T04:50:56,225 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-08-31T04:50:56,227 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-08-31T04:50:56,229 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-08-31T04:50:56,232 creating build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:50:56,233 copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:50:56,235 copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:50:56,237 copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:50:56,239 copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:50:56,241 copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:50:56,243 copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:50:56,245 copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:50:56,247 copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:50:56,249 copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:50:56,252 creating build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-08-31T04:50:56,253 copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-08-31T04:50:56,255 copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-08-31T04:50:56,257 copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-08-31T04:50:56,259 copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-08-31T04:50:56,262 creating build/lib/deepspeed/inference/v2/model_implementations/phi 2025-08-31T04:50:56,263 copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-08-31T04:50:56,265 copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-08-31T04:50:56,267 copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-08-31T04:50:56,269 copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-08-31T04:50:56,272 creating build/lib/deepspeed/inference/v2/model_implementations/opt 2025-08-31T04:50:56,273 copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-08-31T04:50:56,275 copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-08-31T04:50:56,277 copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-08-31T04:50:56,279 copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-08-31T04:50:56,282 creating build/lib/deepspeed/inference/v2/modules/configs 2025-08-31T04:50:56,283 copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-08-31T04:50:56,285 copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-08-31T04:50:56,287 copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-08-31T04:50:56,289 copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-08-31T04:50:56,291 copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-08-31T04:50:56,293 copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-08-31T04:50:56,294 copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-08-31T04:50:56,297 creating build/lib/deepspeed/inference/v2/modules/interfaces 2025-08-31T04:50:56,298 copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-08-31T04:50:56,300 copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-08-31T04:50:56,302 copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-08-31T04:50:56,304 copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-08-31T04:50:56,306 copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-08-31T04:50:56,308 copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-08-31T04:50:56,310 copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-08-31T04:50:56,312 copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-08-31T04:50:56,314 creating build/lib/deepspeed/inference/v2/modules/implementations 2025-08-31T04:50:56,315 copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations 2025-08-31T04:50:56,317 creating build/lib/deepspeed/inference/v2/modules/implementations/moe 2025-08-31T04:50:56,318 copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2025-08-31T04:50:56,320 copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2025-08-31T04:50:56,323 creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2025-08-31T04:50:56,324 copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2025-08-31T04:50:56,326 copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2025-08-31T04:50:56,329 creating build/lib/deepspeed/inference/v2/modules/implementations/attention 2025-08-31T04:50:56,330 copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2025-08-31T04:50:56,332 copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2025-08-31T04:50:56,334 creating build/lib/deepspeed/inference/v2/modules/implementations/unembed 2025-08-31T04:50:56,335 copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2025-08-31T04:50:56,337 copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2025-08-31T04:50:56,340 creating build/lib/deepspeed/inference/v2/modules/implementations/embedding 2025-08-31T04:50:56,341 copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2025-08-31T04:50:56,343 copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2025-08-31T04:50:56,345 creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-08-31T04:50:56,346 copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-08-31T04:50:56,348 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-08-31T04:50:56,350 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-08-31T04:50:56,353 creating build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-08-31T04:50:56,353 copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-08-31T04:50:56,355 copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-08-31T04:50:56,357 copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-08-31T04:50:56,360 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops 2025-08-31T04:50:56,361 copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2025-08-31T04:50:56,364 creating build/lib/deepspeed/inference/v2/kernels/core_ops 2025-08-31T04:50:56,364 copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops 2025-08-31T04:50:56,367 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2025-08-31T04:50:56,368 copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2025-08-31T04:50:56,370 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-08-31T04:50:56,371 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-08-31T04:50:56,373 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-08-31T04:50:56,375 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-08-31T04:50:56,376 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-08-31T04:50:56,378 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-08-31T04:50:56,381 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:50:56,382 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:50:56,384 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:50:56,386 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:50:56,388 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:50:56,391 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-08-31T04:50:56,391 copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-08-31T04:50:56,394 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-08-31T04:50:56,396 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-08-31T04:50:56,397 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-08-31T04:50:56,399 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-08-31T04:50:56,401 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-08-31T04:50:56,403 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-08-31T04:50:56,405 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-08-31T04:50:56,407 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-08-31T04:50:56,408 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-08-31T04:50:56,410 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-08-31T04:50:56,412 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-08-31T04:50:56,413 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-08-31T04:50:56,415 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-08-31T04:50:56,418 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:50:56,419 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:50:56,421 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:50:56,423 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:50:56,425 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:50:56,427 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:50:56,429 creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-08-31T04:50:56,430 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-08-31T04:50:56,432 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-08-31T04:50:56,434 creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-08-31T04:50:56,435 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-08-31T04:50:56,438 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-08-31T04:50:56,440 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-08-31T04:50:56,441 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-08-31T04:50:56,443 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-08-31T04:50:56,446 creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-08-31T04:50:56,447 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-08-31T04:50:56,449 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-08-31T04:50:56,451 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-08-31T04:50:56,452 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-08-31T04:50:56,454 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-08-31T04:50:56,456 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-08-31T04:50:56,458 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-08-31T04:50:56,460 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-08-31T04:50:56,461 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-08-31T04:50:56,463 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-08-31T04:50:56,465 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-08-31T04:50:56,467 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-08-31T04:50:56,468 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-08-31T04:50:56,470 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-08-31T04:50:56,473 running egg_info 2025-08-31T04:50:56,513 writing deepspeed.egg-info/PKG-INFO 2025-08-31T04:50:56,547 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2025-08-31T04:50:56,549 writing entry points to deepspeed.egg-info/entry_points.txt 2025-08-31T04:50:56,567 writing requirements to deepspeed.egg-info/requires.txt 2025-08-31T04:50:56,568 writing top-level names to deepspeed.egg-info/top_level.txt 2025-08-31T04:50:56,701 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2025-08-31T04:50:56,790 reading manifest template 'MANIFEST.in' 2025-08-31T04:50:56,792 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2025-08-31T04:50:56,792 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2025-08-31T04:50:58,498 warning: no files found matching '*.hip' under directory 'deepspeed' 2025-08-31T04:50:59,526 warning: no files found matching '*.cc' under directory 'deepspeed' 2025-08-31T04:51:00,195 warning: no files found matching '*.tr' under directory 'csrc' 2025-08-31T04:51:00,321 warning: no files found matching '*.cc' under directory 'csrc' 2025-08-31T04:51:00,368 warning: no files found matching '*.py' under directory 'benchmarks' 2025-08-31T04:51:00,374 adding license file 'LICENSE' 2025-08-31T04:51:00,428 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2025-08-31T04:51:00,437 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2025-08-31T04:51:00,437 !! 2025-08-31T04:51:00,438 ******************************************************************************** 2025-08-31T04:51:00,439 ############################ 2025-08-31T04:51:00,439 # Package would be ignored # 2025-08-31T04:51:00,440 ############################ 2025-08-31T04:51:00,440 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2025-08-31T04:51:00,440 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,441 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,442 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2025-08-31T04:51:00,442 to the `packages` configuration field. 2025-08-31T04:51:00,443 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,444 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,444 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,445 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,446 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,447 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2025-08-31T04:51:00,448 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2025-08-31T04:51:00,449 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,449 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,450 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,451 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,452 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,455 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,455 even if it does not contain any `.py` files. 2025-08-31T04:51:00,456 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,456 directory, all directories are treated like packages. 2025-08-31T04:51:00,457 ******************************************************************************** 2025-08-31T04:51:00,458 !! 2025-08-31T04:51:00,458 check.warn(importable) 2025-08-31T04:51:00,459 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration. 2025-08-31T04:51:00,459 !! 2025-08-31T04:51:00,460 ******************************************************************************** 2025-08-31T04:51:00,461 ############################ 2025-08-31T04:51:00,461 # Package would be ignored # 2025-08-31T04:51:00,462 ############################ 2025-08-31T04:51:00,463 Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1], 2025-08-31T04:51:00,463 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,464 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,465 package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added 2025-08-31T04:51:00,465 to the `packages` configuration field. 2025-08-31T04:51:00,466 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,467 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,467 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,468 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,468 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,469 If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are 2025-08-31T04:51:00,469 already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via 2025-08-31T04:51:00,470 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,470 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,470 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,471 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,472 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,473 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,473 even if it does not contain any `.py` files. 2025-08-31T04:51:00,474 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,474 directory, all directories are treated like packages. 2025-08-31T04:51:00,475 ******************************************************************************** 2025-08-31T04:51:00,476 !! 2025-08-31T04:51:00,476 check.warn(importable) 2025-08-31T04:51:00,477 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration. 2025-08-31T04:51:00,477 !! 2025-08-31T04:51:00,478 ******************************************************************************** 2025-08-31T04:51:00,479 ############################ 2025-08-31T04:51:00,479 # Package would be ignored # 2025-08-31T04:51:00,480 ############################ 2025-08-31T04:51:00,481 Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1], 2025-08-31T04:51:00,481 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,482 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,483 package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added 2025-08-31T04:51:00,483 to the `packages` configuration field. 2025-08-31T04:51:00,484 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,484 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,485 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,486 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,487 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,488 If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are 2025-08-31T04:51:00,488 already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via 2025-08-31T04:51:00,489 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,489 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,490 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,491 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,491 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,492 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,493 even if it does not contain any `.py` files. 2025-08-31T04:51:00,493 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,493 directory, all directories are treated like packages. 2025-08-31T04:51:00,494 ******************************************************************************** 2025-08-31T04:51:00,494 !! 2025-08-31T04:51:00,495 check.warn(importable) 2025-08-31T04:51:00,495 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration. 2025-08-31T04:51:00,495 !! 2025-08-31T04:51:00,496 ******************************************************************************** 2025-08-31T04:51:00,496 ############################ 2025-08-31T04:51:00,497 # Package would be ignored # 2025-08-31T04:51:00,497 ############################ 2025-08-31T04:51:00,497 Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1], 2025-08-31T04:51:00,498 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,499 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,499 package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added 2025-08-31T04:51:00,500 to the `packages` configuration field. 2025-08-31T04:51:00,501 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,501 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,502 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,503 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,504 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,505 If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are 2025-08-31T04:51:00,506 already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via 2025-08-31T04:51:00,506 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,507 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,507 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,508 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,509 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,510 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,511 even if it does not contain any `.py` files. 2025-08-31T04:51:00,511 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,512 directory, all directories are treated like packages. 2025-08-31T04:51:00,512 ******************************************************************************** 2025-08-31T04:51:00,514 !! 2025-08-31T04:51:00,514 check.warn(importable) 2025-08-31T04:51:00,515 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration. 2025-08-31T04:51:00,515 !! 2025-08-31T04:51:00,516 ******************************************************************************** 2025-08-31T04:51:00,517 ############################ 2025-08-31T04:51:00,517 # Package would be ignored # 2025-08-31T04:51:00,517 ############################ 2025-08-31T04:51:00,518 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1], 2025-08-31T04:51:00,518 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,519 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,519 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added 2025-08-31T04:51:00,519 to the `packages` configuration field. 2025-08-31T04:51:00,520 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,521 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,521 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,522 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,522 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,523 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are 2025-08-31T04:51:00,524 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via 2025-08-31T04:51:00,524 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,524 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,525 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,526 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,527 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,529 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,530 even if it does not contain any `.py` files. 2025-08-31T04:51:00,530 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,531 directory, all directories are treated like packages. 2025-08-31T04:51:00,531 ******************************************************************************** 2025-08-31T04:51:00,532 !! 2025-08-31T04:51:00,533 check.warn(importable) 2025-08-31T04:51:00,533 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration. 2025-08-31T04:51:00,534 !! 2025-08-31T04:51:00,535 ******************************************************************************** 2025-08-31T04:51:00,535 ############################ 2025-08-31T04:51:00,536 # Package would be ignored # 2025-08-31T04:51:00,536 ############################ 2025-08-31T04:51:00,537 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1], 2025-08-31T04:51:00,537 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,538 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,539 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added 2025-08-31T04:51:00,539 to the `packages` configuration field. 2025-08-31T04:51:00,540 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,541 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,541 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,542 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,542 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,543 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are 2025-08-31T04:51:00,543 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via 2025-08-31T04:51:00,544 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,544 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,544 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,545 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,546 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,547 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,547 even if it does not contain any `.py` files. 2025-08-31T04:51:00,547 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,548 directory, all directories are treated like packages. 2025-08-31T04:51:00,548 ******************************************************************************** 2025-08-31T04:51:00,549 !! 2025-08-31T04:51:00,549 check.warn(importable) 2025-08-31T04:51:00,550 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration. 2025-08-31T04:51:00,550 !! 2025-08-31T04:51:00,551 ******************************************************************************** 2025-08-31T04:51:00,552 ############################ 2025-08-31T04:51:00,552 # Package would be ignored # 2025-08-31T04:51:00,553 ############################ 2025-08-31T04:51:00,553 Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1], 2025-08-31T04:51:00,554 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,555 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,555 package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added 2025-08-31T04:51:00,556 to the `packages` configuration field. 2025-08-31T04:51:00,557 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,557 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,558 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,559 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,560 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,560 If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are 2025-08-31T04:51:00,561 already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via 2025-08-31T04:51:00,561 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,562 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,562 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,564 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,565 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,566 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,567 even if it does not contain any `.py` files. 2025-08-31T04:51:00,567 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,567 directory, all directories are treated like packages. 2025-08-31T04:51:00,568 ******************************************************************************** 2025-08-31T04:51:00,568 !! 2025-08-31T04:51:00,569 check.warn(importable) 2025-08-31T04:51:00,569 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration. 2025-08-31T04:51:00,569 !! 2025-08-31T04:51:00,570 ******************************************************************************** 2025-08-31T04:51:00,570 ############################ 2025-08-31T04:51:00,571 # Package would be ignored # 2025-08-31T04:51:00,571 ############################ 2025-08-31T04:51:00,571 Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1], 2025-08-31T04:51:00,572 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,572 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,573 package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added 2025-08-31T04:51:00,573 to the `packages` configuration field. 2025-08-31T04:51:00,574 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,574 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,575 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,576 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,577 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,578 If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are 2025-08-31T04:51:00,578 already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via 2025-08-31T04:51:00,579 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,579 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,580 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,581 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,582 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,583 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,584 even if it does not contain any `.py` files. 2025-08-31T04:51:00,584 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,585 directory, all directories are treated like packages. 2025-08-31T04:51:00,585 ******************************************************************************** 2025-08-31T04:51:00,586 !! 2025-08-31T04:51:00,586 check.warn(importable) 2025-08-31T04:51:00,587 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2025-08-31T04:51:00,587 !! 2025-08-31T04:51:00,588 ******************************************************************************** 2025-08-31T04:51:00,589 ############################ 2025-08-31T04:51:00,589 # Package would be ignored # 2025-08-31T04:51:00,590 ############################ 2025-08-31T04:51:00,590 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2025-08-31T04:51:00,591 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,592 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,592 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2025-08-31T04:51:00,592 to the `packages` configuration field. 2025-08-31T04:51:00,593 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,593 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,594 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,594 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,599 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,599 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2025-08-31T04:51:00,600 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2025-08-31T04:51:00,600 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,600 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,601 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,602 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,603 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,604 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,604 even if it does not contain any `.py` files. 2025-08-31T04:51:00,605 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,605 directory, all directories are treated like packages. 2025-08-31T04:51:00,606 ******************************************************************************** 2025-08-31T04:51:00,607 !! 2025-08-31T04:51:00,608 check.warn(importable) 2025-08-31T04:51:00,608 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2025-08-31T04:51:00,609 !! 2025-08-31T04:51:00,610 ******************************************************************************** 2025-08-31T04:51:00,610 ############################ 2025-08-31T04:51:00,611 # Package would be ignored # 2025-08-31T04:51:00,612 ############################ 2025-08-31T04:51:00,612 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2025-08-31T04:51:00,613 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,614 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,614 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2025-08-31T04:51:00,614 to the `packages` configuration field. 2025-08-31T04:51:00,615 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,616 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,616 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,617 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,618 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,619 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2025-08-31T04:51:00,620 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2025-08-31T04:51:00,620 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,621 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,621 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,622 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,623 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,624 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,624 even if it does not contain any `.py` files. 2025-08-31T04:51:00,624 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,625 directory, all directories are treated like packages. 2025-08-31T04:51:00,625 ******************************************************************************** 2025-08-31T04:51:00,626 !! 2025-08-31T04:51:00,626 check.warn(importable) 2025-08-31T04:51:00,626 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2025-08-31T04:51:00,627 !! 2025-08-31T04:51:00,627 ******************************************************************************** 2025-08-31T04:51:00,628 ############################ 2025-08-31T04:51:00,628 # Package would be ignored # 2025-08-31T04:51:00,628 ############################ 2025-08-31T04:51:00,629 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2025-08-31T04:51:00,629 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,630 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,631 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2025-08-31T04:51:00,631 to the `packages` configuration field. 2025-08-31T04:51:00,632 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,633 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,633 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,634 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,635 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,636 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2025-08-31T04:51:00,637 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2025-08-31T04:51:00,637 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,638 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,638 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,639 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,640 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,642 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,642 even if it does not contain any `.py` files. 2025-08-31T04:51:00,643 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,643 directory, all directories are treated like packages. 2025-08-31T04:51:00,643 ******************************************************************************** 2025-08-31T04:51:00,644 !! 2025-08-31T04:51:00,645 check.warn(importable) 2025-08-31T04:51:00,646 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2025-08-31T04:51:00,646 !! 2025-08-31T04:51:00,647 ******************************************************************************** 2025-08-31T04:51:00,648 ############################ 2025-08-31T04:51:00,648 # Package would be ignored # 2025-08-31T04:51:00,648 ############################ 2025-08-31T04:51:00,649 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2025-08-31T04:51:00,649 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,650 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,650 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2025-08-31T04:51:00,650 to the `packages` configuration field. 2025-08-31T04:51:00,651 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,651 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,652 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,653 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,653 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,654 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2025-08-31T04:51:00,654 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2025-08-31T04:51:00,655 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,655 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,656 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,657 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,658 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,660 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,660 even if it does not contain any `.py` files. 2025-08-31T04:51:00,661 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,661 directory, all directories are treated like packages. 2025-08-31T04:51:00,662 ******************************************************************************** 2025-08-31T04:51:00,663 !! 2025-08-31T04:51:00,663 check.warn(importable) 2025-08-31T04:51:00,664 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2025-08-31T04:51:00,664 !! 2025-08-31T04:51:00,665 ******************************************************************************** 2025-08-31T04:51:00,666 ############################ 2025-08-31T04:51:00,666 # Package would be ignored # 2025-08-31T04:51:00,667 ############################ 2025-08-31T04:51:00,667 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2025-08-31T04:51:00,668 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,669 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,669 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2025-08-31T04:51:00,669 to the `packages` configuration field. 2025-08-31T04:51:00,670 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,671 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,672 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,673 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,674 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,675 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2025-08-31T04:51:00,675 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2025-08-31T04:51:00,676 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,676 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,676 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,677 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,678 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,679 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,679 even if it does not contain any `.py` files. 2025-08-31T04:51:00,679 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,680 directory, all directories are treated like packages. 2025-08-31T04:51:00,680 ******************************************************************************** 2025-08-31T04:51:00,681 !! 2025-08-31T04:51:00,681 check.warn(importable) 2025-08-31T04:51:00,681 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.compile' is absent from the `packages` configuration. 2025-08-31T04:51:00,682 !! 2025-08-31T04:51:00,683 ******************************************************************************** 2025-08-31T04:51:00,683 ############################ 2025-08-31T04:51:00,684 # Package would be ignored # 2025-08-31T04:51:00,684 ############################ 2025-08-31T04:51:00,685 Python recognizes 'deepspeed.ops.csrc.compile' as an importable package[^1], 2025-08-31T04:51:00,685 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,686 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,687 package, please make sure that 'deepspeed.ops.csrc.compile' is explicitly added 2025-08-31T04:51:00,687 to the `packages` configuration field. 2025-08-31T04:51:00,688 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,689 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,689 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,690 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,691 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,692 If you don't want 'deepspeed.ops.csrc.compile' to be distributed and are 2025-08-31T04:51:00,693 already explicitly excluding 'deepspeed.ops.csrc.compile' via 2025-08-31T04:51:00,693 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,694 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,694 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,695 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,696 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,697 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,698 even if it does not contain any `.py` files. 2025-08-31T04:51:00,698 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,699 directory, all directories are treated like packages. 2025-08-31T04:51:00,700 ******************************************************************************** 2025-08-31T04:51:00,701 !! 2025-08-31T04:51:00,701 check.warn(importable) 2025-08-31T04:51:00,701 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration. 2025-08-31T04:51:00,702 !! 2025-08-31T04:51:00,702 ******************************************************************************** 2025-08-31T04:51:00,703 ############################ 2025-08-31T04:51:00,703 # Package would be ignored # 2025-08-31T04:51:00,703 ############################ 2025-08-31T04:51:00,704 Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1], 2025-08-31T04:51:00,704 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,705 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,705 package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added 2025-08-31T04:51:00,705 to the `packages` configuration field. 2025-08-31T04:51:00,706 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,706 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,707 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,708 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,708 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,709 If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are 2025-08-31T04:51:00,710 already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via 2025-08-31T04:51:00,710 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,711 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,712 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,713 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,714 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,715 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,716 even if it does not contain any `.py` files. 2025-08-31T04:51:00,717 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,717 directory, all directories are treated like packages. 2025-08-31T04:51:00,718 ******************************************************************************** 2025-08-31T04:51:00,719 !! 2025-08-31T04:51:00,719 check.warn(importable) 2025-08-31T04:51:00,719 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2025-08-31T04:51:00,720 !! 2025-08-31T04:51:00,721 ******************************************************************************** 2025-08-31T04:51:00,721 ############################ 2025-08-31T04:51:00,722 # Package would be ignored # 2025-08-31T04:51:00,722 ############################ 2025-08-31T04:51:00,723 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2025-08-31T04:51:00,723 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,724 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,725 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2025-08-31T04:51:00,726 to the `packages` configuration field. 2025-08-31T04:51:00,727 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,727 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,727 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,728 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,729 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,729 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2025-08-31T04:51:00,730 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2025-08-31T04:51:00,730 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,731 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,731 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,732 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,732 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,733 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,734 even if it does not contain any `.py` files. 2025-08-31T04:51:00,734 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,734 directory, all directories are treated like packages. 2025-08-31T04:51:00,735 ******************************************************************************** 2025-08-31T04:51:00,736 !! 2025-08-31T04:51:00,736 check.warn(importable) 2025-08-31T04:51:00,737 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration. 2025-08-31T04:51:00,738 !! 2025-08-31T04:51:00,739 ******************************************************************************** 2025-08-31T04:51:00,739 ############################ 2025-08-31T04:51:00,740 # Package would be ignored # 2025-08-31T04:51:00,740 ############################ 2025-08-31T04:51:00,741 Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1], 2025-08-31T04:51:00,741 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,742 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,743 package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added 2025-08-31T04:51:00,746 to the `packages` configuration field. 2025-08-31T04:51:00,747 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,748 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,748 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,749 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,750 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,751 If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are 2025-08-31T04:51:00,751 already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via 2025-08-31T04:51:00,752 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,752 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,753 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,754 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,755 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,756 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,756 even if it does not contain any `.py` files. 2025-08-31T04:51:00,757 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,757 directory, all directories are treated like packages. 2025-08-31T04:51:00,757 ******************************************************************************** 2025-08-31T04:51:00,758 !! 2025-08-31T04:51:00,759 check.warn(importable) 2025-08-31T04:51:00,759 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration. 2025-08-31T04:51:00,759 !! 2025-08-31T04:51:00,760 ******************************************************************************** 2025-08-31T04:51:00,760 ############################ 2025-08-31T04:51:00,761 # Package would be ignored # 2025-08-31T04:51:00,761 ############################ 2025-08-31T04:51:00,761 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1], 2025-08-31T04:51:00,762 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,762 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,763 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added 2025-08-31T04:51:00,763 to the `packages` configuration field. 2025-08-31T04:51:00,764 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,764 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,765 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,766 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,767 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,768 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are 2025-08-31T04:51:00,768 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via 2025-08-31T04:51:00,769 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,770 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,770 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,771 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,772 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,773 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,774 even if it does not contain any `.py` files. 2025-08-31T04:51:00,774 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,775 directory, all directories are treated like packages. 2025-08-31T04:51:00,775 ******************************************************************************** 2025-08-31T04:51:00,776 !! 2025-08-31T04:51:00,777 check.warn(importable) 2025-08-31T04:51:00,777 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration. 2025-08-31T04:51:00,778 !! 2025-08-31T04:51:00,779 ******************************************************************************** 2025-08-31T04:51:00,779 ############################ 2025-08-31T04:51:00,780 # Package would be ignored # 2025-08-31T04:51:00,781 ############################ 2025-08-31T04:51:00,781 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1], 2025-08-31T04:51:00,781 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,782 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,783 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added 2025-08-31T04:51:00,783 to the `packages` configuration field. 2025-08-31T04:51:00,784 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,784 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,784 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,785 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,786 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,786 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are 2025-08-31T04:51:00,787 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via 2025-08-31T04:51:00,787 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,788 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,788 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,789 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,790 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,791 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,792 even if it does not contain any `.py` files. 2025-08-31T04:51:00,792 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,793 directory, all directories are treated like packages. 2025-08-31T04:51:00,793 ******************************************************************************** 2025-08-31T04:51:00,795 !! 2025-08-31T04:51:00,795 check.warn(importable) 2025-08-31T04:51:00,796 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration. 2025-08-31T04:51:00,796 !! 2025-08-31T04:51:00,797 ******************************************************************************** 2025-08-31T04:51:00,798 ############################ 2025-08-31T04:51:00,798 # Package would be ignored # 2025-08-31T04:51:00,799 ############################ 2025-08-31T04:51:00,799 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1], 2025-08-31T04:51:00,799 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,800 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,801 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added 2025-08-31T04:51:00,801 to the `packages` configuration field. 2025-08-31T04:51:00,802 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,803 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,803 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,804 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,806 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,806 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are 2025-08-31T04:51:00,807 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via 2025-08-31T04:51:00,807 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,807 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,808 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,808 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,809 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,810 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,810 even if it does not contain any `.py` files. 2025-08-31T04:51:00,811 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,811 directory, all directories are treated like packages. 2025-08-31T04:51:00,812 ******************************************************************************** 2025-08-31T04:51:00,812 !! 2025-08-31T04:51:00,813 check.warn(importable) 2025-08-31T04:51:00,813 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration. 2025-08-31T04:51:00,814 !! 2025-08-31T04:51:00,815 ******************************************************************************** 2025-08-31T04:51:00,815 ############################ 2025-08-31T04:51:00,816 # Package would be ignored # 2025-08-31T04:51:00,816 ############################ 2025-08-31T04:51:00,817 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1], 2025-08-31T04:51:00,818 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,819 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,819 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added 2025-08-31T04:51:00,820 to the `packages` configuration field. 2025-08-31T04:51:00,821 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,821 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,822 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,823 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,824 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,825 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are 2025-08-31T04:51:00,825 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via 2025-08-31T04:51:00,826 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,826 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,827 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,828 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,829 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,830 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,831 even if it does not contain any `.py` files. 2025-08-31T04:51:00,832 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,832 directory, all directories are treated like packages. 2025-08-31T04:51:00,832 ******************************************************************************** 2025-08-31T04:51:00,833 !! 2025-08-31T04:51:00,833 check.warn(importable) 2025-08-31T04:51:00,834 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration. 2025-08-31T04:51:00,834 !! 2025-08-31T04:51:00,835 ******************************************************************************** 2025-08-31T04:51:00,835 ############################ 2025-08-31T04:51:00,835 # Package would be ignored # 2025-08-31T04:51:00,836 ############################ 2025-08-31T04:51:00,836 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1], 2025-08-31T04:51:00,836 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,837 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,837 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added 2025-08-31T04:51:00,838 to the `packages` configuration field. 2025-08-31T04:51:00,838 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,839 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,839 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,841 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,842 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,843 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are 2025-08-31T04:51:00,843 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via 2025-08-31T04:51:00,844 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,844 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,845 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,846 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,847 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,848 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,848 even if it does not contain any `.py` files. 2025-08-31T04:51:00,849 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,849 directory, all directories are treated like packages. 2025-08-31T04:51:00,849 ******************************************************************************** 2025-08-31T04:51:00,850 !! 2025-08-31T04:51:00,851 check.warn(importable) 2025-08-31T04:51:00,851 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration. 2025-08-31T04:51:00,852 !! 2025-08-31T04:51:00,853 ******************************************************************************** 2025-08-31T04:51:00,853 ############################ 2025-08-31T04:51:00,854 # Package would be ignored # 2025-08-31T04:51:00,854 ############################ 2025-08-31T04:51:00,854 Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1], 2025-08-31T04:51:00,855 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,856 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,856 package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added 2025-08-31T04:51:00,857 to the `packages` configuration field. 2025-08-31T04:51:00,857 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,858 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,858 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,859 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,859 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,860 If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are 2025-08-31T04:51:00,860 already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via 2025-08-31T04:51:00,861 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,861 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,861 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,862 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,863 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,864 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,864 even if it does not contain any `.py` files. 2025-08-31T04:51:00,865 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,865 directory, all directories are treated like packages. 2025-08-31T04:51:00,866 ******************************************************************************** 2025-08-31T04:51:00,867 !! 2025-08-31T04:51:00,867 check.warn(importable) 2025-08-31T04:51:00,868 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration. 2025-08-31T04:51:00,868 !! 2025-08-31T04:51:00,869 ******************************************************************************** 2025-08-31T04:51:00,870 ############################ 2025-08-31T04:51:00,870 # Package would be ignored # 2025-08-31T04:51:00,871 ############################ 2025-08-31T04:51:00,871 Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1], 2025-08-31T04:51:00,872 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,872 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,873 package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added 2025-08-31T04:51:00,873 to the `packages` configuration field. 2025-08-31T04:51:00,874 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,875 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,875 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,876 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,877 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,878 If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are 2025-08-31T04:51:00,879 already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via 2025-08-31T04:51:00,879 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,880 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,880 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,881 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,883 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,884 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,884 even if it does not contain any `.py` files. 2025-08-31T04:51:00,885 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,885 directory, all directories are treated like packages. 2025-08-31T04:51:00,885 ******************************************************************************** 2025-08-31T04:51:00,886 !! 2025-08-31T04:51:00,887 check.warn(importable) 2025-08-31T04:51:00,887 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration. 2025-08-31T04:51:00,887 !! 2025-08-31T04:51:00,888 ******************************************************************************** 2025-08-31T04:51:00,889 ############################ 2025-08-31T04:51:00,889 # Package would be ignored # 2025-08-31T04:51:00,890 ############################ 2025-08-31T04:51:00,890 Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1], 2025-08-31T04:51:00,891 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,892 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,892 package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added 2025-08-31T04:51:00,893 to the `packages` configuration field. 2025-08-31T04:51:00,894 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,895 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,895 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,896 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,897 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,898 If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are 2025-08-31T04:51:00,899 already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via 2025-08-31T04:51:00,899 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,900 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,900 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,901 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,902 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,904 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,904 even if it does not contain any `.py` files. 2025-08-31T04:51:00,905 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,906 directory, all directories are treated like packages. 2025-08-31T04:51:00,906 ******************************************************************************** 2025-08-31T04:51:00,907 !! 2025-08-31T04:51:00,908 check.warn(importable) 2025-08-31T04:51:00,908 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2025-08-31T04:51:00,909 !! 2025-08-31T04:51:00,910 ******************************************************************************** 2025-08-31T04:51:00,910 ############################ 2025-08-31T04:51:00,911 # Package would be ignored # 2025-08-31T04:51:00,911 ############################ 2025-08-31T04:51:00,912 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2025-08-31T04:51:00,912 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,913 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,914 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2025-08-31T04:51:00,914 to the `packages` configuration field. 2025-08-31T04:51:00,915 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,915 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,916 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,917 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,918 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,919 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2025-08-31T04:51:00,919 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2025-08-31T04:51:00,920 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,920 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,921 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,922 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,923 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,925 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,925 even if it does not contain any `.py` files. 2025-08-31T04:51:00,926 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,926 directory, all directories are treated like packages. 2025-08-31T04:51:00,927 ******************************************************************************** 2025-08-31T04:51:00,928 !! 2025-08-31T04:51:00,928 check.warn(importable) 2025-08-31T04:51:00,929 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2025-08-31T04:51:00,929 !! 2025-08-31T04:51:00,930 ******************************************************************************** 2025-08-31T04:51:00,931 ############################ 2025-08-31T04:51:00,931 # Package would be ignored # 2025-08-31T04:51:00,932 ############################ 2025-08-31T04:51:00,932 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2025-08-31T04:51:00,933 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,934 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,935 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2025-08-31T04:51:00,935 to the `packages` configuration field. 2025-08-31T04:51:00,936 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,937 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,938 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,939 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,940 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,941 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2025-08-31T04:51:00,941 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2025-08-31T04:51:00,942 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,942 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,942 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,943 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,944 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,945 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,946 even if it does not contain any `.py` files. 2025-08-31T04:51:00,946 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,947 directory, all directories are treated like packages. 2025-08-31T04:51:00,947 ******************************************************************************** 2025-08-31T04:51:00,948 !! 2025-08-31T04:51:00,949 check.warn(importable) 2025-08-31T04:51:00,949 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration. 2025-08-31T04:51:00,950 !! 2025-08-31T04:51:00,951 ******************************************************************************** 2025-08-31T04:51:00,951 ############################ 2025-08-31T04:51:00,952 # Package would be ignored # 2025-08-31T04:51:00,952 ############################ 2025-08-31T04:51:00,953 Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1], 2025-08-31T04:51:00,953 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,954 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,955 package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added 2025-08-31T04:51:00,955 to the `packages` configuration field. 2025-08-31T04:51:00,956 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,957 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,958 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,959 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,960 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,961 If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are 2025-08-31T04:51:00,961 already explicitly excluding 'deepspeed.ops.csrc.lion' via 2025-08-31T04:51:00,962 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,962 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,963 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,964 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,965 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,967 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,967 even if it does not contain any `.py` files. 2025-08-31T04:51:00,967 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,968 directory, all directories are treated like packages. 2025-08-31T04:51:00,969 ******************************************************************************** 2025-08-31T04:51:00,970 !! 2025-08-31T04:51:00,970 check.warn(importable) 2025-08-31T04:51:00,970 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2025-08-31T04:51:00,971 !! 2025-08-31T04:51:00,972 ******************************************************************************** 2025-08-31T04:51:00,972 ############################ 2025-08-31T04:51:00,973 # Package would be ignored # 2025-08-31T04:51:00,973 ############################ 2025-08-31T04:51:00,973 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2025-08-31T04:51:00,974 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,975 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,975 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2025-08-31T04:51:00,975 to the `packages` configuration field. 2025-08-31T04:51:00,976 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:00,977 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:00,977 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:00,978 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:00,979 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:00,980 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2025-08-31T04:51:00,981 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2025-08-31T04:51:00,981 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:00,982 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:00,983 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:00,984 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:00,985 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:00,987 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:00,987 even if it does not contain any `.py` files. 2025-08-31T04:51:00,988 On the other hand, currently there is no concept of package data 2025-08-31T04:51:00,988 directory, all directories are treated like packages. 2025-08-31T04:51:00,989 ******************************************************************************** 2025-08-31T04:51:00,990 !! 2025-08-31T04:51:00,990 check.warn(importable) 2025-08-31T04:51:00,991 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2025-08-31T04:51:00,992 !! 2025-08-31T04:51:00,993 ******************************************************************************** 2025-08-31T04:51:00,993 ############################ 2025-08-31T04:51:00,994 # Package would be ignored # 2025-08-31T04:51:00,995 ############################ 2025-08-31T04:51:00,995 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2025-08-31T04:51:00,996 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:00,997 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:00,998 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2025-08-31T04:51:00,998 to the `packages` configuration field. 2025-08-31T04:51:00,999 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:01,000 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:01,000 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:01,001 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:01,002 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:01,003 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2025-08-31T04:51:01,004 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2025-08-31T04:51:01,004 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:01,005 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:01,005 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:01,006 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:01,007 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:01,009 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:01,009 even if it does not contain any `.py` files. 2025-08-31T04:51:01,010 On the other hand, currently there is no concept of package data 2025-08-31T04:51:01,010 directory, all directories are treated like packages. 2025-08-31T04:51:01,011 ******************************************************************************** 2025-08-31T04:51:01,012 !! 2025-08-31T04:51:01,012 check.warn(importable) 2025-08-31T04:51:01,013 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2025-08-31T04:51:01,013 !! 2025-08-31T04:51:01,014 ******************************************************************************** 2025-08-31T04:51:01,015 ############################ 2025-08-31T04:51:01,015 # Package would be ignored # 2025-08-31T04:51:01,016 ############################ 2025-08-31T04:51:01,016 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2025-08-31T04:51:01,017 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:01,018 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:01,018 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2025-08-31T04:51:01,019 to the `packages` configuration field. 2025-08-31T04:51:01,020 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:01,021 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:01,021 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:01,022 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:01,023 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:01,024 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2025-08-31T04:51:01,025 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2025-08-31T04:51:01,026 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:01,026 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:01,027 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:01,028 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:01,029 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:01,030 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:01,031 even if it does not contain any `.py` files. 2025-08-31T04:51:01,031 On the other hand, currently there is no concept of package data 2025-08-31T04:51:01,032 directory, all directories are treated like packages. 2025-08-31T04:51:01,032 ******************************************************************************** 2025-08-31T04:51:01,033 !! 2025-08-31T04:51:01,034 check.warn(importable) 2025-08-31T04:51:01,034 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2025-08-31T04:51:01,035 !! 2025-08-31T04:51:01,036 ******************************************************************************** 2025-08-31T04:51:01,036 ############################ 2025-08-31T04:51:01,036 # Package would be ignored # 2025-08-31T04:51:01,037 ############################ 2025-08-31T04:51:01,037 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2025-08-31T04:51:01,038 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:01,039 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:01,039 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2025-08-31T04:51:01,040 to the `packages` configuration field. 2025-08-31T04:51:01,041 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:01,042 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:01,042 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:01,043 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:01,044 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:01,045 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2025-08-31T04:51:01,046 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2025-08-31T04:51:01,046 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:01,047 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:01,047 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:01,049 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:01,050 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:01,051 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:01,052 even if it does not contain any `.py` files. 2025-08-31T04:51:01,052 On the other hand, currently there is no concept of package data 2025-08-31T04:51:01,053 directory, all directories are treated like packages. 2025-08-31T04:51:01,054 ******************************************************************************** 2025-08-31T04:51:01,055 !! 2025-08-31T04:51:01,055 check.warn(importable) 2025-08-31T04:51:01,055 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2025-08-31T04:51:01,056 !! 2025-08-31T04:51:01,057 ******************************************************************************** 2025-08-31T04:51:01,058 ############################ 2025-08-31T04:51:01,058 # Package would be ignored # 2025-08-31T04:51:01,059 ############################ 2025-08-31T04:51:01,059 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2025-08-31T04:51:01,060 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:01,061 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:01,061 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2025-08-31T04:51:01,061 to the `packages` configuration field. 2025-08-31T04:51:01,063 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:01,063 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:01,064 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:01,065 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:01,065 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:01,066 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2025-08-31T04:51:01,067 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2025-08-31T04:51:01,067 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:01,068 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:01,068 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:01,069 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:01,070 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:01,072 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:01,072 even if it does not contain any `.py` files. 2025-08-31T04:51:01,073 On the other hand, currently there is no concept of package data 2025-08-31T04:51:01,073 directory, all directories are treated like packages. 2025-08-31T04:51:01,073 ******************************************************************************** 2025-08-31T04:51:01,075 !! 2025-08-31T04:51:01,075 check.warn(importable) 2025-08-31T04:51:01,076 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2025-08-31T04:51:01,076 !! 2025-08-31T04:51:01,077 ******************************************************************************** 2025-08-31T04:51:01,078 ############################ 2025-08-31T04:51:01,078 # Package would be ignored # 2025-08-31T04:51:01,079 ############################ 2025-08-31T04:51:01,079 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2025-08-31T04:51:01,080 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:01,081 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:01,081 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2025-08-31T04:51:01,082 to the `packages` configuration field. 2025-08-31T04:51:01,083 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:01,084 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:01,084 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:01,085 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:01,086 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:01,087 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2025-08-31T04:51:01,088 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2025-08-31T04:51:01,088 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:01,089 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:01,089 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:01,090 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:01,091 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:01,092 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:01,093 even if it does not contain any `.py` files. 2025-08-31T04:51:01,093 On the other hand, currently there is no concept of package data 2025-08-31T04:51:01,094 directory, all directories are treated like packages. 2025-08-31T04:51:01,094 ******************************************************************************** 2025-08-31T04:51:01,095 !! 2025-08-31T04:51:01,096 check.warn(importable) 2025-08-31T04:51:01,096 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2025-08-31T04:51:01,096 !! 2025-08-31T04:51:01,097 ******************************************************************************** 2025-08-31T04:51:01,098 ############################ 2025-08-31T04:51:01,098 # Package would be ignored # 2025-08-31T04:51:01,099 ############################ 2025-08-31T04:51:01,099 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2025-08-31T04:51:01,100 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:01,101 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:01,101 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2025-08-31T04:51:01,102 to the `packages` configuration field. 2025-08-31T04:51:01,103 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:01,103 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:01,104 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:01,105 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:01,106 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:01,107 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2025-08-31T04:51:01,107 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2025-08-31T04:51:01,108 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:01,108 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:01,109 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:01,110 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:01,111 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:01,112 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:01,113 even if it does not contain any `.py` files. 2025-08-31T04:51:01,113 On the other hand, currently there is no concept of package data 2025-08-31T04:51:01,114 directory, all directories are treated like packages. 2025-08-31T04:51:01,114 ******************************************************************************** 2025-08-31T04:51:01,115 !! 2025-08-31T04:51:01,116 check.warn(importable) 2025-08-31T04:51:01,116 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2025-08-31T04:51:01,117 !! 2025-08-31T04:51:01,117 ******************************************************************************** 2025-08-31T04:51:01,118 ############################ 2025-08-31T04:51:01,118 # Package would be ignored # 2025-08-31T04:51:01,119 ############################ 2025-08-31T04:51:01,119 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2025-08-31T04:51:01,120 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:01,120 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:01,121 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2025-08-31T04:51:01,121 to the `packages` configuration field. 2025-08-31T04:51:01,122 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:01,123 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:01,123 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:01,125 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:01,126 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:01,127 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2025-08-31T04:51:01,127 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2025-08-31T04:51:01,128 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:01,128 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:01,129 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:01,130 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:01,131 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:01,133 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:01,133 even if it does not contain any `.py` files. 2025-08-31T04:51:01,134 On the other hand, currently there is no concept of package data 2025-08-31T04:51:01,134 directory, all directories are treated like packages. 2025-08-31T04:51:01,135 ******************************************************************************** 2025-08-31T04:51:01,136 !! 2025-08-31T04:51:01,136 check.warn(importable) 2025-08-31T04:51:01,137 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2025-08-31T04:51:01,137 !! 2025-08-31T04:51:01,139 ******************************************************************************** 2025-08-31T04:51:01,139 ############################ 2025-08-31T04:51:01,140 # Package would be ignored # 2025-08-31T04:51:01,140 ############################ 2025-08-31T04:51:01,141 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2025-08-31T04:51:01,141 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:01,143 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:01,143 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2025-08-31T04:51:01,144 to the `packages` configuration field. 2025-08-31T04:51:01,145 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:01,146 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:01,146 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:01,147 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:01,148 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:01,149 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2025-08-31T04:51:01,149 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2025-08-31T04:51:01,150 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:01,150 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:01,150 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:01,151 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:01,152 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:01,154 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:01,154 even if it does not contain any `.py` files. 2025-08-31T04:51:01,155 On the other hand, currently there is no concept of package data 2025-08-31T04:51:01,155 directory, all directories are treated like packages. 2025-08-31T04:51:01,156 ******************************************************************************** 2025-08-31T04:51:01,157 !! 2025-08-31T04:51:01,158 check.warn(importable) 2025-08-31T04:51:01,158 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration. 2025-08-31T04:51:01,159 !! 2025-08-31T04:51:01,160 ******************************************************************************** 2025-08-31T04:51:01,160 ############################ 2025-08-31T04:51:01,161 # Package would be ignored # 2025-08-31T04:51:01,162 ############################ 2025-08-31T04:51:01,162 Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1], 2025-08-31T04:51:01,163 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:01,164 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:01,164 package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added 2025-08-31T04:51:01,166 to the `packages` configuration field. 2025-08-31T04:51:01,167 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:01,168 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:01,168 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:01,169 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:01,170 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:01,172 If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are 2025-08-31T04:51:01,172 already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via 2025-08-31T04:51:01,173 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:01,173 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:01,174 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:01,175 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:01,176 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:01,179 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:01,179 even if it does not contain any `.py` files. 2025-08-31T04:51:01,179 On the other hand, currently there is no concept of package data 2025-08-31T04:51:01,180 directory, all directories are treated like packages. 2025-08-31T04:51:01,180 ******************************************************************************** 2025-08-31T04:51:01,181 !! 2025-08-31T04:51:01,182 check.warn(importable) 2025-08-31T04:51:01,183 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration. 2025-08-31T04:51:01,183 !! 2025-08-31T04:51:01,184 ******************************************************************************** 2025-08-31T04:51:01,184 ############################ 2025-08-31T04:51:01,185 # Package would be ignored # 2025-08-31T04:51:01,185 ############################ 2025-08-31T04:51:01,186 Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1], 2025-08-31T04:51:01,187 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:01,188 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:01,188 package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added 2025-08-31T04:51:01,189 to the `packages` configuration field. 2025-08-31T04:51:01,190 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:01,190 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:01,191 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:01,192 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:01,193 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:01,194 If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are 2025-08-31T04:51:01,194 already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via 2025-08-31T04:51:01,195 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:01,196 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:01,196 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:01,197 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:01,198 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:01,200 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:01,201 even if it does not contain any `.py` files. 2025-08-31T04:51:01,201 On the other hand, currently there is no concept of package data 2025-08-31T04:51:01,202 directory, all directories are treated like packages. 2025-08-31T04:51:01,202 ******************************************************************************** 2025-08-31T04:51:01,204 !! 2025-08-31T04:51:01,204 check.warn(importable) 2025-08-31T04:51:01,205 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration. 2025-08-31T04:51:01,205 !! 2025-08-31T04:51:01,206 ******************************************************************************** 2025-08-31T04:51:01,207 ############################ 2025-08-31T04:51:01,207 # Package would be ignored # 2025-08-31T04:51:01,208 ############################ 2025-08-31T04:51:01,209 Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1], 2025-08-31T04:51:01,210 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:01,211 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:01,211 package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added 2025-08-31T04:51:01,211 to the `packages` configuration field. 2025-08-31T04:51:01,212 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:01,213 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:01,213 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:01,214 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:01,215 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:01,216 If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are 2025-08-31T04:51:01,217 already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via 2025-08-31T04:51:01,217 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:01,218 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:01,218 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:01,219 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:01,220 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:01,222 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:01,222 even if it does not contain any `.py` files. 2025-08-31T04:51:01,223 On the other hand, currently there is no concept of package data 2025-08-31T04:51:01,223 directory, all directories are treated like packages. 2025-08-31T04:51:01,224 ******************************************************************************** 2025-08-31T04:51:01,225 !! 2025-08-31T04:51:01,225 check.warn(importable) 2025-08-31T04:51:01,226 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration. 2025-08-31T04:51:01,227 !! 2025-08-31T04:51:01,228 ******************************************************************************** 2025-08-31T04:51:01,228 ############################ 2025-08-31T04:51:01,229 # Package would be ignored # 2025-08-31T04:51:01,229 ############################ 2025-08-31T04:51:01,230 Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1], 2025-08-31T04:51:01,230 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:01,231 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:01,232 package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added 2025-08-31T04:51:01,233 to the `packages` configuration field. 2025-08-31T04:51:01,234 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:01,234 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:01,235 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:01,236 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:01,237 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:01,238 If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are 2025-08-31T04:51:01,238 already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via 2025-08-31T04:51:01,239 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:01,240 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:01,240 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:01,241 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:01,242 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:01,243 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:01,244 even if it does not contain any `.py` files. 2025-08-31T04:51:01,244 On the other hand, currently there is no concept of package data 2025-08-31T04:51:01,245 directory, all directories are treated like packages. 2025-08-31T04:51:01,245 ******************************************************************************** 2025-08-31T04:51:01,246 !! 2025-08-31T04:51:01,247 check.warn(importable) 2025-08-31T04:51:01,247 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration. 2025-08-31T04:51:01,248 !! 2025-08-31T04:51:01,249 ******************************************************************************** 2025-08-31T04:51:01,249 ############################ 2025-08-31T04:51:01,250 # Package would be ignored # 2025-08-31T04:51:01,250 ############################ 2025-08-31T04:51:01,251 Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1], 2025-08-31T04:51:01,251 but it is absent from setuptools' `packages` configuration. 2025-08-31T04:51:01,252 This leads to an ambiguous overall configuration. If you want to distribute this 2025-08-31T04:51:01,253 package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added 2025-08-31T04:51:01,253 to the `packages` configuration field. 2025-08-31T04:51:01,254 Alternatively, you can also rely on setuptools' discovery methods 2025-08-31T04:51:01,255 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-08-31T04:51:01,255 instead of `find_packages(...)`/`find:`). 2025-08-31T04:51:01,257 You can read more about "package discovery" on setuptools documentation page: 2025-08-31T04:51:01,258 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-08-31T04:51:01,259 If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are 2025-08-31T04:51:01,259 already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via 2025-08-31T04:51:01,260 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-08-31T04:51:01,260 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-08-31T04:51:01,261 combination with a more fine grained `package-data` configuration. 2025-08-31T04:51:01,262 You can read more about "package data files" on setuptools documentation page: 2025-08-31T04:51:01,263 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-08-31T04:51:01,265 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-08-31T04:51:01,265 even if it does not contain any `.py` files. 2025-08-31T04:51:01,266 On the other hand, currently there is no concept of package data 2025-08-31T04:51:01,266 directory, all directories are treated like packages. 2025-08-31T04:51:01,267 ******************************************************************************** 2025-08-31T04:51:01,268 !! 2025-08-31T04:51:01,269 check.warn(importable) 2025-08-31T04:51:01,269 creating build/lib/deepspeed/autotuning/config_templates 2025-08-31T04:51:01,270 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2025-08-31T04:51:01,270 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2025-08-31T04:51:01,271 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2025-08-31T04:51:01,271 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2025-08-31T04:51:01,272 creating build/lib/deepspeed/ops/csrc/adagrad 2025-08-31T04:51:01,272 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2025-08-31T04:51:01,273 creating build/lib/deepspeed/ops/csrc/adam 2025-08-31T04:51:01,273 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2025-08-31T04:51:01,274 copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam 2025-08-31T04:51:01,275 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2025-08-31T04:51:01,275 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2025-08-31T04:51:01,275 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2025-08-31T04:51:01,276 creating build/lib/deepspeed/ops/csrc/aio/common 2025-08-31T04:51:01,277 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2025-08-31T04:51:01,277 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2025-08-31T04:51:01,278 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2025-08-31T04:51:01,278 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2025-08-31T04:51:01,279 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2025-08-31T04:51:01,279 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2025-08-31T04:51:01,280 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,280 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,281 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,281 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,282 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,283 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,283 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,284 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,284 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,285 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,285 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,286 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,287 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,287 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,288 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,288 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,289 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,290 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:01,290 creating build/lib/deepspeed/ops/csrc/aio/py_test 2025-08-31T04:51:01,291 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2025-08-31T04:51:01,291 creating build/lib/deepspeed/ops/csrc/compile 2025-08-31T04:51:01,291 copying deepspeed/ops/csrc/compile/deepcompile.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-08-31T04:51:01,292 copying deepspeed/ops/csrc/compile/init.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-08-31T04:51:01,292 copying deepspeed/ops/csrc/compile/util.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-08-31T04:51:01,293 copying deepspeed/ops/csrc/compile/z1.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-08-31T04:51:01,293 copying deepspeed/ops/csrc/compile/z1.h -> build/lib/deepspeed/ops/csrc/compile 2025-08-31T04:51:01,294 copying deepspeed/ops/csrc/compile/z2.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-08-31T04:51:01,294 copying deepspeed/ops/csrc/compile/z2.h -> build/lib/deepspeed/ops/csrc/compile 2025-08-31T04:51:01,295 copying deepspeed/ops/csrc/compile/z3.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-08-31T04:51:01,295 copying deepspeed/ops/csrc/compile/z3.h -> build/lib/deepspeed/ops/csrc/compile 2025-08-31T04:51:01,296 creating build/lib/deepspeed/ops/csrc/cpu/adam 2025-08-31T04:51:01,296 copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam 2025-08-31T04:51:01,297 creating build/lib/deepspeed/ops/csrc/cpu/comm 2025-08-31T04:51:01,297 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-08-31T04:51:01,298 copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-08-31T04:51:01,298 copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-08-31T04:51:01,299 copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-08-31T04:51:01,299 creating build/lib/deepspeed/ops/csrc/cpu/lion 2025-08-31T04:51:01,300 copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion 2025-08-31T04:51:01,300 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-08-31T04:51:01,301 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-08-31T04:51:01,302 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-08-31T04:51:01,302 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-08-31T04:51:01,303 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-08-31T04:51:01,303 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-08-31T04:51:01,304 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-08-31T04:51:01,304 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-08-31T04:51:01,305 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-08-31T04:51:01,305 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-08-31T04:51:01,306 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-08-31T04:51:01,307 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-08-31T04:51:01,307 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-08-31T04:51:01,307 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-08-31T04:51:01,308 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-08-31T04:51:01,308 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-08-31T04:51:01,309 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-08-31T04:51:01,309 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-08-31T04:51:01,310 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-08-31T04:51:01,310 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-08-31T04:51:01,311 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-08-31T04:51:01,312 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-08-31T04:51:01,312 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-08-31T04:51:01,313 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-08-31T04:51:01,313 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-08-31T04:51:01,314 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-08-31T04:51:01,315 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-08-31T04:51:01,315 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-08-31T04:51:01,316 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-08-31T04:51:01,316 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-08-31T04:51:01,317 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-08-31T04:51:01,317 creating build/lib/deepspeed/ops/csrc/fp_quantizer 2025-08-31T04:51:01,318 copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer 2025-08-31T04:51:01,319 copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer 2025-08-31T04:51:01,319 creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2025-08-31T04:51:01,320 copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2025-08-31T04:51:01,320 copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2025-08-31T04:51:01,321 creating build/lib/deepspeed/ops/csrc/gds/py_lib 2025-08-31T04:51:01,321 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-08-31T04:51:01,322 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-08-31T04:51:01,322 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-08-31T04:51:01,323 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-08-31T04:51:01,323 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-08-31T04:51:01,324 copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-08-31T04:51:01,324 creating build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,325 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,325 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,326 copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,326 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,327 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,327 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,328 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,328 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,329 copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,329 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,330 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,330 copying deepspeed/ops/csrc/includes/deepcompile.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,331 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,331 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,332 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,332 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,333 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,333 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,334 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,334 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,335 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,335 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,336 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,337 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,337 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,338 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,338 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,339 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,339 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,340 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2025-08-31T04:51:01,340 creating build/lib/deepspeed/ops/csrc/lamb 2025-08-31T04:51:01,341 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2025-08-31T04:51:01,341 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2025-08-31T04:51:01,342 creating build/lib/deepspeed/ops/csrc/lion 2025-08-31T04:51:01,342 copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion 2025-08-31T04:51:01,343 copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion 2025-08-31T04:51:01,346 copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion 2025-08-31T04:51:01,348 copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion 2025-08-31T04:51:01,351 copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion 2025-08-31T04:51:01,353 creating build/lib/deepspeed/ops/csrc/quantization 2025-08-31T04:51:01,355 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-08-31T04:51:01,357 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-08-31T04:51:01,361 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2025-08-31T04:51:01,364 copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-08-31T04:51:01,368 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-08-31T04:51:01,371 copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-08-31T04:51:01,374 copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-08-31T04:51:01,378 creating build/lib/deepspeed/ops/csrc/random_ltd 2025-08-31T04:51:01,379 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2025-08-31T04:51:01,382 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2025-08-31T04:51:01,385 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2025-08-31T04:51:01,388 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2025-08-31T04:51:01,391 creating build/lib/deepspeed/ops/csrc/sparse_attention 2025-08-31T04:51:01,392 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2025-08-31T04:51:01,395 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2025-08-31T04:51:01,397 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2025-08-31T04:51:01,401 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2025-08-31T04:51:01,403 creating build/lib/deepspeed/ops/csrc/spatial/includes 2025-08-31T04:51:01,405 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2025-08-31T04:51:01,407 creating build/lib/deepspeed/ops/csrc/transformer 2025-08-31T04:51:01,409 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-08-31T04:51:01,413 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-08-31T04:51:01,416 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2025-08-31T04:51:01,421 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-08-31T04:51:01,424 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-08-31T04:51:01,427 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-08-31T04:51:01,431 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-08-31T04:51:01,434 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-08-31T04:51:01,437 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:01,439 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:01,442 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:01,445 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:01,448 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:01,452 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:01,454 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:01,459 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:01,462 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:01,465 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:01,468 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:01,472 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-08-31T04:51:01,473 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-08-31T04:51:01,477 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-08-31T04:51:01,480 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-08-31T04:51:01,483 creating build/lib/deepspeed/ops/csrc/utils 2025-08-31T04:51:01,484 copying deepspeed/ops/csrc/utils/py_ds_utils.cpp -> build/lib/deepspeed/ops/csrc/utils 2025-08-31T04:51:01,487 copying deepspeed/ops/csrc/utils/tensor_cast.cpp -> build/lib/deepspeed/ops/csrc/utils 2025-08-31T04:51:01,490 copying deepspeed/ops/csrc/utils/tensor_cast.h -> build/lib/deepspeed/ops/csrc/utils 2025-08-31T04:51:01,492 creating build/lib/deepspeed/ops/csrc/xpu/adagrad 2025-08-31T04:51:01,494 copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad 2025-08-31T04:51:01,497 creating build/lib/deepspeed/ops/csrc/xpu/adam 2025-08-31T04:51:01,499 copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2025-08-31T04:51:01,501 copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2025-08-31T04:51:01,505 copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2025-08-31T04:51:01,507 creating build/lib/deepspeed/ops/csrc/xpu/common 2025-08-31T04:51:01,509 copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common 2025-08-31T04:51:01,511 creating build/lib/deepspeed/ops/csrc/xpu/includes 2025-08-31T04:51:01,513 copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-08-31T04:51:01,515 copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-08-31T04:51:01,518 copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-08-31T04:51:01,521 copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-08-31T04:51:01,523 copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-08-31T04:51:01,526 creating build/lib/deepspeed/ops/csrc/xpu/packbits 2025-08-31T04:51:01,528 copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits 2025-08-31T04:51:01,530 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-08-31T04:51:01,533 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-08-31T04:51:01,536 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-08-31T04:51:01,539 creating build/lib/deepspeed/inference/v2/ragged/csrc 2025-08-31T04:51:01,540 copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc 2025-08-31T04:51:01,543 copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc 2025-08-31T04:51:01,545 creating build/lib/deepspeed/inference/v2/ragged/includes 2025-08-31T04:51:01,546 copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes 2025-08-31T04:51:01,549 creating build/lib/deepspeed/inference/v2/kernels/includes 2025-08-31T04:51:01,550 copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-08-31T04:51:01,553 copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-08-31T04:51:01,556 copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-08-31T04:51:01,559 copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-08-31T04:51:01,563 copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-08-31T04:51:01,566 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2025-08-31T04:51:01,569 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes 2025-08-31T04:51:01,570 copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes 2025-08-31T04:51:01,573 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-08-31T04:51:01,574 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-08-31T04:51:01,577 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-08-31T04:51:01,579 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-08-31T04:51:01,582 copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops 2025-08-31T04:51:01,585 copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2025-08-31T04:51:01,587 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-08-31T04:51:01,588 copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-08-31T04:51:01,591 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-08-31T04:51:01,593 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-08-31T04:51:01,596 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-08-31T04:51:01,598 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-08-31T04:51:01,601 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-08-31T04:51:01,604 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-08-31T04:51:01,606 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-08-31T04:51:01,609 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-08-31T04:51:01,611 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:51:01,614 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:51:01,617 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:51:01,620 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:51:01,623 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-08-31T04:51:01,626 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-08-31T04:51:01,629 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-08-31T04:51:01,631 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-08-31T04:51:01,634 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-08-31T04:51:01,637 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-08-31T04:51:01,639 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-08-31T04:51:01,642 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-08-31T04:51:01,644 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-08-31T04:51:01,646 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-08-31T04:51:01,649 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-08-31T04:51:01,651 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-08-31T04:51:01,653 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-08-31T04:51:01,656 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-08-31T04:51:01,658 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-08-31T04:51:01,660 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-08-31T04:51:01,662 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-08-31T04:51:01,664 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-08-31T04:51:01,666 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:51:01,669 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:51:01,671 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:51:01,674 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-08-31T04:51:01,678 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-08-31T04:51:01,681 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-08-31T04:51:01,686 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-08-31T04:51:01,690 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-08-31T04:51:01,696 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-08-31T04:51:01,700 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-08-31T04:51:01,703 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-08-31T04:51:01,706 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-08-31T04:51:01,709 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:01,710 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:01,713 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:01,716 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:01,719 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:01,722 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:01,725 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:01,728 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:01,731 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:01,733 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:01,736 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-08-31T04:51:01,739 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-08-31T04:51:01,741 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-08-31T04:51:01,744 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-08-31T04:51:01,747 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-08-31T04:51:01,750 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-08-31T04:51:01,753 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-08-31T04:51:01,756 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-08-31T04:51:01,758 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-08-31T04:51:01,761 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-08-31T04:51:01,764 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-08-31T04:51:01,767 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-08-31T04:51:01,825 running build_scripts 2025-08-31T04:51:01,827 creating build/scripts-3.11 2025-08-31T04:51:01,828 copying and adjusting bin/deepspeed -> build/scripts-3.11 2025-08-31T04:51:01,830 copying and adjusting bin/deepspeed.pt -> build/scripts-3.11 2025-08-31T04:51:01,832 copying and adjusting bin/ds -> build/scripts-3.11 2025-08-31T04:51:01,834 copying bin/ds_ssh -> build/scripts-3.11 2025-08-31T04:51:01,837 copying and adjusting bin/ds_report -> build/scripts-3.11 2025-08-31T04:51:01,839 copying and adjusting bin/ds_bench -> build/scripts-3.11 2025-08-31T04:51:01,841 copying and adjusting bin/dsr -> build/scripts-3.11 2025-08-31T04:51:01,842 copying and adjusting bin/ds_elastic -> build/scripts-3.11 2025-08-31T04:51:01,844 copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11 2025-08-31T04:51:01,846 copying and adjusting bin/ds_io -> build/scripts-3.11 2025-08-31T04:51:01,848 changing mode of build/scripts-3.11/deepspeed from 644 to 755 2025-08-31T04:51:01,848 changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755 2025-08-31T04:51:01,849 changing mode of build/scripts-3.11/ds from 644 to 755 2025-08-31T04:51:01,850 changing mode of build/scripts-3.11/ds_report from 644 to 755 2025-08-31T04:51:01,850 changing mode of build/scripts-3.11/ds_bench from 644 to 755 2025-08-31T04:51:01,851 changing mode of build/scripts-3.11/dsr from 644 to 755 2025-08-31T04:51:01,852 changing mode of build/scripts-3.11/ds_elastic from 644 to 755 2025-08-31T04:51:01,853 changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755 2025-08-31T04:51:01,853 changing mode of build/scripts-3.11/ds_io from 644 to 755 2025-08-31T04:51:01,880 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-08-31T04:51:01,881 !! 2025-08-31T04:51:01,882 ******************************************************************************** 2025-08-31T04:51:01,882 Please avoid running ``setup.py`` directly. 2025-08-31T04:51:01,882 Instead, use pypa/build, pypa/installer or other 2025-08-31T04:51:01,883 standards-based tools. 2025-08-31T04:51:01,884 By 2025-Oct-31, you need to update your project and remove deprecated calls 2025-08-31T04:51:01,885 or your builds will no longer be supported. 2025-08-31T04:51:01,886 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-08-31T04:51:01,886 ******************************************************************************** 2025-08-31T04:51:01,887 !! 2025-08-31T04:51:01,888 self.initialize_options() 2025-08-31T04:51:01,912 installing to build/bdist.linux-armv7l/wheel 2025-08-31T04:51:01,913 running install 2025-08-31T04:51:01,937 running install_lib 2025-08-31T04:51:01,964 creating build/bdist.linux-armv7l/wheel 2025-08-31T04:51:01,967 creating build/bdist.linux-armv7l/wheel/deepspeed 2025-08-31T04:51:01,970 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2025-08-31T04:51:01,971 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-08-31T04:51:01,974 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-08-31T04:51:01,976 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-08-31T04:51:01,979 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-08-31T04:51:01,982 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-08-31T04:51:01,984 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-08-31T04:51:01,987 creating build/bdist.linux-armv7l/wheel/deepspeed/sequence 2025-08-31T04:51:01,988 copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-08-31T04:51:01,990 copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-08-31T04:51:01,993 copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-08-31T04:51:01,995 copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-08-31T04:51:01,998 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-08-31T04:51:02,000 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-08-31T04:51:02,003 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2025-08-31T04:51:02,004 copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-08-31T04:51:02,007 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-08-31T04:51:02,008 copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-08-31T04:51:02,011 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-08-31T04:51:02,013 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-08-31T04:51:02,015 copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-08-31T04:51:02,018 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-08-31T04:51:02,020 copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-08-31T04:51:02,022 copying build/lib/deepspeed/accelerator/sdaa_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-08-31T04:51:02,024 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-08-31T04:51:02,027 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-08-31T04:51:02,029 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2025-08-31T04:51:02,030 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,033 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,035 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,037 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,038 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,041 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,043 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,045 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,047 copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,049 copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,051 copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,052 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,055 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,056 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,059 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,062 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,064 copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,066 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-08-31T04:51:02,069 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2025-08-31T04:51:02,070 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe 2025-08-31T04:51:02,072 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2025-08-31T04:51:02,073 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-08-31T04:51:02,075 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-08-31T04:51:02,077 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-08-31T04:51:02,078 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-08-31T04:51:02,080 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-08-31T04:51:02,082 copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-08-31T04:51:02,084 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-08-31T04:51:02,086 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-08-31T04:51:02,088 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2025-08-31T04:51:02,089 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-08-31T04:51:02,091 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-08-31T04:51:02,093 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-08-31T04:51:02,095 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-08-31T04:51:02,097 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-08-31T04:51:02,099 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-08-31T04:51:02,102 creating build/bdist.linux-armv7l/wheel/deepspeed/io 2025-08-31T04:51:02,103 copying build/lib/deepspeed/io/fast_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-08-31T04:51:02,105 copying build/lib/deepspeed/io/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-08-31T04:51:02,107 copying build/lib/deepspeed/io/single_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-08-31T04:51:02,109 copying build/lib/deepspeed/io/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-08-31T04:51:02,110 copying build/lib/deepspeed/io/py_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-08-31T04:51:02,112 copying build/lib/deepspeed/io/base_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-08-31T04:51:02,114 copying build/lib/deepspeed/io/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-08-31T04:51:02,116 copying build/lib/deepspeed/io/double_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-08-31T04:51:02,118 copying build/lib/deepspeed/io/base_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-08-31T04:51:02,119 copying build/lib/deepspeed/io/mock_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-08-31T04:51:02,122 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2025-08-31T04:51:02,123 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2025-08-31T04:51:02,125 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-08-31T04:51:02,127 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-08-31T04:51:02,128 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-08-31T04:51:02,130 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-08-31T04:51:02,132 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-08-31T04:51:02,134 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-08-31T04:51:02,136 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-08-31T04:51:02,139 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-08-31T04:51:02,141 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-08-31T04:51:02,144 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-08-31T04:51:02,146 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2025-08-31T04:51:02,147 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-08-31T04:51:02,149 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-08-31T04:51:02,151 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-08-31T04:51:02,152 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-08-31T04:51:02,154 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-08-31T04:51:02,156 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-08-31T04:51:02,158 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2025-08-31T04:51:02,159 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-08-31T04:51:02,162 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-08-31T04:51:02,164 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-08-31T04:51:02,166 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-08-31T04:51:02,168 copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-08-31T04:51:02,170 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-08-31T04:51:02,172 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-08-31T04:51:02,174 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2025-08-31T04:51:02,175 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-08-31T04:51:02,177 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-08-31T04:51:02,179 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-08-31T04:51:02,181 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-08-31T04:51:02,184 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-08-31T04:51:02,186 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-08-31T04:51:02,189 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-08-31T04:51:02,191 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-08-31T04:51:02,194 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2025-08-31T04:51:02,195 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2025-08-31T04:51:02,197 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2025-08-31T04:51:02,198 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2025-08-31T04:51:02,200 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2025-08-31T04:51:02,201 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2025-08-31T04:51:02,204 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2025-08-31T04:51:02,204 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler 2025-08-31T04:51:02,206 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler 2025-08-31T04:51:02,209 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2025-08-31T04:51:02,211 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2025-08-31T04:51:02,213 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-08-31T04:51:02,215 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2025-08-31T04:51:02,216 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,219 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/sequence_parallel 2025-08-31T04:51:02,220 copying build/lib/deepspeed/runtime/sequence_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel 2025-08-31T04:51:02,222 copying build/lib/deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel 2025-08-31T04:51:02,226 copying build/lib/deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel 2025-08-31T04:51:02,228 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,230 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/model_checkpointing 2025-08-31T04:51:02,231 copying build/lib/deepspeed/runtime/model_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-08-31T04:51:02,233 copying build/lib/deepspeed/runtime/model_checkpointing/writer_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-08-31T04:51:02,235 copying build/lib/deepspeed/runtime/model_checkpointing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-08-31T04:51:02,237 copying build/lib/deepspeed/runtime/model_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-08-31T04:51:02,239 copying build/lib/deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-08-31T04:51:02,241 copying build/lib/deepspeed/runtime/model_checkpointing/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-08-31T04:51:02,243 copying build/lib/deepspeed/runtime/precision_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,245 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2025-08-31T04:51:02,246 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-08-31T04:51:02,248 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-08-31T04:51:02,251 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-08-31T04:51:02,254 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-08-31T04:51:02,256 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-08-31T04:51:02,259 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-08-31T04:51:02,261 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,263 copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,265 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,266 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,272 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2025-08-31T04:51:02,273 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-08-31T04:51:02,275 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-08-31T04:51:02,277 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2025-08-31T04:51:02,278 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-08-31T04:51:02,281 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-08-31T04:51:02,283 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-08-31T04:51:02,286 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-08-31T04:51:02,288 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-08-31T04:51:02,290 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-08-31T04:51:02,293 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-08-31T04:51:02,295 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2025-08-31T04:51:02,296 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-08-31T04:51:02,298 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-08-31T04:51:02,300 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-08-31T04:51:02,303 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-08-31T04:51:02,304 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-08-31T04:51:02,307 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-08-31T04:51:02,309 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2025-08-31T04:51:02,310 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2025-08-31T04:51:02,312 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2025-08-31T04:51:02,314 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2025-08-31T04:51:02,317 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,319 copying build/lib/deepspeed/runtime/torch_autocast.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,322 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2025-08-31T04:51:02,323 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-08-31T04:51:02,324 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-08-31T04:51:02,326 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-08-31T04:51:02,328 copying build/lib/deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-08-31T04:51:02,330 copying build/lib/deepspeed/runtime/checkpoint_engine/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-08-31T04:51:02,332 copying build/lib/deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-08-31T04:51:02,334 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-08-31T04:51:02,336 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,338 copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,340 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/tensor_parallel 2025-08-31T04:51:02,341 copying build/lib/deepspeed/runtime/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2025-08-31T04:51:02,343 copying build/lib/deepspeed/runtime/tensor_parallel/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2025-08-31T04:51:02,345 copying build/lib/deepspeed/runtime/tensor_parallel/tp_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2025-08-31T04:51:02,347 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,349 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,352 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2025-08-31T04:51:02,353 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression 2025-08-31T04:51:02,355 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression 2025-08-31T04:51:02,357 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2025-08-31T04:51:02,358 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-08-31T04:51:02,361 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-08-31T04:51:02,363 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-08-31T04:51:02,365 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-08-31T04:51:02,369 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-08-31T04:51:02,371 copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-08-31T04:51:02,373 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-08-31T04:51:02,375 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-08-31T04:51:02,379 copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-08-31T04:51:02,381 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-08-31T04:51:02,385 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-08-31T04:51:02,387 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-08-31T04:51:02,389 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-08-31T04:51:02,391 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-08-31T04:51:02,394 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-08-31T04:51:02,396 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-08-31T04:51:02,398 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-08-31T04:51:02,401 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino 2025-08-31T04:51:02,402 copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino 2025-08-31T04:51:02,403 copying build/lib/deepspeed/runtime/domino/async_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino 2025-08-31T04:51:02,406 copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino 2025-08-31T04:51:02,408 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,411 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2025-08-31T04:51:02,412 copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-08-31T04:51:02,414 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-08-31T04:51:02,416 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-08-31T04:51:02,418 copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-08-31T04:51:02,421 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-08-31T04:51:02,423 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-08-31T04:51:02,425 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,428 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2025-08-31T04:51:02,429 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-08-31T04:51:02,432 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-08-31T04:51:02,433 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-08-31T04:51:02,435 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-08-31T04:51:02,437 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-08-31T04:51:02,439 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-08-31T04:51:02,441 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-08-31T04:51:02,443 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-08-31T04:51:02,445 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-08-31T04:51:02,447 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2025-08-31T04:51:02,448 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-08-31T04:51:02,450 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-08-31T04:51:02,452 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-08-31T04:51:02,455 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2025-08-31T04:51:02,456 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-08-31T04:51:02,459 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-08-31T04:51:02,460 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-08-31T04:51:02,463 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-08-31T04:51:02,465 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-08-31T04:51:02,467 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,470 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,472 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,476 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,478 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-08-31T04:51:02,481 creating build/bdist.linux-armv7l/wheel/deepspeed/compile 2025-08-31T04:51:02,482 copying build/lib/deepspeed/compile/init_z1.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-08-31T04:51:02,484 copying build/lib/deepspeed/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-08-31T04:51:02,485 copying build/lib/deepspeed/compile/util.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-08-31T04:51:02,488 creating build/bdist.linux-armv7l/wheel/deepspeed/compile/passes 2025-08-31T04:51:02,489 copying build/lib/deepspeed/compile/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-08-31T04:51:02,491 copying build/lib/deepspeed/compile/passes/selective_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-08-31T04:51:02,494 copying build/lib/deepspeed/compile/passes/prefetch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-08-31T04:51:02,495 copying build/lib/deepspeed/compile/passes/zero1_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-08-31T04:51:02,497 copying build/lib/deepspeed/compile/passes/offload_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-08-31T04:51:02,499 copying build/lib/deepspeed/compile/passes/offload_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-08-31T04:51:02,501 copying build/lib/deepspeed/compile/passes/zero3_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-08-31T04:51:02,503 copying build/lib/deepspeed/compile/passes/offload_adam_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-08-31T04:51:02,505 copying build/lib/deepspeed/compile/fx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-08-31T04:51:02,507 copying build/lib/deepspeed/compile/patch_fake_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-08-31T04:51:02,509 copying build/lib/deepspeed/compile/init_z3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-08-31T04:51:02,511 copying build/lib/deepspeed/compile/partitioner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-08-31T04:51:02,513 copying build/lib/deepspeed/compile/input_storage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-08-31T04:51:02,515 copying build/lib/deepspeed/compile/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-08-31T04:51:02,516 copying build/lib/deepspeed/compile/list_schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-08-31T04:51:02,519 copying build/lib/deepspeed/compile/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-08-31T04:51:02,521 copying build/lib/deepspeed/compile/graph_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-08-31T04:51:02,523 copying build/lib/deepspeed/compile/patch_compiled_func.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-08-31T04:51:02,525 copying build/lib/deepspeed/compile/inductor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-08-31T04:51:02,528 creating build/bdist.linux-armv7l/wheel/deepspeed/compile/profilers 2025-08-31T04:51:02,529 copying build/lib/deepspeed/compile/profilers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers 2025-08-31T04:51:02,530 copying build/lib/deepspeed/compile/profilers/comm_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers 2025-08-31T04:51:02,533 copying build/lib/deepspeed/compile/profilers/graph_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers 2025-08-31T04:51:02,536 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2025-08-31T04:51:02,537 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2025-08-31T04:51:02,538 copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science 2025-08-31T04:51:02,540 copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science 2025-08-31T04:51:02,543 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2025-08-31T04:51:02,544 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-08-31T04:51:02,548 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-08-31T04:51:02,550 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2025-08-31T04:51:02,551 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-08-31T04:51:02,554 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-08-31T04:51:02,557 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-08-31T04:51:02,559 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-08-31T04:51:02,561 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-08-31T04:51:02,564 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-08-31T04:51:02,566 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-08-31T04:51:02,569 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-08-31T04:51:02,572 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-08-31T04:51:02,574 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2025-08-31T04:51:02,576 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd 2025-08-31T04:51:02,578 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd 2025-08-31T04:51:02,582 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2025-08-31T04:51:02,583 copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,585 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,587 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,590 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,593 copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,595 copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,597 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,599 copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,603 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2025-08-31T04:51:02,604 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-08-31T04:51:02,606 copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-08-31T04:51:02,608 copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-08-31T04:51:02,611 copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-08-31T04:51:02,613 copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-08-31T04:51:02,615 copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-08-31T04:51:02,617 copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-08-31T04:51:02,619 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-08-31T04:51:02,621 copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-08-31T04:51:02,624 copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,626 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,628 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,630 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,633 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,636 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu 2025-08-31T04:51:02,637 copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-08-31T04:51:02,639 copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-08-31T04:51:02,641 copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-08-31T04:51:02,643 copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-08-31T04:51:02,646 copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-08-31T04:51:02,647 copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-08-31T04:51:02,649 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,651 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,653 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/sdaa 2025-08-31T04:51:02,654 copying build/lib/deepspeed/ops/op_builder/sdaa/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-08-31T04:51:02,656 copying build/lib/deepspeed/ops/op_builder/sdaa/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-08-31T04:51:02,658 copying build/lib/deepspeed/ops/op_builder/sdaa/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-08-31T04:51:02,660 copying build/lib/deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-08-31T04:51:02,661 copying build/lib/deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-08-31T04:51:02,663 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,665 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,667 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,669 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2025-08-31T04:51:02,670 copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-08-31T04:51:02,672 copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-08-31T04:51:02,674 copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-08-31T04:51:02,676 copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-08-31T04:51:02,677 copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-08-31T04:51:02,679 copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-08-31T04:51:02,680 copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-08-31T04:51:02,682 copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-08-31T04:51:02,684 copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-08-31T04:51:02,685 copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-08-31T04:51:02,687 copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,689 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,691 copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,692 copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,694 copying build/lib/deepspeed/ops/op_builder/dc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,697 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2025-08-31T04:51:02,698 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-08-31T04:51:02,699 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-08-31T04:51:02,701 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-08-31T04:51:02,703 copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-08-31T04:51:02,704 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-08-31T04:51:02,706 copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-08-31T04:51:02,708 copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-08-31T04:51:02,710 copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,711 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,714 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2025-08-31T04:51:02,715 copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-08-31T04:51:02,717 copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-08-31T04:51:02,719 copying build/lib/deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-08-31T04:51:02,720 copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-08-31T04:51:02,722 copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-08-31T04:51:02,724 copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-08-31T04:51:02,726 copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-08-31T04:51:02,727 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-08-31T04:51:02,729 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops 2025-08-31T04:51:02,731 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2025-08-31T04:51:02,732 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-08-31T04:51:02,734 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-08-31T04:51:02,736 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-08-31T04:51:02,738 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-08-31T04:51:02,740 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2025-08-31T04:51:02,741 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio 2025-08-31T04:51:02,744 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer 2025-08-31T04:51:02,745 copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-08-31T04:51:02,747 copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-08-31T04:51:02,748 copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-08-31T04:51:02,750 copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-08-31T04:51:02,753 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2025-08-31T04:51:02,754 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb 2025-08-31T04:51:02,756 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb 2025-08-31T04:51:02,758 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2025-08-31T04:51:02,759 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer 2025-08-31T04:51:02,761 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer 2025-08-31T04:51:02,764 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2025-08-31T04:51:02,765 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-08-31T04:51:02,767 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-08-31T04:51:02,770 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,771 copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,773 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,775 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,776 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,778 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,780 copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,782 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,784 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,785 copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,787 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,789 copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,790 copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,792 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,793 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,795 copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,797 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,799 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,801 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,803 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,805 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,806 copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,808 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,810 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-08-31T04:51:02,813 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2025-08-31T04:51:02,814 copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-08-31T04:51:02,815 copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-08-31T04:51:02,818 copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-08-31T04:51:02,820 copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-08-31T04:51:02,822 copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-08-31T04:51:02,824 copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-08-31T04:51:02,826 copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-08-31T04:51:02,828 copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-08-31T04:51:02,830 copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-08-31T04:51:02,832 copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-08-31T04:51:02,834 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-08-31T04:51:02,835 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-08-31T04:51:02,837 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-08-31T04:51:02,839 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-08-31T04:51:02,841 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-08-31T04:51:02,844 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-08-31T04:51:02,846 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-08-31T04:51:02,848 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-08-31T04:51:02,851 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2025-08-31T04:51:02,852 copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-08-31T04:51:02,854 copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-08-31T04:51:02,856 copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-08-31T04:51:02,857 copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-08-31T04:51:02,860 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/compile 2025-08-31T04:51:02,861 copying build/lib/deepspeed/ops/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/compile 2025-08-31T04:51:02,863 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds 2025-08-31T04:51:02,865 copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds 2025-08-31T04:51:02,867 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2025-08-31T04:51:02,869 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2025-08-31T04:51:02,870 copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,872 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,873 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,876 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,878 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,879 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,881 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,884 copying build/lib/deepspeed/ops/csrc/includes/deepcompile.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,886 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,889 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,891 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,892 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,894 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,896 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,899 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,900 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,903 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,905 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,907 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,909 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,911 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,914 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,916 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,918 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,920 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,923 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,925 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,926 copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,928 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,930 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-08-31T04:51:02,933 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science 2025-08-31T04:51:02,934 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-08-31T04:51:02,935 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-08-31T04:51:02,937 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-08-31T04:51:02,939 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-08-31T04:51:02,941 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-08-31T04:51:02,942 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-08-31T04:51:02,945 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-08-31T04:51:02,947 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-08-31T04:51:02,949 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-08-31T04:51:02,951 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-08-31T04:51:02,953 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-08-31T04:51:02,956 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-08-31T04:51:02,959 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-08-31T04:51:02,961 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-08-31T04:51:02,963 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-08-31T04:51:02,967 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-08-31T04:51:02,969 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-08-31T04:51:02,973 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-08-31T04:51:02,976 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-08-31T04:51:02,977 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-08-31T04:51:02,980 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-08-31T04:51:02,982 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-08-31T04:51:02,984 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-08-31T04:51:02,987 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-08-31T04:51:02,988 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-08-31T04:51:02,990 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-08-31T04:51:02,993 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-08-31T04:51:02,996 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-08-31T04:51:02,998 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-08-31T04:51:03,000 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-08-31T04:51:03,004 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-08-31T04:51:03,007 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2025-08-31T04:51:03,008 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention 2025-08-31T04:51:03,011 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2025-08-31T04:51:03,012 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-08-31T04:51:03,014 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-08-31T04:51:03,017 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-08-31T04:51:03,019 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-08-31T04:51:03,022 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2025-08-31T04:51:03,023 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-08-31T04:51:03,025 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-08-31T04:51:03,026 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-08-31T04:51:03,028 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-08-31T04:51:03,030 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-08-31T04:51:03,033 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2025-08-31T04:51:03,034 copying build/lib/deepspeed/ops/csrc/utils/tensor_cast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils 2025-08-31T04:51:03,036 copying build/lib/deepspeed/ops/csrc/utils/tensor_cast.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils 2025-08-31T04:51:03,037 copying build/lib/deepspeed/ops/csrc/utils/py_ds_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils 2025-08-31T04:51:03,039 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2025-08-31T04:51:03,041 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2025-08-31T04:51:03,042 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-08-31T04:51:03,044 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-08-31T04:51:03,046 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-08-31T04:51:03,048 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-08-31T04:51:03,050 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-08-31T04:51:03,051 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-08-31T04:51:03,054 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2025-08-31T04:51:03,055 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test 2025-08-31T04:51:03,057 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,059 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,060 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,062 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,064 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,067 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,069 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,070 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,072 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,074 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,076 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,078 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,080 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,082 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,084 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,086 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,088 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,090 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-08-31T04:51:03,092 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer 2025-08-31T04:51:03,094 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes 2025-08-31T04:51:03,095 copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes 2025-08-31T04:51:03,098 copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes 2025-08-31T04:51:03,099 copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer 2025-08-31T04:51:03,102 copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer 2025-08-31T04:51:03,105 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2025-08-31T04:51:03,106 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb 2025-08-31T04:51:03,109 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb 2025-08-31T04:51:03,111 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2025-08-31T04:51:03,112 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-08-31T04:51:03,116 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-08-31T04:51:03,118 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-08-31T04:51:03,121 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-08-31T04:51:03,124 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-08-31T04:51:03,126 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-08-31T04:51:03,130 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-08-31T04:51:03,133 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2025-08-31T04:51:03,134 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2025-08-31T04:51:03,136 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2025-08-31T04:51:03,139 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2025-08-31T04:51:03,141 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2025-08-31T04:51:03,144 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:03,145 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:03,147 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:03,150 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:03,155 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:03,157 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:03,159 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:03,161 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:03,163 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:03,166 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:03,169 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-08-31T04:51:03,172 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-08-31T04:51:03,176 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2025-08-31T04:51:03,177 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-08-31T04:51:03,179 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-08-31T04:51:03,182 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-08-31T04:51:03,184 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-08-31T04:51:03,186 copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-08-31T04:51:03,189 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/compile 2025-08-31T04:51:03,190 copying build/lib/deepspeed/ops/csrc/compile/z2.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-08-31T04:51:03,192 copying build/lib/deepspeed/ops/csrc/compile/z2.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-08-31T04:51:03,194 copying build/lib/deepspeed/ops/csrc/compile/z1.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-08-31T04:51:03,196 copying build/lib/deepspeed/ops/csrc/compile/z1.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-08-31T04:51:03,198 copying build/lib/deepspeed/ops/csrc/compile/init.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-08-31T04:51:03,200 copying build/lib/deepspeed/ops/csrc/compile/z3.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-08-31T04:51:03,202 copying build/lib/deepspeed/ops/csrc/compile/deepcompile.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-08-31T04:51:03,206 copying build/lib/deepspeed/ops/csrc/compile/util.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-08-31T04:51:03,209 copying build/lib/deepspeed/ops/csrc/compile/z3.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-08-31T04:51:03,212 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2025-08-31T04:51:03,213 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-08-31T04:51:03,216 copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-08-31T04:51:03,219 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-08-31T04:51:03,221 copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-08-31T04:51:03,223 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-08-31T04:51:03,226 copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-08-31T04:51:03,229 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-08-31T04:51:03,231 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2025-08-31T04:51:03,233 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2025-08-31T04:51:03,234 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes 2025-08-31T04:51:03,237 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2025-08-31T04:51:03,238 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc 2025-08-31T04:51:03,240 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc 2025-08-31T04:51:03,243 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu 2025-08-31T04:51:03,244 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2025-08-31T04:51:03,245 copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-08-31T04:51:03,247 copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-08-31T04:51:03,250 copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-08-31T04:51:03,253 copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-08-31T04:51:03,255 copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-08-31T04:51:03,257 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam 2025-08-31T04:51:03,258 copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2025-08-31T04:51:03,261 copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2025-08-31T04:51:03,263 copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2025-08-31T04:51:03,266 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common 2025-08-31T04:51:03,267 copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common 2025-08-31T04:51:03,270 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits 2025-08-31T04:51:03,271 copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits 2025-08-31T04:51:03,274 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad 2025-08-31T04:51:03,275 copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad 2025-08-31T04:51:03,278 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds 2025-08-31T04:51:03,279 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib 2025-08-31T04:51:03,280 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-08-31T04:51:03,283 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-08-31T04:51:03,286 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-08-31T04:51:03,287 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-08-31T04:51:03,289 copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-08-31T04:51:03,292 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-08-31T04:51:03,295 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu 2025-08-31T04:51:03,297 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2025-08-31T04:51:03,298 copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam 2025-08-31T04:51:03,301 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2025-08-31T04:51:03,302 copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion 2025-08-31T04:51:03,305 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2025-08-31T04:51:03,306 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-08-31T04:51:03,309 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-08-31T04:51:03,311 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-08-31T04:51:03,313 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-08-31T04:51:03,316 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2025-08-31T04:51:03,317 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad 2025-08-31T04:51:03,321 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2025-08-31T04:51:03,322 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer 2025-08-31T04:51:03,324 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer 2025-08-31T04:51:03,327 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2025-08-31T04:51:03,328 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad 2025-08-31T04:51:03,331 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad 2025-08-31T04:51:03,333 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2025-08-31T04:51:03,335 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-08-31T04:51:03,337 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-08-31T04:51:03,339 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-08-31T04:51:03,341 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-08-31T04:51:03,346 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-08-31T04:51:03,348 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-08-31T04:51:03,350 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-08-31T04:51:03,353 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-08-31T04:51:03,355 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-08-31T04:51:03,359 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-08-31T04:51:03,363 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2025-08-31T04:51:03,365 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-08-31T04:51:03,369 copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-08-31T04:51:03,372 copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-08-31T04:51:03,376 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-08-31T04:51:03,378 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-08-31T04:51:03,382 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2025-08-31T04:51:03,383 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,387 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,390 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,393 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,396 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,399 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,402 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,405 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,408 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,410 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,413 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,415 copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,418 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,420 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,423 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,425 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,428 copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,431 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,434 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2025-08-31T04:51:03,435 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-08-31T04:51:03,438 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-08-31T04:51:03,441 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-08-31T04:51:03,443 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-08-31T04:51:03,446 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-08-31T04:51:03,448 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-08-31T04:51:03,450 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-08-31T04:51:03,453 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-08-31T04:51:03,456 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-08-31T04:51:03,458 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-08-31T04:51:03,461 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-08-31T04:51:03,464 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-08-31T04:51:03,468 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-08-31T04:51:03,470 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-08-31T04:51:03,474 copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-08-31T04:51:03,476 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-08-31T04:51:03,479 creating build/bdist.linux-armv7l/wheel/deepspeed/linear 2025-08-31T04:51:03,481 copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-08-31T04:51:03,483 copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-08-31T04:51:03,485 copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-08-31T04:51:03,488 copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-08-31T04:51:03,490 copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-08-31T04:51:03,493 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2025-08-31T04:51:03,494 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations 2025-08-31T04:51:03,498 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2025-08-31T04:51:03,499 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-08-31T04:51:03,502 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-08-31T04:51:03,504 copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-08-31T04:51:03,507 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-08-31T04:51:03,509 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-08-31T04:51:03,511 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-08-31T04:51:03,513 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-08-31T04:51:03,516 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-08-31T04:51:03,518 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-08-31T04:51:03,521 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-08-31T04:51:03,523 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2025-08-31T04:51:03,525 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2025-08-31T04:51:03,528 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2025-08-31T04:51:03,530 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2025-08-31T04:51:03,533 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2025-08-31T04:51:03,534 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features 2025-08-31T04:51:03,537 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features 2025-08-31T04:51:03,539 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2025-08-31T04:51:03,541 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2025-08-31T04:51:03,544 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2025-08-31T04:51:03,545 copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-08-31T04:51:03,548 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2025-08-31T04:51:03,550 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2025-08-31T04:51:03,551 copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes 2025-08-31T04:51:03,553 copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-08-31T04:51:03,555 copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-08-31T04:51:03,557 copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-08-31T04:51:03,560 copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-08-31T04:51:03,561 copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-08-31T04:51:03,564 copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-08-31T04:51:03,566 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2025-08-31T04:51:03,567 copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc 2025-08-31T04:51:03,570 copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc 2025-08-31T04:51:03,571 copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-08-31T04:51:03,574 copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-08-31T04:51:03,575 copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-08-31T04:51:03,577 copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-08-31T04:51:03,580 copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-08-31T04:51:03,582 copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-08-31T04:51:03,583 copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-08-31T04:51:03,585 copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-08-31T04:51:03,588 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2025-08-31T04:51:03,589 copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-08-31T04:51:03,592 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3 2025-08-31T04:51:03,593 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-08-31T04:51:03,595 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-08-31T04:51:03,597 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-08-31T04:51:03,599 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-08-31T04:51:03,601 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2025-08-31T04:51:03,603 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-08-31T04:51:03,605 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-08-31T04:51:03,606 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-08-31T04:51:03,608 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-08-31T04:51:03,611 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2025-08-31T04:51:03,612 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-08-31T04:51:03,614 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-08-31T04:51:03,616 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-08-31T04:51:03,618 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-08-31T04:51:03,621 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:51:03,622 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:51:03,624 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:51:03,625 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:51:03,627 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:51:03,629 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:51:03,631 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:51:03,633 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:51:03,635 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:51:03,637 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-08-31T04:51:03,639 copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-08-31T04:51:03,641 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2 2025-08-31T04:51:03,644 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-08-31T04:51:03,646 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-08-31T04:51:03,648 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-08-31T04:51:03,650 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-08-31T04:51:03,652 copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-08-31T04:51:03,655 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen 2025-08-31T04:51:03,656 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-08-31T04:51:03,658 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-08-31T04:51:03,660 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-08-31T04:51:03,662 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-08-31T04:51:03,664 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral 2025-08-31T04:51:03,665 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-08-31T04:51:03,668 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-08-31T04:51:03,669 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-08-31T04:51:03,672 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-08-31T04:51:03,674 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-08-31T04:51:03,675 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-08-31T04:51:03,677 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-08-31T04:51:03,679 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-08-31T04:51:03,682 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-08-31T04:51:03,683 copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-08-31T04:51:03,687 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:51:03,687 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:51:03,690 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:51:03,692 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:51:03,695 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:51:03,697 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:51:03,700 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:51:03,701 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:51:03,704 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:51:03,706 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-08-31T04:51:03,707 copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-08-31T04:51:03,710 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2025-08-31T04:51:03,711 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-08-31T04:51:03,713 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-08-31T04:51:03,715 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-08-31T04:51:03,717 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-08-31T04:51:03,719 copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-08-31T04:51:03,723 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi 2025-08-31T04:51:03,724 copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-08-31T04:51:03,726 copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-08-31T04:51:03,728 copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-08-31T04:51:03,730 copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-08-31T04:51:03,732 copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-08-31T04:51:03,735 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2025-08-31T04:51:03,736 copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-08-31T04:51:03,738 copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-08-31T04:51:03,740 copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-08-31T04:51:03,742 copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-08-31T04:51:03,744 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2025-08-31T04:51:03,746 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2025-08-31T04:51:03,747 copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-08-31T04:51:03,749 copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-08-31T04:51:03,751 copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-08-31T04:51:03,753 copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-08-31T04:51:03,755 copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-08-31T04:51:03,756 copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-08-31T04:51:03,758 copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-08-31T04:51:03,760 copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-08-31T04:51:03,762 copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-08-31T04:51:03,764 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2025-08-31T04:51:03,765 copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-08-31T04:51:03,767 copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-08-31T04:51:03,769 copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-08-31T04:51:03,771 copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-08-31T04:51:03,773 copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-08-31T04:51:03,775 copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-08-31T04:51:03,777 copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-08-31T04:51:03,779 copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-08-31T04:51:03,781 copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-08-31T04:51:03,784 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2025-08-31T04:51:03,785 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2025-08-31T04:51:03,786 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe 2025-08-31T04:51:03,788 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe 2025-08-31T04:51:03,790 copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations 2025-08-31T04:51:03,793 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2025-08-31T04:51:03,793 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm 2025-08-31T04:51:03,796 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm 2025-08-31T04:51:03,798 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2025-08-31T04:51:03,799 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention 2025-08-31T04:51:03,801 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention 2025-08-31T04:51:03,804 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2025-08-31T04:51:03,805 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed 2025-08-31T04:51:03,807 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed 2025-08-31T04:51:03,810 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2025-08-31T04:51:03,811 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding 2025-08-31T04:51:03,813 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding 2025-08-31T04:51:03,815 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2025-08-31T04:51:03,816 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2025-08-31T04:51:03,818 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2025-08-31T04:51:03,820 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2025-08-31T04:51:03,823 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2025-08-31T04:51:03,824 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2025-08-31T04:51:03,826 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2025-08-31T04:51:03,827 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2025-08-31T04:51:03,830 copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-08-31T04:51:03,831 copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-08-31T04:51:03,834 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2025-08-31T04:51:03,835 copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-08-31T04:51:03,837 copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-08-31T04:51:03,840 copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-08-31T04:51:03,841 copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-08-31T04:51:03,844 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2025-08-31T04:51:03,845 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2025-08-31T04:51:03,847 copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-08-31T04:51:03,848 copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-08-31T04:51:03,851 copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-08-31T04:51:03,853 copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-08-31T04:51:03,855 copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-08-31T04:51:03,859 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2025-08-31T04:51:03,860 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes 2025-08-31T04:51:03,861 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes 2025-08-31T04:51:03,864 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-08-31T04:51:03,865 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-08-31T04:51:03,867 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-08-31T04:51:03,869 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-08-31T04:51:03,871 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-08-31T04:51:03,873 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-08-31T04:51:03,875 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-08-31T04:51:03,878 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-08-31T04:51:03,879 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-08-31T04:51:03,881 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-08-31T04:51:03,882 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-08-31T04:51:03,884 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-08-31T04:51:03,886 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-08-31T04:51:03,888 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-08-31T04:51:03,890 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:51:03,891 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:51:03,894 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:51:03,895 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:51:03,898 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:51:03,900 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:51:03,902 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:51:03,905 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:51:03,907 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-08-31T04:51:03,909 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops 2025-08-31T04:51:03,912 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-08-31T04:51:03,913 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-08-31T04:51:03,915 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-08-31T04:51:03,917 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-08-31T04:51:03,919 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-08-31T04:51:03,921 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-08-31T04:51:03,923 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-08-31T04:51:03,926 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-08-31T04:51:03,927 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-08-31T04:51:03,929 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-08-31T04:51:03,930 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-08-31T04:51:03,932 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-08-31T04:51:03,934 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-08-31T04:51:03,937 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-08-31T04:51:03,939 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-08-31T04:51:03,940 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-08-31T04:51:03,942 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-08-31T04:51:03,944 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-08-31T04:51:03,947 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-08-31T04:51:03,948 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-08-31T04:51:03,950 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-08-31T04:51:03,953 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops 2025-08-31T04:51:03,955 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-08-31T04:51:03,956 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-08-31T04:51:03,958 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-08-31T04:51:03,960 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-08-31T04:51:03,962 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-08-31T04:51:03,964 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-08-31T04:51:03,966 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-08-31T04:51:03,969 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-08-31T04:51:03,970 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-08-31T04:51:03,972 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-08-31T04:51:03,974 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-08-31T04:51:03,976 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-08-31T04:51:03,978 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-08-31T04:51:03,980 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-08-31T04:51:03,982 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-08-31T04:51:03,984 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-08-31T04:51:03,986 copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels 2025-08-31T04:51:03,988 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2025-08-31T04:51:03,990 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:51:03,991 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:51:03,994 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:51:03,997 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:51:03,999 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:51:04,001 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:51:04,003 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:51:04,005 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:51:04,007 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-08-31T04:51:04,009 copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops 2025-08-31T04:51:04,010 copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops 2025-08-31T04:51:04,013 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-08-31T04:51:04,014 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-08-31T04:51:04,016 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-08-31T04:51:04,018 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-08-31T04:51:04,019 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-08-31T04:51:04,022 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-08-31T04:51:04,025 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-08-31T04:51:04,026 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-08-31T04:51:04,028 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-08-31T04:51:04,030 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-08-31T04:51:04,033 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-08-31T04:51:04,035 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-08-31T04:51:04,036 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-08-31T04:51:04,039 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-08-31T04:51:04,041 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-08-31T04:51:04,043 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:04,044 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:04,047 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:04,048 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:04,050 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:04,053 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:04,055 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:04,057 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:04,059 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:04,061 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-08-31T04:51:04,063 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-08-31T04:51:04,066 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-08-31T04:51:04,068 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-08-31T04:51:04,071 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-08-31T04:51:04,072 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-08-31T04:51:04,074 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-08-31T04:51:04,076 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-08-31T04:51:04,077 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-08-31T04:51:04,080 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-08-31T04:51:04,083 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-08-31T04:51:04,084 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-08-31T04:51:04,086 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-08-31T04:51:04,088 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-08-31T04:51:04,090 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-08-31T04:51:04,091 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-08-31T04:51:04,093 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-08-31T04:51:04,096 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-08-31T04:51:04,098 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2025-08-31T04:51:04,100 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-08-31T04:51:04,101 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-08-31T04:51:04,103 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops 2025-08-31T04:51:04,105 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops 2025-08-31T04:51:04,107 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-08-31T04:51:04,109 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-08-31T04:51:04,111 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-08-31T04:51:04,113 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-08-31T04:51:04,115 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-08-31T04:51:04,117 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-08-31T04:51:04,119 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-08-31T04:51:04,122 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-08-31T04:51:04,123 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-08-31T04:51:04,125 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-08-31T04:51:04,127 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-08-31T04:51:04,129 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-08-31T04:51:04,131 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-08-31T04:51:04,133 copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels 2025-08-31T04:51:04,135 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2025-08-31T04:51:04,137 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2025-08-31T04:51:04,140 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2025-08-31T04:51:04,141 copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-08-31T04:51:04,143 copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-08-31T04:51:04,145 copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-08-31T04:51:04,148 copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-08-31T04:51:04,150 copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-08-31T04:51:04,153 creating build/bdist.linux-armv7l/wheel/deepspeed/nvme 2025-08-31T04:51:04,154 copying build/lib/deepspeed/nvme/io_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-08-31T04:51:04,156 copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-08-31T04:51:04,158 copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-08-31T04:51:04,161 copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-08-31T04:51:04,163 copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-08-31T04:51:04,165 copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-08-31T04:51:04,167 copying build/lib/deepspeed/nvme/torch_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-08-31T04:51:04,169 copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-08-31T04:51:04,171 copying build/lib/deepspeed/nvme/ds_aio_constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-08-31T04:51:04,173 copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-08-31T04:51:04,175 copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-08-31T04:51:04,177 copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-08-31T04:51:04,178 copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-08-31T04:51:04,180 copying build/lib/deepspeed/nvme/torch_fastio_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-08-31T04:51:04,182 copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-08-31T04:51:04,185 copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-08-31T04:51:04,187 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2025-08-31T04:51:04,188 copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-08-31T04:51:04,191 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-08-31T04:51:04,193 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-08-31T04:51:04,195 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-08-31T04:51:04,197 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-08-31T04:51:04,199 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-08-31T04:51:04,202 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-08-31T04:51:04,203 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-08-31T04:51:04,206 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-08-31T04:51:04,209 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-08-31T04:51:04,211 running install_egg_info 2025-08-31T04:51:04,244 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.17.4-py3.11.egg-info 2025-08-31T04:51:04,257 running install_scripts 2025-08-31T04:51:04,258 creating build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts 2025-08-31T04:51:04,260 copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts 2025-08-31T04:51:04,262 copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts 2025-08-31T04:51:04,264 copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts 2025-08-31T04:51:04,265 copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts 2025-08-31T04:51:04,267 copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts 2025-08-31T04:51:04,268 copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts 2025-08-31T04:51:04,270 copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts 2025-08-31T04:51:04,272 copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts 2025-08-31T04:51:04,274 copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts 2025-08-31T04:51:04,275 copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts 2025-08-31T04:51:04,277 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts/ds_io to 755 2025-08-31T04:51:04,277 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts/ds_ssh to 755 2025-08-31T04:51:04,278 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts/deepspeed to 755 2025-08-31T04:51:04,278 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts/dsr to 755 2025-08-31T04:51:04,279 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts/ds to 755 2025-08-31T04:51:04,280 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts/ds_elastic to 755 2025-08-31T04:51:04,280 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts/deepspeed.pt to 755 2025-08-31T04:51:04,281 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts/ds_nvme_tune to 755 2025-08-31T04:51:04,281 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts/ds_report to 755 2025-08-31T04:51:04,282 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.data/scripts/ds_bench to 755 2025-08-31T04:51:04,294 creating build/bdist.linux-armv7l/wheel/deepspeed-0.17.4.dist-info/WHEEL 2025-08-31T04:51:04,297 creating '/tmp/pip-wheel-duvj1gas/deepspeed-0.17.4-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-08-31T04:51:04,300 adding 'deepspeed/__init__.py' 2025-08-31T04:51:04,302 adding 'deepspeed/constants.py' 2025-08-31T04:51:04,304 adding 'deepspeed/env_report.py' 2025-08-31T04:51:04,305 adding 'deepspeed/git_version_info.py' 2025-08-31T04:51:04,307 adding 'deepspeed/git_version_info_installed.py' 2025-08-31T04:51:04,308 adding 'deepspeed/accelerator/__init__.py' 2025-08-31T04:51:04,310 adding 'deepspeed/accelerator/abstract_accelerator.py' 2025-08-31T04:51:04,312 adding 'deepspeed/accelerator/cpu_accelerator.py' 2025-08-31T04:51:04,314 adding 'deepspeed/accelerator/cuda_accelerator.py' 2025-08-31T04:51:04,316 adding 'deepspeed/accelerator/hpu_accelerator.py' 2025-08-31T04:51:04,317 adding 'deepspeed/accelerator/mlu_accelerator.py' 2025-08-31T04:51:04,319 adding 'deepspeed/accelerator/mps_accelerator.py' 2025-08-31T04:51:04,321 adding 'deepspeed/accelerator/npu_accelerator.py' 2025-08-31T04:51:04,323 adding 'deepspeed/accelerator/real_accelerator.py' 2025-08-31T04:51:04,325 adding 'deepspeed/accelerator/sdaa_accelerator.py' 2025-08-31T04:51:04,326 adding 'deepspeed/accelerator/xpu_accelerator.py' 2025-08-31T04:51:04,328 adding 'deepspeed/autotuning/__init__.py' 2025-08-31T04:51:04,333 adding 'deepspeed/autotuning/autotuner.py' 2025-08-31T04:51:04,335 adding 'deepspeed/autotuning/config.py' 2025-08-31T04:51:04,336 adding 'deepspeed/autotuning/constants.py' 2025-08-31T04:51:04,339 adding 'deepspeed/autotuning/scheduler.py' 2025-08-31T04:51:04,341 adding 'deepspeed/autotuning/utils.py' 2025-08-31T04:51:04,343 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2025-08-31T04:51:04,344 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2025-08-31T04:51:04,345 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2025-08-31T04:51:04,346 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2025-08-31T04:51:04,348 adding 'deepspeed/autotuning/tuner/__init__.py' 2025-08-31T04:51:04,349 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2025-08-31T04:51:04,350 adding 'deepspeed/autotuning/tuner/cost_model.py' 2025-08-31T04:51:04,351 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2025-08-31T04:51:04,353 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2025-08-31T04:51:04,354 adding 'deepspeed/autotuning/tuner/utils.py' 2025-08-31T04:51:04,356 adding 'deepspeed/checkpoint/__init__.py' 2025-08-31T04:51:04,358 adding 'deepspeed/checkpoint/constants.py' 2025-08-31T04:51:04,360 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2025-08-31T04:51:04,362 adding 'deepspeed/checkpoint/ds_to_universal.py' 2025-08-31T04:51:04,364 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2025-08-31T04:51:04,366 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2025-08-31T04:51:04,367 adding 'deepspeed/checkpoint/reshape_utils.py' 2025-08-31T04:51:04,369 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2025-08-31T04:51:04,370 adding 'deepspeed/checkpoint/utils.py' 2025-08-31T04:51:04,371 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2025-08-31T04:51:04,373 adding 'deepspeed/comm/__init__.py' 2025-08-31T04:51:04,375 adding 'deepspeed/comm/backend.py' 2025-08-31T04:51:04,376 adding 'deepspeed/comm/ccl.py' 2025-08-31T04:51:04,380 adding 'deepspeed/comm/comm.py' 2025-08-31T04:51:04,382 adding 'deepspeed/comm/config.py' 2025-08-31T04:51:04,383 adding 'deepspeed/comm/constants.py' 2025-08-31T04:51:04,384 adding 'deepspeed/comm/reduce_op.py' 2025-08-31T04:51:04,387 adding 'deepspeed/comm/torch.py' 2025-08-31T04:51:04,388 adding 'deepspeed/comm/utils.py' 2025-08-31T04:51:04,390 adding 'deepspeed/compile/__init__.py' 2025-08-31T04:51:04,392 adding 'deepspeed/compile/backend.py' 2025-08-31T04:51:04,393 adding 'deepspeed/compile/config.py' 2025-08-31T04:51:04,395 adding 'deepspeed/compile/fx.py' 2025-08-31T04:51:04,396 adding 'deepspeed/compile/graph_param.py' 2025-08-31T04:51:04,397 adding 'deepspeed/compile/inductor.py' 2025-08-31T04:51:04,399 adding 'deepspeed/compile/init_z1.py' 2025-08-31T04:51:04,400 adding 'deepspeed/compile/init_z3.py' 2025-08-31T04:51:04,401 adding 'deepspeed/compile/input_storage.py' 2025-08-31T04:51:04,404 adding 'deepspeed/compile/list_schedule.py' 2025-08-31T04:51:04,405 adding 'deepspeed/compile/partitioner.py' 2025-08-31T04:51:04,406 adding 'deepspeed/compile/patch_compiled_func.py' 2025-08-31T04:51:04,407 adding 'deepspeed/compile/patch_fake_tensor.py' 2025-08-31T04:51:04,410 adding 'deepspeed/compile/util.py' 2025-08-31T04:51:04,412 adding 'deepspeed/compile/passes/__init__.py' 2025-08-31T04:51:04,413 adding 'deepspeed/compile/passes/offload_activation.py' 2025-08-31T04:51:04,415 adding 'deepspeed/compile/passes/offload_adam_states.py' 2025-08-31T04:51:04,417 adding 'deepspeed/compile/passes/offload_parameters.py' 2025-08-31T04:51:04,418 adding 'deepspeed/compile/passes/prefetch.py' 2025-08-31T04:51:04,419 adding 'deepspeed/compile/passes/selective_gather.py' 2025-08-31T04:51:04,421 adding 'deepspeed/compile/passes/zero1_compile.py' 2025-08-31T04:51:04,422 adding 'deepspeed/compile/passes/zero3_compile.py' 2025-08-31T04:51:04,424 adding 'deepspeed/compile/profilers/__init__.py' 2025-08-31T04:51:04,425 adding 'deepspeed/compile/profilers/comm_profile.py' 2025-08-31T04:51:04,427 adding 'deepspeed/compile/profilers/graph_profile.py' 2025-08-31T04:51:04,429 adding 'deepspeed/compression/__init__.py' 2025-08-31T04:51:04,432 adding 'deepspeed/compression/basic_layer.py' 2025-08-31T04:51:04,434 adding 'deepspeed/compression/compress.py' 2025-08-31T04:51:04,436 adding 'deepspeed/compression/config.py' 2025-08-31T04:51:04,438 adding 'deepspeed/compression/constants.py' 2025-08-31T04:51:04,440 adding 'deepspeed/compression/helper.py' 2025-08-31T04:51:04,441 adding 'deepspeed/compression/scheduler.py' 2025-08-31T04:51:04,443 adding 'deepspeed/compression/utils.py' 2025-08-31T04:51:04,445 adding 'deepspeed/elasticity/__init__.py' 2025-08-31T04:51:04,446 adding 'deepspeed/elasticity/config.py' 2025-08-31T04:51:04,447 adding 'deepspeed/elasticity/constants.py' 2025-08-31T04:51:04,449 adding 'deepspeed/elasticity/elastic_agent.py' 2025-08-31T04:51:04,451 adding 'deepspeed/elasticity/elasticity.py' 2025-08-31T04:51:04,453 adding 'deepspeed/elasticity/utils.py' 2025-08-31T04:51:04,454 adding 'deepspeed/inference/__init__.py' 2025-08-31T04:51:04,456 adding 'deepspeed/inference/config.py' 2025-08-31T04:51:04,460 adding 'deepspeed/inference/engine.py' 2025-08-31T04:51:04,461 adding 'deepspeed/inference/quantization/__init__.py' 2025-08-31T04:51:04,463 adding 'deepspeed/inference/quantization/layers.py' 2025-08-31T04:51:04,464 adding 'deepspeed/inference/quantization/quantization.py' 2025-08-31T04:51:04,465 adding 'deepspeed/inference/quantization/quantization_context.py' 2025-08-31T04:51:04,467 adding 'deepspeed/inference/quantization/utils.py' 2025-08-31T04:51:04,469 adding 'deepspeed/inference/v2/__init__.py' 2025-08-31T04:51:04,470 adding 'deepspeed/inference/v2/allocator.py' 2025-08-31T04:51:04,472 adding 'deepspeed/inference/v2/config_v2.py' 2025-08-31T04:51:04,473 adding 'deepspeed/inference/v2/engine_factory.py' 2025-08-31T04:51:04,475 adding 'deepspeed/inference/v2/engine_v2.py' 2025-08-31T04:51:04,476 adding 'deepspeed/inference/v2/inference_parameter.py' 2025-08-31T04:51:04,478 adding 'deepspeed/inference/v2/inference_utils.py' 2025-08-31T04:51:04,479 adding 'deepspeed/inference/v2/logging.py' 2025-08-31T04:51:04,480 adding 'deepspeed/inference/v2/scheduling_utils.py' 2025-08-31T04:51:04,482 adding 'deepspeed/inference/v2/checkpoint/__init__.py' 2025-08-31T04:51:04,483 adding 'deepspeed/inference/v2/checkpoint/base_engine.py' 2025-08-31T04:51:04,484 adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py' 2025-08-31T04:51:04,486 adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py' 2025-08-31T04:51:04,487 adding 'deepspeed/inference/v2/kernels/__init__.py' 2025-08-31T04:51:04,488 adding 'deepspeed/inference/v2/kernels/ds_kernel.py' 2025-08-31T04:51:04,490 adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py' 2025-08-31T04:51:04,491 adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp' 2025-08-31T04:51:04,493 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py' 2025-08-31T04:51:04,494 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp' 2025-08-31T04:51:04,495 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h' 2025-08-31T04:51:04,497 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py' 2025-08-31T04:51:04,498 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu' 2025-08-31T04:51:04,500 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py' 2025-08-31T04:51:04,501 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h' 2025-08-31T04:51:04,502 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py' 2025-08-31T04:51:04,504 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h' 2025-08-31T04:51:04,506 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py' 2025-08-31T04:51:04,507 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py' 2025-08-31T04:51:04,508 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py' 2025-08-31T04:51:04,509 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py' 2025-08-31T04:51:04,511 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py' 2025-08-31T04:51:04,512 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp' 2025-08-31T04:51:04,513 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h' 2025-08-31T04:51:04,515 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu' 2025-08-31T04:51:04,517 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py' 2025-08-31T04:51:04,518 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py' 2025-08-31T04:51:04,520 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp' 2025-08-31T04:51:04,521 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h' 2025-08-31T04:51:04,523 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu' 2025-08-31T04:51:04,524 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h' 2025-08-31T04:51:04,527 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h' 2025-08-31T04:51:04,528 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh' 2025-08-31T04:51:04,530 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh' 2025-08-31T04:51:04,531 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh' 2025-08-31T04:51:04,533 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh' 2025-08-31T04:51:04,534 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh' 2025-08-31T04:51:04,536 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh' 2025-08-31T04:51:04,537 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh' 2025-08-31T04:51:04,539 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h' 2025-08-31T04:51:04,541 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py' 2025-08-31T04:51:04,542 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp' 2025-08-31T04:51:04,543 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h' 2025-08-31T04:51:04,544 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py' 2025-08-31T04:51:04,545 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py' 2025-08-31T04:51:04,547 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu' 2025-08-31T04:51:04,548 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py' 2025-08-31T04:51:04,550 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py' 2025-08-31T04:51:04,551 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py' 2025-08-31T04:51:04,552 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp' 2025-08-31T04:51:04,553 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h' 2025-08-31T04:51:04,555 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu' 2025-08-31T04:51:04,556 adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py' 2025-08-31T04:51:04,557 adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp' 2025-08-31T04:51:04,559 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py' 2025-08-31T04:51:04,561 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu' 2025-08-31T04:51:04,562 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h' 2025-08-31T04:51:04,563 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py' 2025-08-31T04:51:04,564 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h' 2025-08-31T04:51:04,566 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py' 2025-08-31T04:51:04,567 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py' 2025-08-31T04:51:04,569 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu' 2025-08-31T04:51:04,570 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h' 2025-08-31T04:51:04,571 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py' 2025-08-31T04:51:04,573 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h' 2025-08-31T04:51:04,574 adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h' 2025-08-31T04:51:04,576 adding 'deepspeed/inference/v2/kernels/includes/activation_type.h' 2025-08-31T04:51:04,578 adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h' 2025-08-31T04:51:04,579 adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h' 2025-08-31T04:51:04,581 adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h' 2025-08-31T04:51:04,584 adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h' 2025-08-31T04:51:04,586 adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py' 2025-08-31T04:51:04,587 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp' 2025-08-31T04:51:04,589 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py' 2025-08-31T04:51:04,590 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp' 2025-08-31T04:51:04,591 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h' 2025-08-31T04:51:04,593 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py' 2025-08-31T04:51:04,594 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py' 2025-08-31T04:51:04,596 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h' 2025-08-31T04:51:04,597 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp' 2025-08-31T04:51:04,598 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h' 2025-08-31T04:51:04,600 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py' 2025-08-31T04:51:04,601 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h' 2025-08-31T04:51:04,602 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py' 2025-08-31T04:51:04,604 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp' 2025-08-31T04:51:04,605 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh' 2025-08-31T04:51:04,606 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h' 2025-08-31T04:51:04,607 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py' 2025-08-31T04:51:04,609 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu' 2025-08-31T04:51:04,610 adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h' 2025-08-31T04:51:04,612 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py' 2025-08-31T04:51:04,614 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp' 2025-08-31T04:51:04,615 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh' 2025-08-31T04:51:04,616 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h' 2025-08-31T04:51:04,617 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py' 2025-08-31T04:51:04,620 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu' 2025-08-31T04:51:04,621 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py' 2025-08-31T04:51:04,622 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py' 2025-08-31T04:51:04,624 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py' 2025-08-31T04:51:04,626 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp' 2025-08-31T04:51:04,627 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh' 2025-08-31T04:51:04,628 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h' 2025-08-31T04:51:04,629 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py' 2025-08-31T04:51:04,631 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu' 2025-08-31T04:51:04,633 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py' 2025-08-31T04:51:04,634 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp' 2025-08-31T04:51:04,635 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh' 2025-08-31T04:51:04,637 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h' 2025-08-31T04:51:04,638 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py' 2025-08-31T04:51:04,640 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu' 2025-08-31T04:51:04,643 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py' 2025-08-31T04:51:04,646 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp' 2025-08-31T04:51:04,648 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh' 2025-08-31T04:51:04,649 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h' 2025-08-31T04:51:04,651 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py' 2025-08-31T04:51:04,653 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu' 2025-08-31T04:51:04,655 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h' 2025-08-31T04:51:04,656 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp' 2025-08-31T04:51:04,658 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h' 2025-08-31T04:51:04,661 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py' 2025-08-31T04:51:04,663 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp' 2025-08-31T04:51:04,664 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh' 2025-08-31T04:51:04,666 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h' 2025-08-31T04:51:04,668 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py' 2025-08-31T04:51:04,670 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu' 2025-08-31T04:51:04,672 adding 'deepspeed/inference/v2/model_implementations/__init__.py' 2025-08-31T04:51:04,674 adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py' 2025-08-31T04:51:04,677 adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py' 2025-08-31T04:51:04,679 adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py' 2025-08-31T04:51:04,682 adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py' 2025-08-31T04:51:04,685 adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py' 2025-08-31T04:51:04,687 adding 'deepspeed/inference/v2/model_implementations/parameter_base.py' 2025-08-31T04:51:04,690 adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py' 2025-08-31T04:51:04,691 adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py' 2025-08-31T04:51:04,693 adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py' 2025-08-31T04:51:04,695 adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py' 2025-08-31T04:51:04,697 adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py' 2025-08-31T04:51:04,698 adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py' 2025-08-31T04:51:04,700 adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py' 2025-08-31T04:51:04,702 adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py' 2025-08-31T04:51:04,704 adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py' 2025-08-31T04:51:04,707 adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py' 2025-08-31T04:51:04,708 adding 'deepspeed/inference/v2/model_implementations/falcon/container.py' 2025-08-31T04:51:04,710 adding 'deepspeed/inference/v2/model_implementations/falcon/model.py' 2025-08-31T04:51:04,712 adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py' 2025-08-31T04:51:04,713 adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py' 2025-08-31T04:51:04,715 adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py' 2025-08-31T04:51:04,716 adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py' 2025-08-31T04:51:04,718 adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py' 2025-08-31T04:51:04,719 adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py' 2025-08-31T04:51:04,721 adding 'deepspeed/inference/v2/model_implementations/mistral/container.py' 2025-08-31T04:51:04,722 adding 'deepspeed/inference/v2/model_implementations/mistral/model.py' 2025-08-31T04:51:04,724 adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py' 2025-08-31T04:51:04,726 adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py' 2025-08-31T04:51:04,727 adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py' 2025-08-31T04:51:04,729 adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py' 2025-08-31T04:51:04,730 adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py' 2025-08-31T04:51:04,732 adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py' 2025-08-31T04:51:04,733 adding 'deepspeed/inference/v2/model_implementations/opt/container.py' 2025-08-31T04:51:04,735 adding 'deepspeed/inference/v2/model_implementations/opt/model.py' 2025-08-31T04:51:04,736 adding 'deepspeed/inference/v2/model_implementations/opt/policy.py' 2025-08-31T04:51:04,738 adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py' 2025-08-31T04:51:04,739 adding 'deepspeed/inference/v2/model_implementations/phi/containers.py' 2025-08-31T04:51:04,741 adding 'deepspeed/inference/v2/model_implementations/phi/model.py' 2025-08-31T04:51:04,742 adding 'deepspeed/inference/v2/model_implementations/phi/policy.py' 2025-08-31T04:51:04,744 adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py' 2025-08-31T04:51:04,745 adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py' 2025-08-31T04:51:04,747 adding 'deepspeed/inference/v2/model_implementations/phi3/model.py' 2025-08-31T04:51:04,749 adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py' 2025-08-31T04:51:04,750 adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py' 2025-08-31T04:51:04,752 adding 'deepspeed/inference/v2/model_implementations/qwen/container.py' 2025-08-31T04:51:04,754 adding 'deepspeed/inference/v2/model_implementations/qwen/model.py' 2025-08-31T04:51:04,755 adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py' 2025-08-31T04:51:04,757 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py' 2025-08-31T04:51:04,758 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py' 2025-08-31T04:51:04,760 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py' 2025-08-31T04:51:04,761 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py' 2025-08-31T04:51:04,763 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py' 2025-08-31T04:51:04,765 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py' 2025-08-31T04:51:04,767 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py' 2025-08-31T04:51:04,768 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py' 2025-08-31T04:51:04,770 adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py' 2025-08-31T04:51:04,772 adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py' 2025-08-31T04:51:04,773 adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py' 2025-08-31T04:51:04,775 adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py' 2025-08-31T04:51:04,776 adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py' 2025-08-31T04:51:04,778 adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py' 2025-08-31T04:51:04,780 adding 'deepspeed/inference/v2/model_implementations/sharding/types.py' 2025-08-31T04:51:04,781 adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py' 2025-08-31T04:51:04,783 adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py' 2025-08-31T04:51:04,785 adding 'deepspeed/inference/v2/modules/__init__.py' 2025-08-31T04:51:04,786 adding 'deepspeed/inference/v2/modules/ds_module.py' 2025-08-31T04:51:04,788 adding 'deepspeed/inference/v2/modules/heuristics.py' 2025-08-31T04:51:04,789 adding 'deepspeed/inference/v2/modules/module_registry.py' 2025-08-31T04:51:04,791 adding 'deepspeed/inference/v2/modules/configs/__init__.py' 2025-08-31T04:51:04,792 adding 'deepspeed/inference/v2/modules/configs/attention_configs.py' 2025-08-31T04:51:04,794 adding 'deepspeed/inference/v2/modules/configs/embedding_config.py' 2025-08-31T04:51:04,795 adding 'deepspeed/inference/v2/modules/configs/linear_config.py' 2025-08-31T04:51:04,797 adding 'deepspeed/inference/v2/modules/configs/moe_config.py' 2025-08-31T04:51:04,798 adding 'deepspeed/inference/v2/modules/configs/norm_config.py' 2025-08-31T04:51:04,799 adding 'deepspeed/inference/v2/modules/configs/unembed_config.py' 2025-08-31T04:51:04,801 adding 'deepspeed/inference/v2/modules/implementations/__init__.py' 2025-08-31T04:51:04,803 adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py' 2025-08-31T04:51:04,805 adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py' 2025-08-31T04:51:04,806 adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py' 2025-08-31T04:51:04,808 adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py' 2025-08-31T04:51:04,810 adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py' 2025-08-31T04:51:04,811 adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py' 2025-08-31T04:51:04,813 adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py' 2025-08-31T04:51:04,815 adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py' 2025-08-31T04:51:04,817 adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py' 2025-08-31T04:51:04,819 adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py' 2025-08-31T04:51:04,820 adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py' 2025-08-31T04:51:04,822 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py' 2025-08-31T04:51:04,823 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py' 2025-08-31T04:51:04,825 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py' 2025-08-31T04:51:04,826 adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py' 2025-08-31T04:51:04,828 adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py' 2025-08-31T04:51:04,829 adding 'deepspeed/inference/v2/modules/interfaces/__init__.py' 2025-08-31T04:51:04,831 adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py' 2025-08-31T04:51:04,832 adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py' 2025-08-31T04:51:04,834 adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py' 2025-08-31T04:51:04,835 adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py' 2025-08-31T04:51:04,836 adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py' 2025-08-31T04:51:04,838 adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py' 2025-08-31T04:51:04,839 adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py' 2025-08-31T04:51:04,841 adding 'deepspeed/inference/v2/ragged/__init__.py' 2025-08-31T04:51:04,843 adding 'deepspeed/inference/v2/ragged/blocked_allocator.py' 2025-08-31T04:51:04,844 adding 'deepspeed/inference/v2/ragged/kv_cache.py' 2025-08-31T04:51:04,846 adding 'deepspeed/inference/v2/ragged/manager_configs.py' 2025-08-31T04:51:04,848 adding 'deepspeed/inference/v2/ragged/ragged_manager.py' 2025-08-31T04:51:04,850 adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py' 2025-08-31T04:51:04,852 adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py' 2025-08-31T04:51:04,854 adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu' 2025-08-31T04:51:04,855 adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp' 2025-08-31T04:51:04,857 adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h' 2025-08-31T04:51:04,859 adding 'deepspeed/io/__init__.py' 2025-08-31T04:51:04,860 adding 'deepspeed/io/base_file_writer.py' 2025-08-31T04:51:04,861 adding 'deepspeed/io/base_io_buffer.py' 2025-08-31T04:51:04,863 adding 'deepspeed/io/constants.py' 2025-08-31T04:51:04,864 adding 'deepspeed/io/double_io_buffer.py' 2025-08-31T04:51:04,866 adding 'deepspeed/io/fast_file_writer.py' 2025-08-31T04:51:04,867 adding 'deepspeed/io/mock_file_writer.py' 2025-08-31T04:51:04,869 adding 'deepspeed/io/py_file_writer.py' 2025-08-31T04:51:04,870 adding 'deepspeed/io/single_io_buffer.py' 2025-08-31T04:51:04,871 adding 'deepspeed/io/utils.py' 2025-08-31T04:51:04,873 adding 'deepspeed/launcher/__init__.py' 2025-08-31T04:51:04,874 adding 'deepspeed/launcher/constants.py' 2025-08-31T04:51:04,876 adding 'deepspeed/launcher/launch.py' 2025-08-31T04:51:04,878 adding 'deepspeed/launcher/launcher_helper.py' 2025-08-31T04:51:04,880 adding 'deepspeed/launcher/multinode_runner.py' 2025-08-31T04:51:04,883 adding 'deepspeed/launcher/runner.py' 2025-08-31T04:51:04,885 adding 'deepspeed/linear/__init__.py' 2025-08-31T04:51:04,886 adding 'deepspeed/linear/config.py' 2025-08-31T04:51:04,888 adding 'deepspeed/linear/context_manager.py' 2025-08-31T04:51:04,889 adding 'deepspeed/linear/optimized_linear.py' 2025-08-31T04:51:04,891 adding 'deepspeed/linear/quantization.py' 2025-08-31T04:51:04,893 adding 'deepspeed/model_implementations/__init__.py' 2025-08-31T04:51:04,894 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2025-08-31T04:51:04,896 adding 'deepspeed/model_implementations/diffusers/unet.py' 2025-08-31T04:51:04,897 adding 'deepspeed/model_implementations/diffusers/vae.py' 2025-08-31T04:51:04,899 adding 'deepspeed/model_implementations/features/__init__.py' 2025-08-31T04:51:04,900 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2025-08-31T04:51:04,902 adding 'deepspeed/model_implementations/transformers/__init__.py' 2025-08-31T04:51:04,903 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2025-08-31T04:51:04,905 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2025-08-31T04:51:04,906 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2025-08-31T04:51:04,907 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2025-08-31T04:51:04,908 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2025-08-31T04:51:04,910 adding 'deepspeed/model_implementations/transformers/ds_llama2.py' 2025-08-31T04:51:04,911 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2025-08-31T04:51:04,912 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2025-08-31T04:51:04,914 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2025-08-31T04:51:04,916 adding 'deepspeed/module_inject/__init__.py' 2025-08-31T04:51:04,918 adding 'deepspeed/module_inject/auto_tp.py' 2025-08-31T04:51:04,920 adding 'deepspeed/module_inject/auto_tp_model_utils.py' 2025-08-31T04:51:04,922 adding 'deepspeed/module_inject/fusedqkv_utils.py' 2025-08-31T04:51:04,924 adding 'deepspeed/module_inject/inject.py' 2025-08-31T04:51:04,927 adding 'deepspeed/module_inject/layers.py' 2025-08-31T04:51:04,929 adding 'deepspeed/module_inject/load_checkpoint.py' 2025-08-31T04:51:04,931 adding 'deepspeed/module_inject/module_quantize.py' 2025-08-31T04:51:04,932 adding 'deepspeed/module_inject/policy.py' 2025-08-31T04:51:04,936 adding 'deepspeed/module_inject/replace_module.py' 2025-08-31T04:51:04,938 adding 'deepspeed/module_inject/replace_policy.py' 2025-08-31T04:51:04,939 adding 'deepspeed/module_inject/tp_shard.py' 2025-08-31T04:51:04,941 adding 'deepspeed/module_inject/utils.py' 2025-08-31T04:51:04,943 adding 'deepspeed/module_inject/containers/__init__.py' 2025-08-31T04:51:04,945 adding 'deepspeed/module_inject/containers/base.py' 2025-08-31T04:51:04,946 adding 'deepspeed/module_inject/containers/base_moe.py' 2025-08-31T04:51:04,948 adding 'deepspeed/module_inject/containers/bert.py' 2025-08-31T04:51:04,950 adding 'deepspeed/module_inject/containers/bloom.py' 2025-08-31T04:51:04,951 adding 'deepspeed/module_inject/containers/clip.py' 2025-08-31T04:51:04,952 adding 'deepspeed/module_inject/containers/distil_bert.py' 2025-08-31T04:51:04,954 adding 'deepspeed/module_inject/containers/gpt2.py' 2025-08-31T04:51:04,955 adding 'deepspeed/module_inject/containers/gptj.py' 2025-08-31T04:51:04,957 adding 'deepspeed/module_inject/containers/gptneo.py' 2025-08-31T04:51:04,958 adding 'deepspeed/module_inject/containers/gptneox.py' 2025-08-31T04:51:04,960 adding 'deepspeed/module_inject/containers/internlm.py' 2025-08-31T04:51:04,962 adding 'deepspeed/module_inject/containers/llama.py' 2025-08-31T04:51:04,963 adding 'deepspeed/module_inject/containers/llama2.py' 2025-08-31T04:51:04,964 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2025-08-31T04:51:04,966 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2025-08-31T04:51:04,967 adding 'deepspeed/module_inject/containers/opt.py' 2025-08-31T04:51:04,969 adding 'deepspeed/module_inject/containers/unet.py' 2025-08-31T04:51:04,970 adding 'deepspeed/module_inject/containers/vae.py' 2025-08-31T04:51:04,972 adding 'deepspeed/module_inject/containers/features/__init__.py' 2025-08-31T04:51:04,973 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2025-08-31T04:51:04,975 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2025-08-31T04:51:04,976 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2025-08-31T04:51:04,977 adding 'deepspeed/module_inject/containers/features/megatron.py' 2025-08-31T04:51:04,979 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2025-08-31T04:51:04,980 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2025-08-31T04:51:04,982 adding 'deepspeed/moe/__init__.py' 2025-08-31T04:51:04,984 adding 'deepspeed/moe/experts.py' 2025-08-31T04:51:04,985 adding 'deepspeed/moe/layer.py' 2025-08-31T04:51:04,987 adding 'deepspeed/moe/mappings.py' 2025-08-31T04:51:04,990 adding 'deepspeed/moe/sharded_moe.py' 2025-08-31T04:51:04,991 adding 'deepspeed/moe/utils.py' 2025-08-31T04:51:04,993 adding 'deepspeed/monitor/__init__.py' 2025-08-31T04:51:04,995 adding 'deepspeed/monitor/comet.py' 2025-08-31T04:51:04,996 adding 'deepspeed/monitor/config.py' 2025-08-31T04:51:04,998 adding 'deepspeed/monitor/csv_monitor.py' 2025-08-31T04:51:04,999 adding 'deepspeed/monitor/monitor.py' 2025-08-31T04:51:05,000 adding 'deepspeed/monitor/tensorboard.py' 2025-08-31T04:51:05,002 adding 'deepspeed/monitor/utils.py' 2025-08-31T04:51:05,003 adding 'deepspeed/monitor/wandb.py' 2025-08-31T04:51:05,005 adding 'deepspeed/nebula/__init__.py' 2025-08-31T04:51:05,006 adding 'deepspeed/nebula/config.py' 2025-08-31T04:51:05,007 adding 'deepspeed/nebula/constants.py' 2025-08-31T04:51:05,009 adding 'deepspeed/nvme/__init__.py' 2025-08-31T04:51:05,011 adding 'deepspeed/nvme/ds_aio_args.py' 2025-08-31T04:51:05,012 adding 'deepspeed/nvme/ds_aio_basic.py' 2025-08-31T04:51:05,014 adding 'deepspeed/nvme/ds_aio_constants.py' 2025-08-31T04:51:05,015 adding 'deepspeed/nvme/ds_aio_handle.py' 2025-08-31T04:51:05,016 adding 'deepspeed/nvme/ds_aio_job.py' 2025-08-31T04:51:05,018 adding 'deepspeed/nvme/io_engine.py' 2025-08-31T04:51:05,019 adding 'deepspeed/nvme/parse_nvme_stats.py' 2025-08-31T04:51:05,021 adding 'deepspeed/nvme/perf_generate_param.py' 2025-08-31T04:51:05,022 adding 'deepspeed/nvme/perf_run_sweep.py' 2025-08-31T04:51:05,024 adding 'deepspeed/nvme/perf_sweep_utils.py' 2025-08-31T04:51:05,025 adding 'deepspeed/nvme/test_ds_aio.py' 2025-08-31T04:51:05,026 adding 'deepspeed/nvme/test_ds_aio_utils.py' 2025-08-31T04:51:05,028 adding 'deepspeed/nvme/torch_fastio_engine.py' 2025-08-31T04:51:05,029 adding 'deepspeed/nvme/torch_io.py' 2025-08-31T04:51:05,030 adding 'deepspeed/nvme/validate_async_io.py' 2025-08-31T04:51:05,032 adding 'deepspeed/ops/__init__.py' 2025-08-31T04:51:05,034 adding 'deepspeed/ops/adagrad/__init__.py' 2025-08-31T04:51:05,035 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2025-08-31T04:51:05,037 adding 'deepspeed/ops/adam/__init__.py' 2025-08-31T04:51:05,039 adding 'deepspeed/ops/adam/cpu_adam.py' 2025-08-31T04:51:05,041 adding 'deepspeed/ops/adam/fused_adam.py' 2025-08-31T04:51:05,042 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2025-08-31T04:51:05,044 adding 'deepspeed/ops/aio/__init__.py' 2025-08-31T04:51:05,045 adding 'deepspeed/ops/compile/__init__.py' 2025-08-31T04:51:05,048 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2025-08-31T04:51:05,050 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2025-08-31T04:51:05,051 adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp' 2025-08-31T04:51:05,052 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2025-08-31T04:51:05,054 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2025-08-31T04:51:05,055 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2025-08-31T04:51:05,058 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2025-08-31T04:51:05,059 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2025-08-31T04:51:05,060 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2025-08-31T04:51:05,061 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2025-08-31T04:51:05,063 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2025-08-31T04:51:05,064 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2025-08-31T04:51:05,066 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp' 2025-08-31T04:51:05,067 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h' 2025-08-31T04:51:05,068 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2025-08-31T04:51:05,070 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2025-08-31T04:51:05,071 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp' 2025-08-31T04:51:05,072 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h' 2025-08-31T04:51:05,073 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2025-08-31T04:51:05,074 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2025-08-31T04:51:05,076 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2025-08-31T04:51:05,077 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2025-08-31T04:51:05,078 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2025-08-31T04:51:05,079 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2025-08-31T04:51:05,081 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2025-08-31T04:51:05,082 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2025-08-31T04:51:05,084 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp' 2025-08-31T04:51:05,085 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h' 2025-08-31T04:51:05,087 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2025-08-31T04:51:05,088 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2025-08-31T04:51:05,091 adding 'deepspeed/ops/csrc/compile/deepcompile.cpp' 2025-08-31T04:51:05,092 adding 'deepspeed/ops/csrc/compile/init.cpp' 2025-08-31T04:51:05,093 adding 'deepspeed/ops/csrc/compile/util.cpp' 2025-08-31T04:51:05,095 adding 'deepspeed/ops/csrc/compile/z1.cpp' 2025-08-31T04:51:05,096 adding 'deepspeed/ops/csrc/compile/z1.h' 2025-08-31T04:51:05,097 adding 'deepspeed/ops/csrc/compile/z2.cpp' 2025-08-31T04:51:05,098 adding 'deepspeed/ops/csrc/compile/z2.h' 2025-08-31T04:51:05,101 adding 'deepspeed/ops/csrc/compile/z3.cpp' 2025-08-31T04:51:05,102 adding 'deepspeed/ops/csrc/compile/z3.h' 2025-08-31T04:51:05,104 adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp' 2025-08-31T04:51:05,107 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2025-08-31T04:51:05,110 adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp' 2025-08-31T04:51:05,111 adding 'deepspeed/ops/csrc/cpu/comm/shm.h' 2025-08-31T04:51:05,113 adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp' 2025-08-31T04:51:05,114 adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp' 2025-08-31T04:51:05,117 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp' 2025-08-31T04:51:05,118 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu' 2025-08-31T04:51:05,120 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu' 2025-08-31T04:51:05,122 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h' 2025-08-31T04:51:05,130 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h' 2025-08-31T04:51:05,135 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h' 2025-08-31T04:51:05,137 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h' 2025-08-31T04:51:05,139 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h' 2025-08-31T04:51:05,141 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h' 2025-08-31T04:51:05,143 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h' 2025-08-31T04:51:05,145 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h' 2025-08-31T04:51:05,148 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h' 2025-08-31T04:51:05,151 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h' 2025-08-31T04:51:05,153 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h' 2025-08-31T04:51:05,155 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h' 2025-08-31T04:51:05,156 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h' 2025-08-31T04:51:05,164 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h' 2025-08-31T04:51:05,167 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h' 2025-08-31T04:51:05,169 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h' 2025-08-31T04:51:05,173 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h' 2025-08-31T04:51:05,176 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h' 2025-08-31T04:51:05,180 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h' 2025-08-31T04:51:05,182 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h' 2025-08-31T04:51:05,184 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h' 2025-08-31T04:51:05,186 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h' 2025-08-31T04:51:05,187 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h' 2025-08-31T04:51:05,189 adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp' 2025-08-31T04:51:05,192 adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu' 2025-08-31T04:51:05,194 adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h' 2025-08-31T04:51:05,195 adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h' 2025-08-31T04:51:05,198 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp' 2025-08-31T04:51:05,199 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h' 2025-08-31T04:51:05,200 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h' 2025-08-31T04:51:05,202 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp' 2025-08-31T04:51:05,203 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h' 2025-08-31T04:51:05,205 adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp' 2025-08-31T04:51:05,207 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2025-08-31T04:51:05,208 adding 'deepspeed/ops/csrc/includes/Timer.h' 2025-08-31T04:51:05,209 adding 'deepspeed/ops/csrc/includes/activation_type.h' 2025-08-31T04:51:05,210 adding 'deepspeed/ops/csrc/includes/compat.h' 2025-08-31T04:51:05,212 adding 'deepspeed/ops/csrc/includes/context.h' 2025-08-31T04:51:05,214 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2025-08-31T04:51:05,215 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2025-08-31T04:51:05,217 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2025-08-31T04:51:05,218 adding 'deepspeed/ops/csrc/includes/cpu_lion.h' 2025-08-31T04:51:05,220 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2025-08-31T04:51:05,221 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2025-08-31T04:51:05,224 adding 'deepspeed/ops/csrc/includes/deepcompile.h' 2025-08-31T04:51:05,225 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2025-08-31T04:51:05,227 adding 'deepspeed/ops/csrc/includes/dropout.h' 2025-08-31T04:51:05,228 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2025-08-31T04:51:05,229 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2025-08-31T04:51:05,230 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2025-08-31T04:51:05,232 adding 'deepspeed/ops/csrc/includes/gelu.h' 2025-08-31T04:51:05,233 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2025-08-31T04:51:05,234 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2025-08-31T04:51:05,237 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2025-08-31T04:51:05,238 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2025-08-31T04:51:05,240 adding 'deepspeed/ops/csrc/includes/quantization.h' 2025-08-31T04:51:05,242 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2025-08-31T04:51:05,243 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2025-08-31T04:51:05,246 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2025-08-31T04:51:05,247 adding 'deepspeed/ops/csrc/includes/simd.h' 2025-08-31T04:51:05,249 adding 'deepspeed/ops/csrc/includes/softmax.h' 2025-08-31T04:51:05,250 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2025-08-31T04:51:05,251 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2025-08-31T04:51:05,253 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2025-08-31T04:51:05,255 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2025-08-31T04:51:05,257 adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp' 2025-08-31T04:51:05,258 adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp' 2025-08-31T04:51:05,260 adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp' 2025-08-31T04:51:05,261 adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh' 2025-08-31T04:51:05,263 adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu' 2025-08-31T04:51:05,265 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2025-08-31T04:51:05,267 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2025-08-31T04:51:05,269 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2025-08-31T04:51:05,272 adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu' 2025-08-31T04:51:05,273 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2025-08-31T04:51:05,275 adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu' 2025-08-31T04:51:05,277 adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu' 2025-08-31T04:51:05,279 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2025-08-31T04:51:05,280 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2025-08-31T04:51:05,282 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2025-08-31T04:51:05,283 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2025-08-31T04:51:05,285 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2025-08-31T04:51:05,288 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2025-08-31T04:51:05,289 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2025-08-31T04:51:05,291 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2025-08-31T04:51:05,293 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2025-08-31T04:51:05,296 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2025-08-31T04:51:05,300 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2025-08-31T04:51:05,302 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2025-08-31T04:51:05,304 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2025-08-31T04:51:05,308 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2025-08-31T04:51:05,311 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2025-08-31T04:51:05,314 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2025-08-31T04:51:05,316 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2025-08-31T04:51:05,318 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2025-08-31T04:51:05,321 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2025-08-31T04:51:05,323 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2025-08-31T04:51:05,325 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2025-08-31T04:51:05,331 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2025-08-31T04:51:05,333 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2025-08-31T04:51:05,334 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2025-08-31T04:51:05,337 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2025-08-31T04:51:05,340 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2025-08-31T04:51:05,343 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2025-08-31T04:51:05,345 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2025-08-31T04:51:05,346 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2025-08-31T04:51:05,348 adding 'deepspeed/ops/csrc/utils/py_ds_utils.cpp' 2025-08-31T04:51:05,349 adding 'deepspeed/ops/csrc/utils/tensor_cast.cpp' 2025-08-31T04:51:05,351 adding 'deepspeed/ops/csrc/utils/tensor_cast.h' 2025-08-31T04:51:05,354 adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp' 2025-08-31T04:51:05,356 adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp' 2025-08-31T04:51:05,358 adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp' 2025-08-31T04:51:05,359 adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp' 2025-08-31T04:51:05,361 adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp' 2025-08-31T04:51:05,363 adding 'deepspeed/ops/csrc/xpu/includes/compat.h' 2025-08-31T04:51:05,365 adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h' 2025-08-31T04:51:05,367 adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h' 2025-08-31T04:51:05,368 adding 'deepspeed/ops/csrc/xpu/includes/simd.h' 2025-08-31T04:51:05,370 adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h' 2025-08-31T04:51:05,372 adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp' 2025-08-31T04:51:05,373 adding 'deepspeed/ops/deepspeed4science/__init__.py' 2025-08-31T04:51:05,375 adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py' 2025-08-31T04:51:05,376 adding 'deepspeed/ops/fp_quantizer/__init__.py' 2025-08-31T04:51:05,378 adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py' 2025-08-31T04:51:05,379 adding 'deepspeed/ops/fp_quantizer/fp8_gemm_triton.py' 2025-08-31T04:51:05,381 adding 'deepspeed/ops/fp_quantizer/quantize.py' 2025-08-31T04:51:05,382 adding 'deepspeed/ops/gds/__init__.py' 2025-08-31T04:51:05,384 adding 'deepspeed/ops/lamb/__init__.py' 2025-08-31T04:51:05,386 adding 'deepspeed/ops/lamb/fused_lamb.py' 2025-08-31T04:51:05,387 adding 'deepspeed/ops/lion/__init__.py' 2025-08-31T04:51:05,389 adding 'deepspeed/ops/lion/cpu_lion.py' 2025-08-31T04:51:05,390 adding 'deepspeed/ops/lion/fused_lion.py' 2025-08-31T04:51:05,392 adding 'deepspeed/ops/lion/multi_tensor_apply.py' 2025-08-31T04:51:05,394 adding 'deepspeed/ops/op_builder/__init__.py' 2025-08-31T04:51:05,396 adding 'deepspeed/ops/op_builder/all_ops.py' 2025-08-31T04:51:05,397 adding 'deepspeed/ops/op_builder/async_io.py' 2025-08-31T04:51:05,401 adding 'deepspeed/ops/op_builder/builder.py' 2025-08-31T04:51:05,403 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2025-08-31T04:51:05,404 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2025-08-31T04:51:05,405 adding 'deepspeed/ops/op_builder/cpu_lion.py' 2025-08-31T04:51:05,407 adding 'deepspeed/ops/op_builder/dc.py' 2025-08-31T04:51:05,408 adding 'deepspeed/ops/op_builder/evoformer_attn.py' 2025-08-31T04:51:05,410 adding 'deepspeed/ops/op_builder/fp_quantizer.py' 2025-08-31T04:51:05,411 adding 'deepspeed/ops/op_builder/fused_adam.py' 2025-08-31T04:51:05,413 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2025-08-31T04:51:05,414 adding 'deepspeed/ops/op_builder/fused_lion.py' 2025-08-31T04:51:05,415 adding 'deepspeed/ops/op_builder/gds.py' 2025-08-31T04:51:05,416 adding 'deepspeed/ops/op_builder/inference_core_ops.py' 2025-08-31T04:51:05,418 adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py' 2025-08-31T04:51:05,419 adding 'deepspeed/ops/op_builder/quantizer.py' 2025-08-31T04:51:05,420 adding 'deepspeed/ops/op_builder/ragged_ops.py' 2025-08-31T04:51:05,421 adding 'deepspeed/ops/op_builder/ragged_utils.py' 2025-08-31T04:51:05,423 adding 'deepspeed/ops/op_builder/random_ltd.py' 2025-08-31T04:51:05,424 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2025-08-31T04:51:05,425 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2025-08-31T04:51:05,427 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2025-08-31T04:51:05,428 adding 'deepspeed/ops/op_builder/transformer.py' 2025-08-31T04:51:05,429 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2025-08-31T04:51:05,430 adding 'deepspeed/ops/op_builder/utils.py' 2025-08-31T04:51:05,432 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2025-08-31T04:51:05,434 adding 'deepspeed/ops/op_builder/cpu/async_io.py' 2025-08-31T04:51:05,435 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2025-08-31T04:51:05,436 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2025-08-31T04:51:05,437 adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py' 2025-08-31T04:51:05,438 adding 'deepspeed/ops/op_builder/cpu/fused_adam.py' 2025-08-31T04:51:05,440 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2025-08-31T04:51:05,441 adding 'deepspeed/ops/op_builder/hpu/__init__.py' 2025-08-31T04:51:05,443 adding 'deepspeed/ops/op_builder/hpu/builder.py' 2025-08-31T04:51:05,444 adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py' 2025-08-31T04:51:05,445 adding 'deepspeed/ops/op_builder/hpu/fp_quantizer.py' 2025-08-31T04:51:05,447 adding 'deepspeed/ops/op_builder/hpu/fused_adam.py' 2025-08-31T04:51:05,448 adding 'deepspeed/ops/op_builder/hpu/no_impl.py' 2025-08-31T04:51:05,449 adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py' 2025-08-31T04:51:05,451 adding 'deepspeed/ops/op_builder/mlu/__init__.py' 2025-08-31T04:51:05,453 adding 'deepspeed/ops/op_builder/mlu/builder.py' 2025-08-31T04:51:05,454 adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py' 2025-08-31T04:51:05,455 adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py' 2025-08-31T04:51:05,456 adding 'deepspeed/ops/op_builder/mlu/fused_adam.py' 2025-08-31T04:51:05,457 adding 'deepspeed/ops/op_builder/mlu/no_impl.py' 2025-08-31T04:51:05,459 adding 'deepspeed/ops/op_builder/npu/__init__.py' 2025-08-31T04:51:05,461 adding 'deepspeed/ops/op_builder/npu/async_io.py' 2025-08-31T04:51:05,462 adding 'deepspeed/ops/op_builder/npu/builder.py' 2025-08-31T04:51:05,463 adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py' 2025-08-31T04:51:05,464 adding 'deepspeed/ops/op_builder/npu/cpu_adam.py' 2025-08-31T04:51:05,466 adding 'deepspeed/ops/op_builder/npu/cpu_lion.py' 2025-08-31T04:51:05,467 adding 'deepspeed/ops/op_builder/npu/fused_adam.py' 2025-08-31T04:51:05,469 adding 'deepspeed/ops/op_builder/npu/inference.py' 2025-08-31T04:51:05,470 adding 'deepspeed/ops/op_builder/npu/no_impl.py' 2025-08-31T04:51:05,472 adding 'deepspeed/ops/op_builder/sdaa/__init__.py' 2025-08-31T04:51:05,474 adding 'deepspeed/ops/op_builder/sdaa/builder.py' 2025-08-31T04:51:05,475 adding 'deepspeed/ops/op_builder/sdaa/cpu_adam.py' 2025-08-31T04:51:05,476 adding 'deepspeed/ops/op_builder/sdaa/fused_adam.py' 2025-08-31T04:51:05,478 adding 'deepspeed/ops/op_builder/sdaa/no_impl.py' 2025-08-31T04:51:05,480 adding 'deepspeed/ops/op_builder/xpu/__init__.py' 2025-08-31T04:51:05,481 adding 'deepspeed/ops/op_builder/xpu/async_io.py' 2025-08-31T04:51:05,483 adding 'deepspeed/ops/op_builder/xpu/builder.py' 2025-08-31T04:51:05,484 adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py' 2025-08-31T04:51:05,485 adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py' 2025-08-31T04:51:05,486 adding 'deepspeed/ops/op_builder/xpu/flash_attn.py' 2025-08-31T04:51:05,487 adding 'deepspeed/ops/op_builder/xpu/fused_adam.py' 2025-08-31T04:51:05,488 adding 'deepspeed/ops/op_builder/xpu/inference.py' 2025-08-31T04:51:05,490 adding 'deepspeed/ops/op_builder/xpu/no_impl.py' 2025-08-31T04:51:05,491 adding 'deepspeed/ops/op_builder/xpu/packbits.py' 2025-08-31T04:51:05,492 adding 'deepspeed/ops/quantizer/__init__.py' 2025-08-31T04:51:05,494 adding 'deepspeed/ops/quantizer/quantizer.py' 2025-08-31T04:51:05,495 adding 'deepspeed/ops/random_ltd/__init__.py' 2025-08-31T04:51:05,496 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2025-08-31T04:51:05,498 adding 'deepspeed/ops/sparse_attention/__init__.py' 2025-08-31T04:51:05,499 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2025-08-31T04:51:05,503 adding 'deepspeed/ops/sparse_attention/matmul.py' 2025-08-31T04:51:05,505 adding 'deepspeed/ops/sparse_attention/softmax.py' 2025-08-31T04:51:05,507 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2025-08-31T04:51:05,509 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2025-08-31T04:51:05,512 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2025-08-31T04:51:05,514 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2025-08-31T04:51:05,515 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2025-08-31T04:51:05,517 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2025-08-31T04:51:05,518 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2025-08-31T04:51:05,520 adding 'deepspeed/ops/transformer/__init__.py' 2025-08-31T04:51:05,522 adding 'deepspeed/ops/transformer/transformer.py' 2025-08-31T04:51:05,524 adding 'deepspeed/ops/transformer/inference/__init__.py' 2025-08-31T04:51:05,526 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2025-08-31T04:51:05,527 adding 'deepspeed/ops/transformer/inference/config.py' 2025-08-31T04:51:05,528 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2025-08-31T04:51:05,530 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2025-08-31T04:51:05,532 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2025-08-31T04:51:05,534 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2025-08-31T04:51:05,536 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2025-08-31T04:51:05,538 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2025-08-31T04:51:05,539 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2025-08-31T04:51:05,541 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2025-08-31T04:51:05,543 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2025-08-31T04:51:05,544 adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py' 2025-08-31T04:51:05,545 adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py' 2025-08-31T04:51:05,546 adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py' 2025-08-31T04:51:05,548 adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py' 2025-08-31T04:51:05,549 adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py' 2025-08-31T04:51:05,550 adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py' 2025-08-31T04:51:05,552 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2025-08-31T04:51:05,553 adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py' 2025-08-31T04:51:05,554 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2025-08-31T04:51:05,556 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2025-08-31T04:51:05,557 adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py' 2025-08-31T04:51:05,558 adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py' 2025-08-31T04:51:05,559 adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py' 2025-08-31T04:51:05,561 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2025-08-31T04:51:05,562 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2025-08-31T04:51:05,563 adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py' 2025-08-31T04:51:05,565 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2025-08-31T04:51:05,566 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2025-08-31T04:51:05,567 adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py' 2025-08-31T04:51:05,568 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2025-08-31T04:51:05,570 adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py' 2025-08-31T04:51:05,572 adding 'deepspeed/ops/transformer/inference/triton/__init__.py' 2025-08-31T04:51:05,574 adding 'deepspeed/ops/transformer/inference/triton/attention.py' 2025-08-31T04:51:05,575 adding 'deepspeed/ops/transformer/inference/triton/gelu.py' 2025-08-31T04:51:05,577 adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py' 2025-08-31T04:51:05,579 adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py' 2025-08-31T04:51:05,580 adding 'deepspeed/ops/transformer/inference/triton/mlp.py' 2025-08-31T04:51:05,582 adding 'deepspeed/ops/transformer/inference/triton/ops.py' 2025-08-31T04:51:05,583 adding 'deepspeed/ops/transformer/inference/triton/residual_add.py' 2025-08-31T04:51:05,584 adding 'deepspeed/ops/transformer/inference/triton/softmax.py' 2025-08-31T04:51:05,586 adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py' 2025-08-31T04:51:05,588 adding 'deepspeed/pipe/__init__.py' 2025-08-31T04:51:05,589 adding 'deepspeed/profiling/__init__.py' 2025-08-31T04:51:05,591 adding 'deepspeed/profiling/config.py' 2025-08-31T04:51:05,592 adding 'deepspeed/profiling/constants.py' 2025-08-31T04:51:05,594 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2025-08-31T04:51:05,599 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2025-08-31T04:51:05,601 adding 'deepspeed/runtime/__init__.py' 2025-08-31T04:51:05,603 adding 'deepspeed/runtime/base_optimizer.py' 2025-08-31T04:51:05,606 adding 'deepspeed/runtime/bf16_optimizer.py' 2025-08-31T04:51:05,607 adding 'deepspeed/runtime/compiler.py' 2025-08-31T04:51:05,611 adding 'deepspeed/runtime/config.py' 2025-08-31T04:51:05,613 adding 'deepspeed/runtime/config_utils.py' 2025-08-31T04:51:05,616 adding 'deepspeed/runtime/constants.py' 2025-08-31T04:51:05,617 adding 'deepspeed/runtime/dataloader.py' 2025-08-31T04:51:05,619 adding 'deepspeed/runtime/eigenvalue.py' 2025-08-31T04:51:05,639 adding 'deepspeed/runtime/engine.py' 2025-08-31T04:51:05,643 adding 'deepspeed/runtime/hybrid_engine.py' 2025-08-31T04:51:05,647 adding 'deepspeed/runtime/lr_schedules.py' 2025-08-31T04:51:05,648 adding 'deepspeed/runtime/precision_config.py' 2025-08-31T04:51:05,650 adding 'deepspeed/runtime/progressive_layer_drop.py' 2025-08-31T04:51:05,651 adding 'deepspeed/runtime/quantize.py' 2025-08-31T04:51:05,653 adding 'deepspeed/runtime/sparse_tensor.py' 2025-08-31T04:51:05,655 adding 'deepspeed/runtime/state_dict_factory.py' 2025-08-31T04:51:05,657 adding 'deepspeed/runtime/torch_autocast.py' 2025-08-31T04:51:05,662 adding 'deepspeed/runtime/utils.py' 2025-08-31T04:51:05,664 adding 'deepspeed/runtime/weight_quantizer.py' 2025-08-31T04:51:05,665 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2025-08-31T04:51:05,670 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2025-08-31T04:51:05,672 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2025-08-31T04:51:05,674 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2025-08-31T04:51:05,675 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2025-08-31T04:51:05,677 adding 'deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py' 2025-08-31T04:51:05,678 adding 'deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py' 2025-08-31T04:51:05,679 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2025-08-31T04:51:05,680 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2025-08-31T04:51:05,682 adding 'deepspeed/runtime/checkpoint_engine/utils.py' 2025-08-31T04:51:05,683 adding 'deepspeed/runtime/comm/__init__.py' 2025-08-31T04:51:05,685 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2025-08-31T04:51:05,686 adding 'deepspeed/runtime/comm/compressed.py' 2025-08-31T04:51:05,688 adding 'deepspeed/runtime/comm/hccl.py' 2025-08-31T04:51:05,689 adding 'deepspeed/runtime/comm/mpi.py' 2025-08-31T04:51:05,691 adding 'deepspeed/runtime/comm/nccl.py' 2025-08-31T04:51:05,692 adding 'deepspeed/runtime/compression/__init__.py' 2025-08-31T04:51:05,694 adding 'deepspeed/runtime/compression/cupy.py' 2025-08-31T04:51:05,695 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2025-08-31T04:51:05,697 adding 'deepspeed/runtime/data_pipeline/config.py' 2025-08-31T04:51:05,698 adding 'deepspeed/runtime/data_pipeline/constants.py' 2025-08-31T04:51:05,699 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2025-08-31T04:51:05,701 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2025-08-31T04:51:05,703 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2025-08-31T04:51:05,704 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2025-08-31T04:51:05,705 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2025-08-31T04:51:05,706 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2025-08-31T04:51:05,708 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2025-08-31T04:51:05,713 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2025-08-31T04:51:05,716 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2025-08-31T04:51:05,719 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2025-08-31T04:51:05,720 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2025-08-31T04:51:05,723 adding 'deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py' 2025-08-31T04:51:05,725 adding 'deepspeed/runtime/domino/__init__.py' 2025-08-31T04:51:05,727 adding 'deepspeed/runtime/domino/async_linear.py' 2025-08-31T04:51:05,729 adding 'deepspeed/runtime/domino/transformer.py' 2025-08-31T04:51:05,731 adding 'deepspeed/runtime/fp16/__init__.py' 2025-08-31T04:51:05,734 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2025-08-31T04:51:05,736 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2025-08-31T04:51:05,738 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2025-08-31T04:51:05,740 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2025-08-31T04:51:05,742 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2025-08-31T04:51:05,745 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2025-08-31T04:51:05,748 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2025-08-31T04:51:05,749 adding 'deepspeed/runtime/model_checkpointing/__init__.py' 2025-08-31T04:51:05,751 adding 'deepspeed/runtime/model_checkpointing/config.py' 2025-08-31T04:51:05,752 adding 'deepspeed/runtime/model_checkpointing/constants.py' 2025-08-31T04:51:05,754 adding 'deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py' 2025-08-31T04:51:05,755 adding 'deepspeed/runtime/model_checkpointing/utils.py' 2025-08-31T04:51:05,757 adding 'deepspeed/runtime/model_checkpointing/writer_factory.py' 2025-08-31T04:51:05,758 adding 'deepspeed/runtime/pipe/__init__.py' 2025-08-31T04:51:05,765 adding 'deepspeed/runtime/pipe/engine.py' 2025-08-31T04:51:05,769 adding 'deepspeed/runtime/pipe/module.py' 2025-08-31T04:51:05,771 adding 'deepspeed/runtime/pipe/p2p.py' 2025-08-31T04:51:05,773 adding 'deepspeed/runtime/pipe/schedule.py' 2025-08-31T04:51:05,776 adding 'deepspeed/runtime/pipe/topology.py' 2025-08-31T04:51:05,778 adding 'deepspeed/runtime/sequence_parallel/__init__.py' 2025-08-31T04:51:05,779 adding 'deepspeed/runtime/sequence_parallel/parallel_state_sp.py' 2025-08-31T04:51:05,786 adding 'deepspeed/runtime/sequence_parallel/ulysses_sp.py' 2025-08-31T04:51:05,788 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2025-08-31T04:51:05,789 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2025-08-31T04:51:05,791 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2025-08-31T04:51:05,792 adding 'deepspeed/runtime/swap_tensor/constants.py' 2025-08-31T04:51:05,795 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2025-08-31T04:51:05,796 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2025-08-31T04:51:05,799 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2025-08-31T04:51:05,801 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2025-08-31T04:51:05,802 adding 'deepspeed/runtime/swap_tensor/utils.py' 2025-08-31T04:51:05,804 adding 'deepspeed/runtime/tensor_parallel/__init__.py' 2025-08-31T04:51:05,806 adding 'deepspeed/runtime/tensor_parallel/config.py' 2025-08-31T04:51:05,807 adding 'deepspeed/runtime/tensor_parallel/tp_manager.py' 2025-08-31T04:51:05,809 adding 'deepspeed/runtime/zero/__init__.py' 2025-08-31T04:51:05,811 adding 'deepspeed/runtime/zero/config.py' 2025-08-31T04:51:05,813 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2025-08-31T04:51:05,815 adding 'deepspeed/runtime/zero/linear.py' 2025-08-31T04:51:05,817 adding 'deepspeed/runtime/zero/mics.py' 2025-08-31T04:51:05,819 adding 'deepspeed/runtime/zero/mics_utils.py' 2025-08-31T04:51:05,820 adding 'deepspeed/runtime/zero/offload_config.py' 2025-08-31T04:51:05,822 adding 'deepspeed/runtime/zero/offload_states.py' 2025-08-31T04:51:05,825 adding 'deepspeed/runtime/zero/parameter_offload.py' 2025-08-31T04:51:05,837 adding 'deepspeed/runtime/zero/partition_parameters.py' 2025-08-31T04:51:05,841 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2025-08-31T04:51:05,842 adding 'deepspeed/runtime/zero/partitioned_param_profiler.py' 2025-08-31T04:51:05,859 adding 'deepspeed/runtime/zero/stage3.py' 2025-08-31T04:51:05,873 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2025-08-31T04:51:05,875 adding 'deepspeed/runtime/zero/test.py' 2025-08-31T04:51:05,877 adding 'deepspeed/runtime/zero/tiling.py' 2025-08-31T04:51:05,879 adding 'deepspeed/runtime/zero/utils.py' 2025-08-31T04:51:05,881 adding 'deepspeed/sequence/__init__.py' 2025-08-31T04:51:05,882 adding 'deepspeed/sequence/cross_entropy.py' 2025-08-31T04:51:05,886 adding 'deepspeed/sequence/fpdt_layer.py' 2025-08-31T04:51:05,889 adding 'deepspeed/sequence/layer.py' 2025-08-31T04:51:05,891 adding 'deepspeed/utils/__init__.py' 2025-08-31T04:51:05,893 adding 'deepspeed/utils/bwc.py' 2025-08-31T04:51:05,895 adding 'deepspeed/utils/comms_logging.py' 2025-08-31T04:51:05,896 adding 'deepspeed/utils/config.py' 2025-08-31T04:51:05,898 adding 'deepspeed/utils/debug.py' 2025-08-31T04:51:05,899 adding 'deepspeed/utils/exceptions.py' 2025-08-31T04:51:05,903 adding 'deepspeed/utils/groups.py' 2025-08-31T04:51:05,904 adding 'deepspeed/utils/init_on_device.py' 2025-08-31T04:51:05,906 adding 'deepspeed/utils/logging.py' 2025-08-31T04:51:05,907 adding 'deepspeed/utils/mixed_precision_linkage.py' 2025-08-31T04:51:05,909 adding 'deepspeed/utils/numa.py' 2025-08-31T04:51:05,910 adding 'deepspeed/utils/nvtx.py' 2025-08-31T04:51:05,912 adding 'deepspeed/utils/tensor_fragment.py' 2025-08-31T04:51:05,914 adding 'deepspeed/utils/timer.py' 2025-08-31T04:51:05,915 adding 'deepspeed/utils/torch.py' 2025-08-31T04:51:05,916 adding 'deepspeed/utils/types.py' 2025-08-31T04:51:05,918 adding 'deepspeed/utils/z3_leaf_module.py' 2025-08-31T04:51:05,921 adding 'deepspeed/utils/zero_to_fp32.py' 2025-08-31T04:51:05,924 adding 'deepspeed-0.17.4.data/scripts/deepspeed' 2025-08-31T04:51:05,925 adding 'deepspeed-0.17.4.data/scripts/deepspeed.pt' 2025-08-31T04:51:05,926 adding 'deepspeed-0.17.4.data/scripts/ds' 2025-08-31T04:51:05,927 adding 'deepspeed-0.17.4.data/scripts/ds_bench' 2025-08-31T04:51:05,928 adding 'deepspeed-0.17.4.data/scripts/ds_elastic' 2025-08-31T04:51:05,930 adding 'deepspeed-0.17.4.data/scripts/ds_io' 2025-08-31T04:51:05,931 adding 'deepspeed-0.17.4.data/scripts/ds_nvme_tune' 2025-08-31T04:51:05,932 adding 'deepspeed-0.17.4.data/scripts/ds_report' 2025-08-31T04:51:05,933 adding 'deepspeed-0.17.4.data/scripts/ds_ssh' 2025-08-31T04:51:05,934 adding 'deepspeed-0.17.4.data/scripts/dsr' 2025-08-31T04:51:05,937 adding 'deepspeed-0.17.4.dist-info/licenses/LICENSE' 2025-08-31T04:51:05,942 adding 'deepspeed-0.17.4.dist-info/METADATA' 2025-08-31T04:51:05,943 adding 'deepspeed-0.17.4.dist-info/WHEEL' 2025-08-31T04:51:05,944 adding 'deepspeed-0.17.4.dist-info/entry_points.txt' 2025-08-31T04:51:05,945 adding 'deepspeed-0.17.4.dist-info/top_level.txt' 2025-08-31T04:51:05,960 adding 'deepspeed-0.17.4.dist-info/RECORD' 2025-08-31T04:51:05,995 removing build/bdist.linux-armv7l/wheel 2025-08-31T04:51:06,224 deepspeed build time = 11.960093021392822 secs 2025-08-31T04:51:06,352 Building wheel for deepspeed (setup.py): finished with status 'done' 2025-08-31T04:51:06,371 Created wheel for deepspeed: filename=deepspeed-0.17.4-py3-none-any.whl size=1705715 sha256=b1edf8e83c0a6ebc2db69bde686b7a07864f60f5960b31b794b4a1676f3cea11 2025-08-31T04:51:06,373 Stored in directory: /tmp/pip-ephem-wheel-cache-es298r37/wheels/fb/74/10/268a3379c5063d2f94681b8aa3bd4bf9c5bdaf3ba1736f35b2 2025-08-31T04:51:06,419 Successfully built deepspeed 2025-08-31T04:51:06,464 Removed build tracker: '/tmp/pip-build-tracker-wvik5ri8'