2023-12-01T20:49:23,119 Created temporary directory: /tmp/pip-build-tracker-ii2xzll0 2023-12-01T20:49:23,120 Initialized build tracking at /tmp/pip-build-tracker-ii2xzll0 2023-12-01T20:49:23,121 Created build tracker: /tmp/pip-build-tracker-ii2xzll0 2023-12-01T20:49:23,121 Entered build tracker: /tmp/pip-build-tracker-ii2xzll0 2023-12-01T20:49:23,122 Created temporary directory: /tmp/pip-wheel-hkmmtxq_ 2023-12-01T20:49:23,126 Created temporary directory: /tmp/pip-ephem-wheel-cache-t7bqfgwb 2023-12-01T20:49:23,150 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-12-01T20:49:23,153 2 location(s) to search for versions of deepspeed: 2023-12-01T20:49:23,153 * https://pypi.org/simple/deepspeed/ 2023-12-01T20:49:23,153 * https://www.piwheels.org/simple/deepspeed/ 2023-12-01T20:49:23,154 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2023-12-01T20:49:23,155 Getting page https://pypi.org/simple/deepspeed/ 2023-12-01T20:49:23,157 Found index url https://pypi.org/simple/ 2023-12-01T20:49:23,379 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2023-12-01T20:49:23,406 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-12-01T20:49:23,407 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2023-12-01T20:49:23,408 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-12-01T20:49:23,409 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2023-12-01T20:49:23,410 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-12-01T20:49:23,412 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2023-12-01T20:49:23,413 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-12-01T20:49:23,414 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2023-12-01T20:49:23,415 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-12-01T20:49:23,416 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2023-12-01T20:49:23,417 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2023-12-01T20:49:23,418 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2023-12-01T20:49:23,419 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2023-12-01T20:49:23,421 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2023-12-01T20:49:23,422 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2023-12-01T20:49:23,423 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2023-12-01T20:49:23,424 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2023-12-01T20:49:23,425 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2023-12-01T20:49:23,426 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2023-12-01T20:49:23,427 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2023-12-01T20:49:23,428 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2023-12-01T20:49:23,429 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2023-12-01T20:49:23,430 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2023-12-01T20:49:23,431 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2023-12-01T20:49:23,433 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2023-12-01T20:49:23,434 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2023-12-01T20:49:23,435 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2023-12-01T20:49:23,436 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2023-12-01T20:49:23,438 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2023-12-01T20:49:23,439 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2023-12-01T20:49:23,440 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2023-12-01T20:49:23,441 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2023-12-01T20:49:23,442 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2023-12-01T20:49:23,443 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2023-12-01T20:49:23,444 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2023-12-01T20:49:23,445 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2023-12-01T20:49:23,446 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2023-12-01T20:49:23,447 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2023-12-01T20:49:23,448 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2023-12-01T20:49:23,449 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2023-12-01T20:49:23,450 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2023-12-01T20:49:23,451 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2023-12-01T20:49:23,452 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2023-12-01T20:49:23,453 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2023-12-01T20:49:23,455 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2023-12-01T20:49:23,456 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2023-12-01T20:49:23,457 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2023-12-01T20:49:23,458 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2023-12-01T20:49:23,459 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2023-12-01T20:49:23,460 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2023-12-01T20:49:23,461 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2023-12-01T20:49:23,463 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2023-12-01T20:49:23,464 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2023-12-01T20:49:23,465 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2023-12-01T20:49:23,465 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2023-12-01T20:49:23,467 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2023-12-01T20:49:23,468 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2023-12-01T20:49:23,468 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2023-12-01T20:49:23,469 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2023-12-01T20:49:23,471 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2023-12-01T20:49:23,472 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2023-12-01T20:49:23,473 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2023-12-01T20:49:23,474 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2023-12-01T20:49:23,475 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2023-12-01T20:49:23,476 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2023-12-01T20:49:23,477 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2023-12-01T20:49:23,478 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2023-12-01T20:49:23,478 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2023-12-01T20:49:23,480 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2023-12-01T20:49:23,480 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2023-12-01T20:49:23,481 Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5 2023-12-01T20:49:23,481 Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0 2023-12-01T20:49:23,482 Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1 2023-12-01T20:49:23,482 Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2 2023-12-01T20:49:23,483 Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3 2023-12-01T20:49:23,484 Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0 2023-12-01T20:49:23,484 Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1 2023-12-01T20:49:23,485 Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2 2023-12-01T20:49:23,486 Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0 2023-12-01T20:49:23,487 Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1 2023-12-01T20:49:23,487 Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2 2023-12-01T20:49:23,488 Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3 2023-12-01T20:49:23,489 Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4 2023-12-01T20:49:23,490 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2023-12-01T20:49:23,490 Getting page https://www.piwheels.org/simple/deepspeed/ 2023-12-01T20:49:23,492 Found index url https://www.piwheels.org/simple/ 2023-12-01T20:49:23,648 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2023-12-01T20:49:23,662 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,663 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,663 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,664 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,664 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,665 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,665 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,666 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,667 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,667 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,668 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,669 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,669 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,670 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,670 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,671 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,672 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,672 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,673 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,673 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,674 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,674 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,675 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,675 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,676 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,676 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,677 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,678 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,678 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,679 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,679 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,680 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,681 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,681 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,682 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,682 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,683 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,683 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,684 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,684 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,685 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,686 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,686 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,687 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,687 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,688 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,689 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,689 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,690 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,690 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,691 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,691 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,692 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2023-12-01T20:49:23,692 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2023-12-01T20:49:23,693 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2023-12-01T20:49:23,722 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2023-12-01T20:49:23,742 Collecting deepspeed==0.12.4 2023-12-01T20:49:23,744 Created temporary directory: /tmp/pip-unpack-3kbcsyr3 2023-12-01T20:49:23,956 Downloading deepspeed-0.12.4.tar.gz (1.2 MB) 2023-12-01T20:49:26,211 Added deepspeed==0.12.4 from https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz to build tracker '/tmp/pip-build-tracker-ii2xzll0' 2023-12-01T20:49:26,213 Running setup.py (path:/tmp/pip-wheel-hkmmtxq_/deepspeed_6cd3e5373e01433981f62b5b115c9990/setup.py) egg_info for package deepspeed 2023-12-01T20:49:26,214 Created temporary directory: /tmp/pip-pip-egg-info-dtpme8t6 2023-12-01T20:49:26,215 Preparing metadata (setup.py): started 2023-12-01T20:49:26,216 Running command python setup.py egg_info 2023-12-01T20:49:27,108 fatal: not a git repository (or any of the parent directories): .git 2023-12-01T20:49:27,793 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-12-01T20:49:27,794  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-12-01T20:49:27,795 DS_BUILD_OPS=0 2023-12-01T20:49:27,795  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-12-01T20:49:27,796  [WARNING]  async_io: please install the libaio-dev package with apt 2023-12-01T20:49:27,796  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-12-01T20:49:27,797  [WARNING]  Please install torch if trying to pre-compile kernels 2023-12-01T20:49:27,798  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-01T20:49:27,798  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-01T20:49:27,799  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-01T20:49:27,799  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-01T20:49:27,800  [WARNING]  unable to import torch, please install it first 2023-12-01T20:49:27,801  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-01T20:49:27,801  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-01T20:49:27,802 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-12-01T20:49:27,802 version=0.12.4, git_hash=unknown, git_branch=unknown 2023-12-01T20:49:27,803 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm'] 2023-12-01T20:49:27,803 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False} 2023-12-01T20:49:27,804 ext_modules=[] 2023-12-01T20:49:27,805 running egg_info 2023-12-01T20:49:27,805 creating /tmp/pip-pip-egg-info-dtpme8t6/deepspeed.egg-info 2023-12-01T20:49:27,827 writing /tmp/pip-pip-egg-info-dtpme8t6/deepspeed.egg-info/PKG-INFO 2023-12-01T20:49:27,860 writing dependency_links to /tmp/pip-pip-egg-info-dtpme8t6/deepspeed.egg-info/dependency_links.txt 2023-12-01T20:49:27,862 writing entry points to /tmp/pip-pip-egg-info-dtpme8t6/deepspeed.egg-info/entry_points.txt 2023-12-01T20:49:27,877 writing requirements to /tmp/pip-pip-egg-info-dtpme8t6/deepspeed.egg-info/requires.txt 2023-12-01T20:49:27,879 writing top-level names to /tmp/pip-pip-egg-info-dtpme8t6/deepspeed.egg-info/top_level.txt 2023-12-01T20:49:27,881 writing manifest file '/tmp/pip-pip-egg-info-dtpme8t6/deepspeed.egg-info/SOURCES.txt' 2023-12-01T20:49:28,090 reading manifest file '/tmp/pip-pip-egg-info-dtpme8t6/deepspeed.egg-info/SOURCES.txt' 2023-12-01T20:49:28,092 reading manifest template 'MANIFEST.in' 2023-12-01T20:49:28,094 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2023-12-01T20:49:28,094 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2023-12-01T20:49:29,244 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-12-01T20:49:30,080 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-12-01T20:49:30,578 warning: no files found matching '*.tr' under directory 'csrc' 2023-12-01T20:49:30,686 warning: no files found matching '*.cc' under directory 'csrc' 2023-12-01T20:49:30,713 warning: no files found matching '*.py' under directory 'benchmarks' 2023-12-01T20:49:30,747 writing manifest file '/tmp/pip-pip-egg-info-dtpme8t6/deepspeed.egg-info/SOURCES.txt' 2023-12-01T20:49:30,750 deepspeed build time = 3.637788772583008 secs 2023-12-01T20:49:30,865 Preparing metadata (setup.py): finished with status 'done' 2023-12-01T20:49:30,871 Source in /tmp/pip-wheel-hkmmtxq_/deepspeed_6cd3e5373e01433981f62b5b115c9990 has version 0.12.4, which satisfies requirement deepspeed==0.12.4 from https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz 2023-12-01T20:49:30,872 Removed deepspeed==0.12.4 from https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz from build tracker '/tmp/pip-build-tracker-ii2xzll0' 2023-12-01T20:49:30,881 Created temporary directory: /tmp/pip-unpack-3cxd4m1t 2023-12-01T20:49:30,882 Created temporary directory: /tmp/pip-unpack-sbdxa_27 2023-12-01T20:49:31,124 Building wheels for collected packages: deepspeed 2023-12-01T20:49:31,129 Created temporary directory: /tmp/pip-wheel-cxfrttmp 2023-12-01T20:49:31,129 Building wheel for deepspeed (setup.py): started 2023-12-01T20:49:31,131 Destination directory: /tmp/pip-wheel-cxfrttmp 2023-12-01T20:49:31,131 Running command python setup.py bdist_wheel 2023-12-01T20:49:31,578 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-12-01T20:49:31,586  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-12-01T20:49:31,650 DS_BUILD_OPS=0 2023-12-01T20:49:31,766  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-12-01T20:49:31,826  [WARNING]  async_io: please install the libaio-dev package with apt 2023-12-01T20:49:31,826  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-12-01T20:49:31,827  [WARNING]  Please install torch if trying to pre-compile kernels 2023-12-01T20:49:31,828  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-01T20:49:31,829  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-01T20:49:31,829  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-01T20:49:31,830  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-01T20:49:31,831  [WARNING]  unable to import torch, please install it first 2023-12-01T20:49:31,832  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-01T20:49:31,832  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-01T20:49:31,833 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-12-01T20:49:31,842 fatal: not a git repository (or any of the parent directories): .git 2023-12-01T20:49:31,844 version=0.12.4, git_hash=unknown, git_branch=unknown 2023-12-01T20:49:31,845 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm'] 2023-12-01T20:49:31,846 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False} 2023-12-01T20:49:31,847 ext_modules=[] 2023-12-01T20:49:32,495 running bdist_wheel 2023-12-01T20:49:32,599 running build 2023-12-01T20:49:32,600 running build_py 2023-12-01T20:49:32,628 creating build 2023-12-01T20:49:32,629 creating build/lib 2023-12-01T20:49:32,630 creating build/lib/deepspeed 2023-12-01T20:49:32,631 copying deepspeed/pydantic_v1.py -> build/lib/deepspeed 2023-12-01T20:49:32,633 copying deepspeed/__init__.py -> build/lib/deepspeed 2023-12-01T20:49:32,636 copying deepspeed/env_report.py -> build/lib/deepspeed 2023-12-01T20:49:32,638 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2023-12-01T20:49:32,639 copying deepspeed/constants.py -> build/lib/deepspeed 2023-12-01T20:49:32,641 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2023-12-01T20:49:32,644 creating build/lib/deepspeed/module_inject 2023-12-01T20:49:32,645 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2023-12-01T20:49:32,647 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2023-12-01T20:49:32,649 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2023-12-01T20:49:32,651 copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject 2023-12-01T20:49:32,654 copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject 2023-12-01T20:49:32,656 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2023-12-01T20:49:32,657 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2023-12-01T20:49:32,660 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2023-12-01T20:49:32,662 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2023-12-01T20:49:32,664 copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject 2023-12-01T20:49:32,666 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2023-12-01T20:49:32,669 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2023-12-01T20:49:32,671 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2023-12-01T20:49:32,674 creating build/lib/deepspeed/accelerator 2023-12-01T20:49:32,675 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2023-12-01T20:49:32,677 copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator 2023-12-01T20:49:32,679 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2023-12-01T20:49:32,681 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2023-12-01T20:49:32,683 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2023-12-01T20:49:32,686 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2023-12-01T20:49:32,688 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2023-12-01T20:49:32,692 creating build/lib/deepspeed/monitor 2023-12-01T20:49:32,693 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2023-12-01T20:49:32,695 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2023-12-01T20:49:32,697 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2023-12-01T20:49:32,698 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2023-12-01T20:49:32,700 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2023-12-01T20:49:32,702 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2023-12-01T20:49:32,704 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2023-12-01T20:49:32,707 creating build/lib/deepspeed/utils 2023-12-01T20:49:32,708 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2023-12-01T20:49:32,710 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2023-12-01T20:49:32,712 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2023-12-01T20:49:32,714 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2023-12-01T20:49:32,716 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2023-12-01T20:49:32,718 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2023-12-01T20:49:32,720 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2023-12-01T20:49:32,721 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2023-12-01T20:49:32,724 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2023-12-01T20:49:32,726 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2023-12-01T20:49:32,728 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2023-12-01T20:49:32,730 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2023-12-01T20:49:32,732 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2023-12-01T20:49:32,735 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2023-12-01T20:49:32,737 creating build/lib/deepspeed/pipe 2023-12-01T20:49:32,738 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2023-12-01T20:49:32,740 creating build/lib/deepspeed/compression 2023-12-01T20:49:32,741 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2023-12-01T20:49:32,744 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2023-12-01T20:49:32,745 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2023-12-01T20:49:32,748 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2023-12-01T20:49:32,750 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2023-12-01T20:49:32,753 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2023-12-01T20:49:32,756 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2023-12-01T20:49:32,758 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2023-12-01T20:49:32,761 creating build/lib/deepspeed/moe 2023-12-01T20:49:32,762 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2023-12-01T20:49:32,764 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2023-12-01T20:49:32,767 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2023-12-01T20:49:32,768 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2023-12-01T20:49:32,771 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2023-12-01T20:49:32,772 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2023-12-01T20:49:32,775 creating build/lib/deepspeed/launcher 2023-12-01T20:49:32,776 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2023-12-01T20:49:32,778 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2023-12-01T20:49:32,781 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2023-12-01T20:49:32,783 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2023-12-01T20:49:32,786 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2023-12-01T20:49:32,788 creating build/lib/deepspeed/checkpoint 2023-12-01T20:49:32,789 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-12-01T20:49:32,792 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2023-12-01T20:49:32,794 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2023-12-01T20:49:32,796 copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint 2023-12-01T20:49:32,799 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2023-12-01T20:49:32,801 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-12-01T20:49:32,803 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2023-12-01T20:49:32,805 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-12-01T20:49:32,807 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2023-12-01T20:49:32,809 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2023-12-01T20:49:32,811 creating build/lib/deepspeed/ops 2023-12-01T20:49:32,812 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2023-12-01T20:49:32,815 creating build/lib/deepspeed/nebula 2023-12-01T20:49:32,816 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2023-12-01T20:49:32,817 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2023-12-01T20:49:32,819 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2023-12-01T20:49:32,822 creating build/lib/deepspeed/inference 2023-12-01T20:49:32,822 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2023-12-01T20:49:32,824 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2023-12-01T20:49:32,827 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2023-12-01T20:49:32,830 creating build/lib/deepspeed/runtime 2023-12-01T20:49:32,831 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2023-12-01T20:49:32,834 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2023-12-01T20:49:32,835 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2023-12-01T20:49:32,838 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2023-12-01T20:49:32,841 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2023-12-01T20:49:32,844 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2023-12-01T20:49:32,846 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2023-12-01T20:49:32,849 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2023-12-01T20:49:32,851 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2023-12-01T20:49:32,856 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2023-12-01T20:49:32,859 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2023-12-01T20:49:32,861 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2023-12-01T20:49:32,864 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2023-12-01T20:49:32,866 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2023-12-01T20:49:32,868 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2023-12-01T20:49:32,871 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2023-12-01T20:49:32,874 creating build/lib/deepspeed/profiling 2023-12-01T20:49:32,874 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2023-12-01T20:49:32,876 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2023-12-01T20:49:32,878 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2023-12-01T20:49:32,881 creating build/lib/deepspeed/comm 2023-12-01T20:49:32,882 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2023-12-01T20:49:32,885 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2023-12-01T20:49:32,887 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2023-12-01T20:49:32,889 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2023-12-01T20:49:32,891 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2023-12-01T20:49:32,893 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2023-12-01T20:49:32,896 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2023-12-01T20:49:32,898 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2023-12-01T20:49:32,900 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2023-12-01T20:49:32,903 creating build/lib/deepspeed/model_implementations 2023-12-01T20:49:32,904 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2023-12-01T20:49:32,906 creating build/lib/deepspeed/autotuning 2023-12-01T20:49:32,907 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2023-12-01T20:49:32,910 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2023-12-01T20:49:32,913 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2023-12-01T20:49:32,915 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2023-12-01T20:49:32,917 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2023-12-01T20:49:32,920 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2023-12-01T20:49:32,922 creating build/lib/deepspeed/sequence 2023-12-01T20:49:32,923 copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence 2023-12-01T20:49:32,925 copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence 2023-12-01T20:49:32,928 creating build/lib/deepspeed/elasticity 2023-12-01T20:49:32,929 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2023-12-01T20:49:32,930 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2023-12-01T20:49:32,933 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2023-12-01T20:49:32,935 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2023-12-01T20:49:32,937 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2023-12-01T20:49:32,939 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2023-12-01T20:49:32,942 creating build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,942 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,945 copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,947 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,949 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,951 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,953 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,955 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,957 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,960 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,962 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,964 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,966 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,968 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,970 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,972 copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,975 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,977 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,979 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,981 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2023-12-01T20:49:32,984 creating build/lib/deepspeed/module_inject/containers/features 2023-12-01T20:49:32,985 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2023-12-01T20:49:32,987 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2023-12-01T20:49:32,988 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2023-12-01T20:49:32,991 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2023-12-01T20:49:32,993 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-12-01T20:49:32,995 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2023-12-01T20:49:32,997 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-12-01T20:49:33,000 creating build/lib/deepspeed/ops/lion 2023-12-01T20:49:33,001 copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion 2023-12-01T20:49:33,003 copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion 2023-12-01T20:49:33,005 copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion 2023-12-01T20:49:33,007 copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion 2023-12-01T20:49:33,010 creating build/lib/deepspeed/ops/random_ltd 2023-12-01T20:49:33,011 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2023-12-01T20:49:33,013 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2023-12-01T20:49:33,016 creating build/lib/deepspeed/ops/adam 2023-12-01T20:49:33,017 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2023-12-01T20:49:33,019 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2023-12-01T20:49:33,021 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2023-12-01T20:49:33,023 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2023-12-01T20:49:33,026 creating build/lib/deepspeed/ops/quantizer 2023-12-01T20:49:33,027 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2023-12-01T20:49:33,029 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2023-12-01T20:49:33,032 creating build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,033 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,035 copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,037 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,039 copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,041 copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,043 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,045 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,047 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,049 copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,051 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,053 copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,054 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,056 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,059 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,061 copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,063 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,064 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,066 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,068 copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,070 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,072 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,074 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2023-12-01T20:49:33,076 creating build/lib/deepspeed/ops/lamb 2023-12-01T20:49:33,077 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2023-12-01T20:49:33,079 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2023-12-01T20:49:33,082 creating build/lib/deepspeed/ops/sparse_attention 2023-12-01T20:49:33,083 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2023-12-01T20:49:33,085 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2023-12-01T20:49:33,087 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2023-12-01T20:49:33,090 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-12-01T20:49:33,092 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-12-01T20:49:33,094 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2023-12-01T20:49:33,097 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2023-12-01T20:49:33,101 creating build/lib/deepspeed/ops/deepspeed4science 2023-12-01T20:49:33,102 copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science 2023-12-01T20:49:33,104 copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science 2023-12-01T20:49:33,107 creating build/lib/deepspeed/ops/adagrad 2023-12-01T20:49:33,107 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2023-12-01T20:49:33,109 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2023-12-01T20:49:33,112 creating build/lib/deepspeed/ops/aio 2023-12-01T20:49:33,113 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2023-12-01T20:49:33,116 creating build/lib/deepspeed/ops/transformer 2023-12-01T20:49:33,117 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2023-12-01T20:49:33,119 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2023-12-01T20:49:33,123 creating build/lib/deepspeed/ops/op_builder/npu 2023-12-01T20:49:33,123 copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu 2023-12-01T20:49:33,126 copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu 2023-12-01T20:49:33,128 copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2023-12-01T20:49:33,130 copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu 2023-12-01T20:49:33,132 copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2023-12-01T20:49:33,135 copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu 2023-12-01T20:49:33,137 copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu 2023-12-01T20:49:33,139 creating build/lib/deepspeed/ops/op_builder/cpu 2023-12-01T20:49:33,140 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-12-01T20:49:33,142 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-12-01T20:49:33,144 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-12-01T20:49:33,146 copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-12-01T20:49:33,148 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-12-01T20:49:33,150 copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-12-01T20:49:33,153 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2023-12-01T20:49:33,154 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-12-01T20:49:33,156 creating build/lib/deepspeed/ops/transformer/inference 2023-12-01T20:49:33,157 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-01T20:49:33,159 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-01T20:49:33,161 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-01T20:49:33,164 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-01T20:49:33,165 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-01T20:49:33,168 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-01T20:49:33,170 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-01T20:49:33,172 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-01T20:49:33,175 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-01T20:49:33,178 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-01T20:49:33,181 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:33,182 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:33,184 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:33,187 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:33,189 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:33,191 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:33,193 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:33,195 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:33,197 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:33,198 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:33,201 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:33,203 creating build/lib/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:33,204 copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:33,207 copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:33,209 copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:33,211 copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:33,213 copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:33,216 copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:33,218 copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:33,221 copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:33,223 copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:33,226 copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:33,229 creating build/lib/deepspeed/inference/v2 2023-12-01T20:49:33,230 copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2 2023-12-01T20:49:33,232 copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2 2023-12-01T20:49:33,234 copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2 2023-12-01T20:49:33,236 copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2 2023-12-01T20:49:33,238 copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2 2023-12-01T20:49:33,240 copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2 2023-12-01T20:49:33,242 copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2 2023-12-01T20:49:33,244 copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2 2023-12-01T20:49:33,246 copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2 2023-12-01T20:49:33,248 creating build/lib/deepspeed/inference/quantization 2023-12-01T20:49:33,250 copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization 2023-12-01T20:49:33,252 copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization 2023-12-01T20:49:33,254 copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization 2023-12-01T20:49:33,257 copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization 2023-12-01T20:49:33,260 copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization 2023-12-01T20:49:33,262 creating build/lib/deepspeed/inference/v2/ragged 2023-12-01T20:49:33,264 copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged 2023-12-01T20:49:33,266 copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged 2023-12-01T20:49:33,268 copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged 2023-12-01T20:49:33,271 copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged 2023-12-01T20:49:33,273 copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged 2023-12-01T20:49:33,276 copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged 2023-12-01T20:49:33,279 copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged 2023-12-01T20:49:33,282 creating build/lib/deepspeed/inference/v2/checkpoint 2023-12-01T20:49:33,283 copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-12-01T20:49:33,285 copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-12-01T20:49:33,287 copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-12-01T20:49:33,289 copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-12-01T20:49:33,292 creating build/lib/deepspeed/inference/v2/model_implementations 2023-12-01T20:49:33,293 copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-12-01T20:49:33,296 copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-12-01T20:49:33,298 copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-12-01T20:49:33,300 copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-12-01T20:49:33,303 copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-12-01T20:49:33,306 copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-12-01T20:49:33,308 copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-12-01T20:49:33,311 creating build/lib/deepspeed/inference/v2/modules 2023-12-01T20:49:33,312 copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules 2023-12-01T20:49:33,314 copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules 2023-12-01T20:49:33,316 copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules 2023-12-01T20:49:33,318 copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules 2023-12-01T20:49:33,322 creating build/lib/deepspeed/inference/v2/kernels 2023-12-01T20:49:33,323 copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels 2023-12-01T20:49:33,325 copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels 2023-12-01T20:49:33,328 creating build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-12-01T20:49:33,329 copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-12-01T20:49:33,331 copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-12-01T20:49:33,333 copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-12-01T20:49:33,335 copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-12-01T20:49:33,339 creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:33,340 copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:33,342 copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:33,344 copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:33,346 copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:33,348 copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:33,350 copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:33,352 copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:33,354 copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:33,356 copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:33,358 creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-01T20:49:33,359 copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-01T20:49:33,361 copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-01T20:49:33,363 copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-01T20:49:33,366 copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-01T20:49:33,369 creating build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:33,370 copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:33,372 copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:33,374 copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:33,376 copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:33,378 copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:33,380 copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:33,382 copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:33,385 copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:33,387 copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:33,390 creating build/lib/deepspeed/inference/v2/model_implementations/opt 2023-12-01T20:49:33,391 copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-12-01T20:49:33,393 copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-12-01T20:49:33,395 copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-12-01T20:49:33,397 copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-12-01T20:49:33,400 creating build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:33,401 copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:33,403 copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:33,405 copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:33,407 copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:33,409 copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:33,411 copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:33,413 copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:33,415 copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:33,418 creating build/lib/deepspeed/inference/v2/modules/implementations 2023-12-01T20:49:33,419 copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations 2023-12-01T20:49:33,422 creating build/lib/deepspeed/inference/v2/modules/configs 2023-12-01T20:49:33,423 copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-12-01T20:49:33,425 copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-12-01T20:49:33,427 copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-12-01T20:49:33,429 copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-12-01T20:49:33,431 copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-12-01T20:49:33,433 copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-12-01T20:49:33,436 copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-12-01T20:49:33,438 creating build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-12-01T20:49:33,439 copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-12-01T20:49:33,441 copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-12-01T20:49:33,444 creating build/lib/deepspeed/inference/v2/modules/implementations/unembed 2023-12-01T20:49:33,445 copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2023-12-01T20:49:33,447 copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2023-12-01T20:49:33,451 creating build/lib/deepspeed/inference/v2/modules/implementations/embedding 2023-12-01T20:49:33,452 copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2023-12-01T20:49:33,454 copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2023-12-01T20:49:33,456 creating build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-12-01T20:49:33,457 copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-12-01T20:49:33,459 copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-12-01T20:49:33,462 creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2023-12-01T20:49:33,463 copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2023-12-01T20:49:33,466 copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2023-12-01T20:49:33,468 creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-12-01T20:49:33,469 copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-12-01T20:49:33,471 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-12-01T20:49:33,474 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-12-01T20:49:33,476 creating build/lib/deepspeed/inference/v2/modules/implementations/attention 2023-12-01T20:49:33,477 copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2023-12-01T20:49:33,479 copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2023-12-01T20:49:33,483 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2023-12-01T20:49:33,484 copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2023-12-01T20:49:33,486 creating build/lib/deepspeed/inference/v2/kernels/core_ops 2023-12-01T20:49:33,487 copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops 2023-12-01T20:49:33,490 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops 2023-12-01T20:49:33,491 copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2023-12-01T20:49:33,494 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-01T20:49:33,495 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-01T20:49:33,497 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-01T20:49:33,499 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-01T20:49:33,501 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-01T20:49:33,503 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-01T20:49:33,505 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-01T20:49:33,508 creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-01T20:49:33,509 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-01T20:49:33,511 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-01T20:49:33,513 creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-01T20:49:33,514 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-01T20:49:33,516 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-01T20:49:33,519 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:33,520 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:33,522 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:33,524 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:33,526 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:33,528 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:33,531 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-01T20:49:33,532 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-01T20:49:33,534 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-01T20:49:33,536 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-01T20:49:33,538 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-01T20:49:33,541 creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-01T20:49:33,542 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-01T20:49:33,544 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-01T20:49:33,546 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-01T20:49:33,547 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-01T20:49:33,549 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-01T20:49:33,552 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-01T20:49:33,553 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-01T20:49:33,555 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-01T20:49:33,558 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-01T20:49:33,559 copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-01T20:49:33,561 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-01T20:49:33,564 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:33,565 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:33,567 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:33,569 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:33,571 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:33,573 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-01T20:49:33,574 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-01T20:49:33,576 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-01T20:49:33,580 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-01T20:49:33,581 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-01T20:49:33,583 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-01T20:49:33,587 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-01T20:49:33,588 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-01T20:49:33,590 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-01T20:49:33,594 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-01T20:49:33,595 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-01T20:49:33,598 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-01T20:49:33,601 creating build/lib/deepspeed/runtime/fp16 2023-12-01T20:49:33,603 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-12-01T20:49:33,606 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2023-12-01T20:49:33,609 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2023-12-01T20:49:33,612 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-12-01T20:49:33,617 creating build/lib/deepspeed/runtime/pipe 2023-12-01T20:49:33,618 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2023-12-01T20:49:33,621 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2023-12-01T20:49:33,624 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2023-12-01T20:49:33,627 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2023-12-01T20:49:33,631 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2023-12-01T20:49:33,635 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2023-12-01T20:49:33,640 creating build/lib/deepspeed/runtime/checkpoint_engine 2023-12-01T20:49:33,642 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-12-01T20:49:33,645 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-12-01T20:49:33,648 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-12-01T20:49:33,651 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-12-01T20:49:33,655 creating build/lib/deepspeed/runtime/data_pipeline 2023-12-01T20:49:33,657 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2023-12-01T20:49:33,660 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2023-12-01T20:49:33,664 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2023-12-01T20:49:33,667 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2023-12-01T20:49:33,672 creating build/lib/deepspeed/runtime/compression 2023-12-01T20:49:33,674 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2023-12-01T20:49:33,677 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2023-12-01T20:49:33,681 creating build/lib/deepspeed/runtime/swap_tensor 2023-12-01T20:49:33,683 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-01T20:49:33,687 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-01T20:49:33,690 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-01T20:49:33,693 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-01T20:49:33,697 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-01T20:49:33,700 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-01T20:49:33,705 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-01T20:49:33,708 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-01T20:49:33,711 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-01T20:49:33,716 creating build/lib/deepspeed/runtime/activation_checkpointing 2023-12-01T20:49:33,718 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-12-01T20:49:33,721 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-12-01T20:49:33,726 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-12-01T20:49:33,729 creating build/lib/deepspeed/runtime/comm 2023-12-01T20:49:33,731 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2023-12-01T20:49:33,734 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2023-12-01T20:49:33,738 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2023-12-01T20:49:33,742 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2023-12-01T20:49:33,746 creating build/lib/deepspeed/runtime/zero 2023-12-01T20:49:33,748 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2023-12-01T20:49:33,750 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2023-12-01T20:49:33,753 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2023-12-01T20:49:33,756 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2023-12-01T20:49:33,762 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2023-12-01T20:49:33,765 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2023-12-01T20:49:33,768 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2023-12-01T20:49:33,771 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2023-12-01T20:49:33,774 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2023-12-01T20:49:33,780 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2023-12-01T20:49:33,782 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2023-12-01T20:49:33,785 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2023-12-01T20:49:33,787 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2023-12-01T20:49:33,790 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2023-12-01T20:49:33,792 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2023-12-01T20:49:33,797 copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero 2023-12-01T20:49:33,800 creating build/lib/deepspeed/runtime/fp16/onebit 2023-12-01T20:49:33,800 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-12-01T20:49:33,803 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-12-01T20:49:33,805 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-12-01T20:49:33,808 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-12-01T20:49:33,811 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-12-01T20:49:33,812 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-12-01T20:49:33,815 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-12-01T20:49:33,817 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-12-01T20:49:33,819 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-12-01T20:49:33,821 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-12-01T20:49:33,824 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-12-01T20:49:33,825 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-12-01T20:49:33,828 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-12-01T20:49:33,829 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-12-01T20:49:33,832 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-12-01T20:49:33,834 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-12-01T20:49:33,838 creating build/lib/deepspeed/profiling/flops_profiler 2023-12-01T20:49:33,839 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2023-12-01T20:49:33,842 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2023-12-01T20:49:33,845 creating build/lib/deepspeed/model_implementations/features 2023-12-01T20:49:33,846 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2023-12-01T20:49:33,848 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2023-12-01T20:49:33,850 creating build/lib/deepspeed/model_implementations/diffusers 2023-12-01T20:49:33,851 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2023-12-01T20:49:33,853 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2023-12-01T20:49:33,855 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2023-12-01T20:49:33,858 creating build/lib/deepspeed/model_implementations/transformers 2023-12-01T20:49:33,859 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-01T20:49:33,861 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-01T20:49:33,863 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-01T20:49:33,865 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-01T20:49:33,866 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-01T20:49:33,868 copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-01T20:49:33,870 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-01T20:49:33,873 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-01T20:49:33,875 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-01T20:49:33,877 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-01T20:49:33,879 creating build/lib/deepspeed/autotuning/tuner 2023-12-01T20:49:33,880 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-12-01T20:49:33,882 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2023-12-01T20:49:33,884 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2023-12-01T20:49:33,886 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-12-01T20:49:33,889 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2023-12-01T20:49:33,891 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-12-01T20:49:33,893 running egg_info 2023-12-01T20:49:33,944 writing deepspeed.egg-info/PKG-INFO 2023-12-01T20:49:33,976 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2023-12-01T20:49:33,978 writing entry points to deepspeed.egg-info/entry_points.txt 2023-12-01T20:49:33,993 writing requirements to deepspeed.egg-info/requires.txt 2023-12-01T20:49:33,995 writing top-level names to deepspeed.egg-info/top_level.txt 2023-12-01T20:49:34,108 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-12-01T20:49:34,156 reading manifest template 'MANIFEST.in' 2023-12-01T20:49:34,158 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2023-12-01T20:49:34,158 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2023-12-01T20:49:35,319 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-12-01T20:49:36,170 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-12-01T20:49:36,689 warning: no files found matching '*.tr' under directory 'csrc' 2023-12-01T20:49:36,810 warning: no files found matching '*.cc' under directory 'csrc' 2023-12-01T20:49:36,839 warning: no files found matching '*.py' under directory 'benchmarks' 2023-12-01T20:49:36,884 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-12-01T20:49:36,892 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2023-12-01T20:49:36,892 !! 2023-12-01T20:49:36,893 ******************************************************************************** 2023-12-01T20:49:36,894 ############################ 2023-12-01T20:49:36,895 # Package would be ignored # 2023-12-01T20:49:36,895 ############################ 2023-12-01T20:49:36,896 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2023-12-01T20:49:36,896 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:36,897 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:36,898 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2023-12-01T20:49:36,898 to the `packages` configuration field. 2023-12-01T20:49:36,899 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:36,900 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:36,901 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:36,902 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:36,904 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:36,905 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2023-12-01T20:49:36,906 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2023-12-01T20:49:36,906 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:36,907 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:36,907 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:36,908 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:36,909 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:36,911 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:36,911 even if it does not contain any `.py` files. 2023-12-01T20:49:36,912 On the other hand, currently there is no concept of package data 2023-12-01T20:49:36,913 directory, all directories are treated like packages. 2023-12-01T20:49:36,913 ******************************************************************************** 2023-12-01T20:49:36,914 !! 2023-12-01T20:49:36,915 check.warn(importable) 2023-12-01T20:49:36,915 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration. 2023-12-01T20:49:36,916 !! 2023-12-01T20:49:36,917 ******************************************************************************** 2023-12-01T20:49:36,918 ############################ 2023-12-01T20:49:36,919 # Package would be ignored # 2023-12-01T20:49:36,919 ############################ 2023-12-01T20:49:36,920 Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1], 2023-12-01T20:49:36,920 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:36,921 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:36,922 package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added 2023-12-01T20:49:36,922 to the `packages` configuration field. 2023-12-01T20:49:36,923 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:36,923 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:36,924 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:36,924 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:36,925 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:36,926 If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are 2023-12-01T20:49:36,926 already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via 2023-12-01T20:49:36,927 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:36,927 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:36,928 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:36,929 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:36,930 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:36,932 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:36,932 even if it does not contain any `.py` files. 2023-12-01T20:49:36,933 On the other hand, currently there is no concept of package data 2023-12-01T20:49:36,933 directory, all directories are treated like packages. 2023-12-01T20:49:36,934 ******************************************************************************** 2023-12-01T20:49:36,935 !! 2023-12-01T20:49:36,936 check.warn(importable) 2023-12-01T20:49:36,936 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration. 2023-12-01T20:49:36,937 !! 2023-12-01T20:49:36,938 ******************************************************************************** 2023-12-01T20:49:36,938 ############################ 2023-12-01T20:49:36,939 # Package would be ignored # 2023-12-01T20:49:36,939 ############################ 2023-12-01T20:49:36,940 Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1], 2023-12-01T20:49:36,940 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:36,941 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:36,942 package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added 2023-12-01T20:49:36,942 to the `packages` configuration field. 2023-12-01T20:49:36,943 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:36,944 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:36,944 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:36,945 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:36,947 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:36,948 If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are 2023-12-01T20:49:36,948 already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via 2023-12-01T20:49:36,949 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:36,949 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:36,950 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:36,950 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:36,951 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:36,952 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:36,953 even if it does not contain any `.py` files. 2023-12-01T20:49:36,953 On the other hand, currently there is no concept of package data 2023-12-01T20:49:36,954 directory, all directories are treated like packages. 2023-12-01T20:49:36,954 ******************************************************************************** 2023-12-01T20:49:36,955 !! 2023-12-01T20:49:36,955 check.warn(importable) 2023-12-01T20:49:36,956 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration. 2023-12-01T20:49:36,956 !! 2023-12-01T20:49:36,957 ******************************************************************************** 2023-12-01T20:49:36,957 ############################ 2023-12-01T20:49:36,958 # Package would be ignored # 2023-12-01T20:49:36,958 ############################ 2023-12-01T20:49:36,958 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1], 2023-12-01T20:49:36,959 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:36,960 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:36,961 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added 2023-12-01T20:49:36,961 to the `packages` configuration field. 2023-12-01T20:49:36,962 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:36,963 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:36,963 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:36,965 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:36,966 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:36,967 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are 2023-12-01T20:49:36,967 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via 2023-12-01T20:49:36,968 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:36,968 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:36,969 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:36,969 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:36,970 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:36,972 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:36,972 even if it does not contain any `.py` files. 2023-12-01T20:49:36,973 On the other hand, currently there is no concept of package data 2023-12-01T20:49:36,974 directory, all directories are treated like packages. 2023-12-01T20:49:36,975 ******************************************************************************** 2023-12-01T20:49:36,975 !! 2023-12-01T20:49:36,976 check.warn(importable) 2023-12-01T20:49:36,976 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration. 2023-12-01T20:49:36,976 !! 2023-12-01T20:49:36,977 ******************************************************************************** 2023-12-01T20:49:36,977 ############################ 2023-12-01T20:49:36,978 # Package would be ignored # 2023-12-01T20:49:36,978 ############################ 2023-12-01T20:49:36,979 Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1], 2023-12-01T20:49:36,979 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:36,980 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:36,980 package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added 2023-12-01T20:49:36,980 to the `packages` configuration field. 2023-12-01T20:49:36,981 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:36,982 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:36,982 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:36,983 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:36,984 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:36,985 If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are 2023-12-01T20:49:36,986 already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via 2023-12-01T20:49:36,986 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:36,987 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:36,990 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:36,992 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:36,994 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:36,995 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:36,996 even if it does not contain any `.py` files. 2023-12-01T20:49:36,997 On the other hand, currently there is no concept of package data 2023-12-01T20:49:36,998 directory, all directories are treated like packages. 2023-12-01T20:49:36,998 ******************************************************************************** 2023-12-01T20:49:36,999 !! 2023-12-01T20:49:37,000 check.warn(importable) 2023-12-01T20:49:37,001 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration. 2023-12-01T20:49:37,001 !! 2023-12-01T20:49:37,002 ******************************************************************************** 2023-12-01T20:49:37,003 ############################ 2023-12-01T20:49:37,003 # Package would be ignored # 2023-12-01T20:49:37,004 ############################ 2023-12-01T20:49:37,004 Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1], 2023-12-01T20:49:37,005 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,006 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,007 package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added 2023-12-01T20:49:37,008 to the `packages` configuration field. 2023-12-01T20:49:37,008 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,009 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,009 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,010 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,010 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,011 If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are 2023-12-01T20:49:37,012 already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via 2023-12-01T20:49:37,012 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,012 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,013 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,013 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,014 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,015 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,016 even if it does not contain any `.py` files. 2023-12-01T20:49:37,016 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,017 directory, all directories are treated like packages. 2023-12-01T20:49:37,017 ******************************************************************************** 2023-12-01T20:49:37,018 !! 2023-12-01T20:49:37,019 check.warn(importable) 2023-12-01T20:49:37,019 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2023-12-01T20:49:37,020 !! 2023-12-01T20:49:37,021 ******************************************************************************** 2023-12-01T20:49:37,021 ############################ 2023-12-01T20:49:37,022 # Package would be ignored # 2023-12-01T20:49:37,022 ############################ 2023-12-01T20:49:37,023 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2023-12-01T20:49:37,023 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,025 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,025 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2023-12-01T20:49:37,026 to the `packages` configuration field. 2023-12-01T20:49:37,027 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,027 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,027 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,028 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,030 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,031 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2023-12-01T20:49:37,031 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2023-12-01T20:49:37,032 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,032 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,033 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,034 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,035 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,036 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,036 even if it does not contain any `.py` files. 2023-12-01T20:49:37,037 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,038 directory, all directories are treated like packages. 2023-12-01T20:49:37,038 ******************************************************************************** 2023-12-01T20:49:37,039 !! 2023-12-01T20:49:37,039 check.warn(importable) 2023-12-01T20:49:37,040 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2023-12-01T20:49:37,040 !! 2023-12-01T20:49:37,041 ******************************************************************************** 2023-12-01T20:49:37,041 ############################ 2023-12-01T20:49:37,041 # Package would be ignored # 2023-12-01T20:49:37,042 ############################ 2023-12-01T20:49:37,042 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2023-12-01T20:49:37,043 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,043 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,044 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2023-12-01T20:49:37,044 to the `packages` configuration field. 2023-12-01T20:49:37,045 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,046 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,046 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,048 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,049 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,050 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2023-12-01T20:49:37,050 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2023-12-01T20:49:37,051 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,052 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,052 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,053 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,054 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,056 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,056 even if it does not contain any `.py` files. 2023-12-01T20:49:37,057 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,057 directory, all directories are treated like packages. 2023-12-01T20:49:37,057 ******************************************************************************** 2023-12-01T20:49:37,058 !! 2023-12-01T20:49:37,059 check.warn(importable) 2023-12-01T20:49:37,060 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2023-12-01T20:49:37,060 !! 2023-12-01T20:49:37,061 ******************************************************************************** 2023-12-01T20:49:37,062 ############################ 2023-12-01T20:49:37,062 # Package would be ignored # 2023-12-01T20:49:37,063 ############################ 2023-12-01T20:49:37,064 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2023-12-01T20:49:37,064 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,065 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,065 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2023-12-01T20:49:37,066 to the `packages` configuration field. 2023-12-01T20:49:37,067 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,067 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,067 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,068 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,069 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,070 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2023-12-01T20:49:37,070 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2023-12-01T20:49:37,071 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,073 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,073 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,074 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,075 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,077 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,077 even if it does not contain any `.py` files. 2023-12-01T20:49:37,078 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,078 directory, all directories are treated like packages. 2023-12-01T20:49:37,079 ******************************************************************************** 2023-12-01T20:49:37,080 !! 2023-12-01T20:49:37,081 check.warn(importable) 2023-12-01T20:49:37,081 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2023-12-01T20:49:37,082 !! 2023-12-01T20:49:37,083 ******************************************************************************** 2023-12-01T20:49:37,084 ############################ 2023-12-01T20:49:37,084 # Package would be ignored # 2023-12-01T20:49:37,085 ############################ 2023-12-01T20:49:37,085 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2023-12-01T20:49:37,086 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,087 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,087 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2023-12-01T20:49:37,088 to the `packages` configuration field. 2023-12-01T20:49:37,089 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,089 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,089 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,091 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,092 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,093 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2023-12-01T20:49:37,094 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2023-12-01T20:49:37,095 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,095 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,095 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,096 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,097 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,098 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,099 even if it does not contain any `.py` files. 2023-12-01T20:49:37,099 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,099 directory, all directories are treated like packages. 2023-12-01T20:49:37,100 ******************************************************************************** 2023-12-01T20:49:37,100 !! 2023-12-01T20:49:37,101 check.warn(importable) 2023-12-01T20:49:37,101 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2023-12-01T20:49:37,102 !! 2023-12-01T20:49:37,103 ******************************************************************************** 2023-12-01T20:49:37,103 ############################ 2023-12-01T20:49:37,103 # Package would be ignored # 2023-12-01T20:49:37,104 ############################ 2023-12-01T20:49:37,105 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2023-12-01T20:49:37,105 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,106 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,107 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2023-12-01T20:49:37,107 to the `packages` configuration field. 2023-12-01T20:49:37,109 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,109 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,110 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,111 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,112 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,113 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2023-12-01T20:49:37,114 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2023-12-01T20:49:37,114 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,115 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,115 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,116 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,117 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,119 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,120 even if it does not contain any `.py` files. 2023-12-01T20:49:37,120 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,121 directory, all directories are treated like packages. 2023-12-01T20:49:37,121 ******************************************************************************** 2023-12-01T20:49:37,122 !! 2023-12-01T20:49:37,123 check.warn(importable) 2023-12-01T20:49:37,124 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration. 2023-12-01T20:49:37,124 !! 2023-12-01T20:49:37,125 ******************************************************************************** 2023-12-01T20:49:37,125 ############################ 2023-12-01T20:49:37,126 # Package would be ignored # 2023-12-01T20:49:37,126 ############################ 2023-12-01T20:49:37,126 Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1], 2023-12-01T20:49:37,127 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,128 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,128 package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added 2023-12-01T20:49:37,128 to the `packages` configuration field. 2023-12-01T20:49:37,129 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,130 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,130 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,131 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,131 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,132 If you don't want 'deepspeed.ops.csrc.common' to be distributed and are 2023-12-01T20:49:37,133 already explicitly excluding 'deepspeed.ops.csrc.common' via 2023-12-01T20:49:37,133 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,134 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,134 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,135 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,137 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,138 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,139 even if it does not contain any `.py` files. 2023-12-01T20:49:37,140 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,140 directory, all directories are treated like packages. 2023-12-01T20:49:37,141 ******************************************************************************** 2023-12-01T20:49:37,142 !! 2023-12-01T20:49:37,143 check.warn(importable) 2023-12-01T20:49:37,143 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration. 2023-12-01T20:49:37,144 !! 2023-12-01T20:49:37,145 ******************************************************************************** 2023-12-01T20:49:37,145 ############################ 2023-12-01T20:49:37,146 # Package would be ignored # 2023-12-01T20:49:37,146 ############################ 2023-12-01T20:49:37,147 Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1], 2023-12-01T20:49:37,147 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,148 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,149 package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added 2023-12-01T20:49:37,149 to the `packages` configuration field. 2023-12-01T20:49:37,150 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,151 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,152 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,153 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,154 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,155 If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are 2023-12-01T20:49:37,155 already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via 2023-12-01T20:49:37,156 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,156 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,157 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,157 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,158 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,159 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,160 even if it does not contain any `.py` files. 2023-12-01T20:49:37,160 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,161 directory, all directories are treated like packages. 2023-12-01T20:49:37,161 ******************************************************************************** 2023-12-01T20:49:37,162 !! 2023-12-01T20:49:37,163 check.warn(importable) 2023-12-01T20:49:37,163 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2023-12-01T20:49:37,164 !! 2023-12-01T20:49:37,165 ******************************************************************************** 2023-12-01T20:49:37,166 ############################ 2023-12-01T20:49:37,166 # Package would be ignored # 2023-12-01T20:49:37,167 ############################ 2023-12-01T20:49:37,168 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2023-12-01T20:49:37,168 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,169 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,170 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2023-12-01T20:49:37,171 to the `packages` configuration field. 2023-12-01T20:49:37,172 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,173 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,173 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,174 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,176 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,177 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2023-12-01T20:49:37,177 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2023-12-01T20:49:37,178 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,178 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,179 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,180 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,181 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,183 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,184 even if it does not contain any `.py` files. 2023-12-01T20:49:37,185 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,186 directory, all directories are treated like packages. 2023-12-01T20:49:37,186 ******************************************************************************** 2023-12-01T20:49:37,187 !! 2023-12-01T20:49:37,187 check.warn(importable) 2023-12-01T20:49:37,188 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration. 2023-12-01T20:49:37,188 !! 2023-12-01T20:49:37,189 ******************************************************************************** 2023-12-01T20:49:37,190 ############################ 2023-12-01T20:49:37,190 # Package would be ignored # 2023-12-01T20:49:37,191 ############################ 2023-12-01T20:49:37,191 Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1], 2023-12-01T20:49:37,192 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,193 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,193 package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added 2023-12-01T20:49:37,194 to the `packages` configuration field. 2023-12-01T20:49:37,195 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,195 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,196 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,197 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,198 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,199 If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are 2023-12-01T20:49:37,199 already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via 2023-12-01T20:49:37,200 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,201 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,201 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,202 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,204 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,206 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,206 even if it does not contain any `.py` files. 2023-12-01T20:49:37,207 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,208 directory, all directories are treated like packages. 2023-12-01T20:49:37,208 ******************************************************************************** 2023-12-01T20:49:37,210 !! 2023-12-01T20:49:37,210 check.warn(importable) 2023-12-01T20:49:37,211 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration. 2023-12-01T20:49:37,211 !! 2023-12-01T20:49:37,212 ******************************************************************************** 2023-12-01T20:49:37,213 ############################ 2023-12-01T20:49:37,213 # Package would be ignored # 2023-12-01T20:49:37,214 ############################ 2023-12-01T20:49:37,215 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1], 2023-12-01T20:49:37,215 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,216 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,217 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added 2023-12-01T20:49:37,217 to the `packages` configuration field. 2023-12-01T20:49:37,218 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,219 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,219 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,220 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,221 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,222 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are 2023-12-01T20:49:37,222 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via 2023-12-01T20:49:37,223 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,223 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,223 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,224 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,225 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,227 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,228 even if it does not contain any `.py` files. 2023-12-01T20:49:37,228 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,229 directory, all directories are treated like packages. 2023-12-01T20:49:37,229 ******************************************************************************** 2023-12-01T20:49:37,230 !! 2023-12-01T20:49:37,231 check.warn(importable) 2023-12-01T20:49:37,231 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration. 2023-12-01T20:49:37,232 !! 2023-12-01T20:49:37,233 ******************************************************************************** 2023-12-01T20:49:37,234 ############################ 2023-12-01T20:49:37,234 # Package would be ignored # 2023-12-01T20:49:37,235 ############################ 2023-12-01T20:49:37,236 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1], 2023-12-01T20:49:37,236 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,237 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,238 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added 2023-12-01T20:49:37,238 to the `packages` configuration field. 2023-12-01T20:49:37,240 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,240 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,241 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,242 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,243 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,244 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are 2023-12-01T20:49:37,244 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via 2023-12-01T20:49:37,245 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,246 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,246 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,247 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,248 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,249 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,250 even if it does not contain any `.py` files. 2023-12-01T20:49:37,250 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,251 directory, all directories are treated like packages. 2023-12-01T20:49:37,251 ******************************************************************************** 2023-12-01T20:49:37,252 !! 2023-12-01T20:49:37,253 check.warn(importable) 2023-12-01T20:49:37,253 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration. 2023-12-01T20:49:37,254 !! 2023-12-01T20:49:37,255 ******************************************************************************** 2023-12-01T20:49:37,255 ############################ 2023-12-01T20:49:37,256 # Package would be ignored # 2023-12-01T20:49:37,256 ############################ 2023-12-01T20:49:37,257 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1], 2023-12-01T20:49:37,258 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,259 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,259 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added 2023-12-01T20:49:37,260 to the `packages` configuration field. 2023-12-01T20:49:37,261 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,261 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,262 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,263 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,264 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,265 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are 2023-12-01T20:49:37,265 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via 2023-12-01T20:49:37,266 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,266 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,267 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,268 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,269 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,270 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,271 even if it does not contain any `.py` files. 2023-12-01T20:49:37,272 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,273 directory, all directories are treated like packages. 2023-12-01T20:49:37,273 ******************************************************************************** 2023-12-01T20:49:37,274 !! 2023-12-01T20:49:37,275 check.warn(importable) 2023-12-01T20:49:37,275 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration. 2023-12-01T20:49:37,276 !! 2023-12-01T20:49:37,276 ******************************************************************************** 2023-12-01T20:49:37,277 ############################ 2023-12-01T20:49:37,277 # Package would be ignored # 2023-12-01T20:49:37,278 ############################ 2023-12-01T20:49:37,278 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1], 2023-12-01T20:49:37,279 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,279 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,280 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added 2023-12-01T20:49:37,280 to the `packages` configuration field. 2023-12-01T20:49:37,281 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,282 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,282 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,283 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,284 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,285 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are 2023-12-01T20:49:37,286 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via 2023-12-01T20:49:37,286 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,287 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,287 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,288 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,289 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,291 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,291 even if it does not contain any `.py` files. 2023-12-01T20:49:37,292 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,292 directory, all directories are treated like packages. 2023-12-01T20:49:37,293 ******************************************************************************** 2023-12-01T20:49:37,294 !! 2023-12-01T20:49:37,295 check.warn(importable) 2023-12-01T20:49:37,295 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration. 2023-12-01T20:49:37,296 !! 2023-12-01T20:49:37,297 ******************************************************************************** 2023-12-01T20:49:37,297 ############################ 2023-12-01T20:49:37,298 # Package would be ignored # 2023-12-01T20:49:37,298 ############################ 2023-12-01T20:49:37,299 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1], 2023-12-01T20:49:37,300 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,301 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,302 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added 2023-12-01T20:49:37,302 to the `packages` configuration field. 2023-12-01T20:49:37,303 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,304 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,304 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,305 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,306 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,307 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are 2023-12-01T20:49:37,307 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via 2023-12-01T20:49:37,308 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,308 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,308 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,309 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,310 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,312 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,313 even if it does not contain any `.py` files. 2023-12-01T20:49:37,313 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,314 directory, all directories are treated like packages. 2023-12-01T20:49:37,314 ******************************************************************************** 2023-12-01T20:49:37,315 !! 2023-12-01T20:49:37,316 check.warn(importable) 2023-12-01T20:49:37,317 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2023-12-01T20:49:37,317 !! 2023-12-01T20:49:37,318 ******************************************************************************** 2023-12-01T20:49:37,319 ############################ 2023-12-01T20:49:37,320 # Package would be ignored # 2023-12-01T20:49:37,320 ############################ 2023-12-01T20:49:37,321 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2023-12-01T20:49:37,322 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,323 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,324 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2023-12-01T20:49:37,324 to the `packages` configuration field. 2023-12-01T20:49:37,325 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,326 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,327 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,328 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,329 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,330 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2023-12-01T20:49:37,331 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2023-12-01T20:49:37,331 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,332 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,332 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,334 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,335 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,336 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,337 even if it does not contain any `.py` files. 2023-12-01T20:49:37,337 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,337 directory, all directories are treated like packages. 2023-12-01T20:49:37,338 ******************************************************************************** 2023-12-01T20:49:37,339 !! 2023-12-01T20:49:37,339 check.warn(importable) 2023-12-01T20:49:37,340 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2023-12-01T20:49:37,340 !! 2023-12-01T20:49:37,341 ******************************************************************************** 2023-12-01T20:49:37,342 ############################ 2023-12-01T20:49:37,342 # Package would be ignored # 2023-12-01T20:49:37,343 ############################ 2023-12-01T20:49:37,343 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2023-12-01T20:49:37,344 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,345 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,345 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2023-12-01T20:49:37,346 to the `packages` configuration field. 2023-12-01T20:49:37,347 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,347 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,348 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,349 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,350 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,351 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2023-12-01T20:49:37,351 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2023-12-01T20:49:37,352 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,353 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,353 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,354 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,356 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,357 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,358 even if it does not contain any `.py` files. 2023-12-01T20:49:37,359 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,359 directory, all directories are treated like packages. 2023-12-01T20:49:37,360 ******************************************************************************** 2023-12-01T20:49:37,361 !! 2023-12-01T20:49:37,361 check.warn(importable) 2023-12-01T20:49:37,362 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration. 2023-12-01T20:49:37,363 !! 2023-12-01T20:49:37,364 ******************************************************************************** 2023-12-01T20:49:37,364 ############################ 2023-12-01T20:49:37,365 # Package would be ignored # 2023-12-01T20:49:37,366 ############################ 2023-12-01T20:49:37,367 Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1], 2023-12-01T20:49:37,368 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,368 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,369 package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added 2023-12-01T20:49:37,369 to the `packages` configuration field. 2023-12-01T20:49:37,370 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,371 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,371 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,372 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,373 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,374 If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are 2023-12-01T20:49:37,375 already explicitly excluding 'deepspeed.ops.csrc.lion' via 2023-12-01T20:49:37,376 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,376 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,376 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,377 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,379 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,381 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,381 even if it does not contain any `.py` files. 2023-12-01T20:49:37,382 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,383 directory, all directories are treated like packages. 2023-12-01T20:49:37,383 ******************************************************************************** 2023-12-01T20:49:37,384 !! 2023-12-01T20:49:37,385 check.warn(importable) 2023-12-01T20:49:37,385 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2023-12-01T20:49:37,386 !! 2023-12-01T20:49:37,387 ******************************************************************************** 2023-12-01T20:49:37,387 ############################ 2023-12-01T20:49:37,388 # Package would be ignored # 2023-12-01T20:49:37,388 ############################ 2023-12-01T20:49:37,389 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2023-12-01T20:49:37,393 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,394 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,395 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2023-12-01T20:49:37,395 to the `packages` configuration field. 2023-12-01T20:49:37,396 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,397 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,398 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,399 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,400 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,401 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2023-12-01T20:49:37,401 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2023-12-01T20:49:37,402 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,403 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,403 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,404 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,405 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,406 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,407 even if it does not contain any `.py` files. 2023-12-01T20:49:37,407 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,408 directory, all directories are treated like packages. 2023-12-01T20:49:37,408 ******************************************************************************** 2023-12-01T20:49:37,409 !! 2023-12-01T20:49:37,409 check.warn(importable) 2023-12-01T20:49:37,410 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2023-12-01T20:49:37,410 !! 2023-12-01T20:49:37,411 ******************************************************************************** 2023-12-01T20:49:37,412 ############################ 2023-12-01T20:49:37,412 # Package would be ignored # 2023-12-01T20:49:37,413 ############################ 2023-12-01T20:49:37,413 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2023-12-01T20:49:37,414 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,415 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,415 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2023-12-01T20:49:37,416 to the `packages` configuration field. 2023-12-01T20:49:37,417 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,418 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,418 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,419 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,420 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,421 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2023-12-01T20:49:37,422 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2023-12-01T20:49:37,422 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,423 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,424 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,425 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,426 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,427 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,428 even if it does not contain any `.py` files. 2023-12-01T20:49:37,428 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,429 directory, all directories are treated like packages. 2023-12-01T20:49:37,430 ******************************************************************************** 2023-12-01T20:49:37,431 !! 2023-12-01T20:49:37,431 check.warn(importable) 2023-12-01T20:49:37,432 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2023-12-01T20:49:37,433 !! 2023-12-01T20:49:37,433 ******************************************************************************** 2023-12-01T20:49:37,434 ############################ 2023-12-01T20:49:37,434 # Package would be ignored # 2023-12-01T20:49:37,435 ############################ 2023-12-01T20:49:37,435 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2023-12-01T20:49:37,436 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,437 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,437 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2023-12-01T20:49:37,437 to the `packages` configuration field. 2023-12-01T20:49:37,439 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,439 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,439 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,440 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,441 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,442 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2023-12-01T20:49:37,443 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2023-12-01T20:49:37,443 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,444 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,444 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,445 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,446 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,448 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,448 even if it does not contain any `.py` files. 2023-12-01T20:49:37,449 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,449 directory, all directories are treated like packages. 2023-12-01T20:49:37,450 ******************************************************************************** 2023-12-01T20:49:37,451 !! 2023-12-01T20:49:37,452 check.warn(importable) 2023-12-01T20:49:37,452 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2023-12-01T20:49:37,453 !! 2023-12-01T20:49:37,454 ******************************************************************************** 2023-12-01T20:49:37,454 ############################ 2023-12-01T20:49:37,455 # Package would be ignored # 2023-12-01T20:49:37,456 ############################ 2023-12-01T20:49:37,456 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2023-12-01T20:49:37,457 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,458 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,458 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2023-12-01T20:49:37,459 to the `packages` configuration field. 2023-12-01T20:49:37,460 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,461 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,461 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,462 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,463 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,464 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2023-12-01T20:49:37,464 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2023-12-01T20:49:37,465 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,465 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,466 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,467 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,468 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,469 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,470 even if it does not contain any `.py` files. 2023-12-01T20:49:37,470 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,471 directory, all directories are treated like packages. 2023-12-01T20:49:37,471 ******************************************************************************** 2023-12-01T20:49:37,472 !! 2023-12-01T20:49:37,473 check.warn(importable) 2023-12-01T20:49:37,473 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2023-12-01T20:49:37,474 !! 2023-12-01T20:49:37,475 ******************************************************************************** 2023-12-01T20:49:37,476 ############################ 2023-12-01T20:49:37,476 # Package would be ignored # 2023-12-01T20:49:37,477 ############################ 2023-12-01T20:49:37,477 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2023-12-01T20:49:37,478 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,479 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,479 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2023-12-01T20:49:37,480 to the `packages` configuration field. 2023-12-01T20:49:37,481 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,481 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,482 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,483 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,484 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,485 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2023-12-01T20:49:37,486 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2023-12-01T20:49:37,487 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,487 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,488 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,489 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,490 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,492 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,492 even if it does not contain any `.py` files. 2023-12-01T20:49:37,493 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,494 directory, all directories are treated like packages. 2023-12-01T20:49:37,494 ******************************************************************************** 2023-12-01T20:49:37,495 !! 2023-12-01T20:49:37,496 check.warn(importable) 2023-12-01T20:49:37,496 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2023-12-01T20:49:37,497 !! 2023-12-01T20:49:37,497 ******************************************************************************** 2023-12-01T20:49:37,498 ############################ 2023-12-01T20:49:37,498 # Package would be ignored # 2023-12-01T20:49:37,499 ############################ 2023-12-01T20:49:37,499 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2023-12-01T20:49:37,500 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,501 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,501 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2023-12-01T20:49:37,502 to the `packages` configuration field. 2023-12-01T20:49:37,503 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,503 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,504 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,505 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,506 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,507 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2023-12-01T20:49:37,507 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2023-12-01T20:49:37,508 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,508 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,509 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,510 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,511 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,513 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,513 even if it does not contain any `.py` files. 2023-12-01T20:49:37,514 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,514 directory, all directories are treated like packages. 2023-12-01T20:49:37,515 ******************************************************************************** 2023-12-01T20:49:37,516 !! 2023-12-01T20:49:37,517 check.warn(importable) 2023-12-01T20:49:37,517 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2023-12-01T20:49:37,518 !! 2023-12-01T20:49:37,519 ******************************************************************************** 2023-12-01T20:49:37,519 ############################ 2023-12-01T20:49:37,520 # Package would be ignored # 2023-12-01T20:49:37,521 ############################ 2023-12-01T20:49:37,521 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2023-12-01T20:49:37,522 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,523 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,523 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2023-12-01T20:49:37,523 to the `packages` configuration field. 2023-12-01T20:49:37,524 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,525 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,526 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,527 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,527 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,528 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2023-12-01T20:49:37,529 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2023-12-01T20:49:37,529 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,530 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,530 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,531 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,532 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,534 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,535 even if it does not contain any `.py` files. 2023-12-01T20:49:37,536 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,536 directory, all directories are treated like packages. 2023-12-01T20:49:37,537 ******************************************************************************** 2023-12-01T20:49:37,538 !! 2023-12-01T20:49:37,538 check.warn(importable) 2023-12-01T20:49:37,539 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2023-12-01T20:49:37,540 !! 2023-12-01T20:49:37,541 ******************************************************************************** 2023-12-01T20:49:37,541 ############################ 2023-12-01T20:49:37,542 # Package would be ignored # 2023-12-01T20:49:37,542 ############################ 2023-12-01T20:49:37,543 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2023-12-01T20:49:37,543 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,545 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,545 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2023-12-01T20:49:37,546 to the `packages` configuration field. 2023-12-01T20:49:37,547 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,547 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,548 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,549 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,550 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,551 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2023-12-01T20:49:37,552 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2023-12-01T20:49:37,553 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,554 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,554 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,555 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,556 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,558 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,558 even if it does not contain any `.py` files. 2023-12-01T20:49:37,559 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,559 directory, all directories are treated like packages. 2023-12-01T20:49:37,559 ******************************************************************************** 2023-12-01T20:49:37,560 !! 2023-12-01T20:49:37,561 check.warn(importable) 2023-12-01T20:49:37,561 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2023-12-01T20:49:37,562 !! 2023-12-01T20:49:37,563 ******************************************************************************** 2023-12-01T20:49:37,563 ############################ 2023-12-01T20:49:37,564 # Package would be ignored # 2023-12-01T20:49:37,564 ############################ 2023-12-01T20:49:37,565 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2023-12-01T20:49:37,565 but it is absent from setuptools' `packages` configuration. 2023-12-01T20:49:37,566 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-01T20:49:37,567 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2023-12-01T20:49:37,567 to the `packages` configuration field. 2023-12-01T20:49:37,568 Alternatively, you can also rely on setuptools' discovery methods 2023-12-01T20:49:37,569 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-01T20:49:37,569 instead of `find_packages(...)`/`find:`). 2023-12-01T20:49:37,570 You can read more about "package discovery" on setuptools documentation page: 2023-12-01T20:49:37,571 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-01T20:49:37,572 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2023-12-01T20:49:37,573 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2023-12-01T20:49:37,574 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-01T20:49:37,574 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-01T20:49:37,575 combination with a more fine grained `package-data` configuration. 2023-12-01T20:49:37,576 You can read more about "package data files" on setuptools documentation page: 2023-12-01T20:49:37,577 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-01T20:49:37,578 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-01T20:49:37,579 even if it does not contain any `.py` files. 2023-12-01T20:49:37,580 On the other hand, currently there is no concept of package data 2023-12-01T20:49:37,580 directory, all directories are treated like packages. 2023-12-01T20:49:37,581 ******************************************************************************** 2023-12-01T20:49:37,582 !! 2023-12-01T20:49:37,582 check.warn(importable) 2023-12-01T20:49:37,583 creating build/lib/deepspeed/ops/csrc 2023-12-01T20:49:37,583 creating build/lib/deepspeed/ops/csrc/adagrad 2023-12-01T20:49:37,584 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2023-12-01T20:49:37,585 creating build/lib/deepspeed/ops/csrc/adam 2023-12-01T20:49:37,585 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-12-01T20:49:37,586 copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-12-01T20:49:37,586 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-12-01T20:49:37,587 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2023-12-01T20:49:37,587 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2023-12-01T20:49:37,588 creating build/lib/deepspeed/ops/csrc/aio 2023-12-01T20:49:37,588 creating build/lib/deepspeed/ops/csrc/aio/common 2023-12-01T20:49:37,589 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-12-01T20:49:37,589 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-12-01T20:49:37,590 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-12-01T20:49:37,590 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-12-01T20:49:37,591 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-12-01T20:49:37,592 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-12-01T20:49:37,592 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:37,593 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:37,593 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:37,594 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:37,594 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:37,595 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:37,596 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:37,596 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:37,597 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:37,597 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:37,599 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:37,599 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:37,600 creating build/lib/deepspeed/ops/csrc/aio/py_test 2023-12-01T20:49:37,600 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2023-12-01T20:49:37,601 creating build/lib/deepspeed/ops/csrc/common 2023-12-01T20:49:37,601 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2023-12-01T20:49:37,602 creating build/lib/deepspeed/ops/csrc/cpu 2023-12-01T20:49:37,602 creating build/lib/deepspeed/ops/csrc/cpu/adam 2023-12-01T20:49:37,603 copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam 2023-12-01T20:49:37,603 creating build/lib/deepspeed/ops/csrc/cpu/comm 2023-12-01T20:49:37,604 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2023-12-01T20:49:37,605 creating build/lib/deepspeed/ops/csrc/cpu/lion 2023-12-01T20:49:37,606 copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion 2023-12-01T20:49:37,606 creating build/lib/deepspeed/ops/csrc/deepspeed4science 2023-12-01T20:49:37,607 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-01T20:49:37,608 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-01T20:49:37,609 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-01T20:49:37,609 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-01T20:49:37,610 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-01T20:49:37,610 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-01T20:49:37,611 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-01T20:49:37,611 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-01T20:49:37,612 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-01T20:49:37,612 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-01T20:49:37,613 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-01T20:49:37,613 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-01T20:49:37,614 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-01T20:49:37,614 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-01T20:49:37,615 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-01T20:49:37,616 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-01T20:49:37,616 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-01T20:49:37,617 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-01T20:49:37,617 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-01T20:49:37,618 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-01T20:49:37,618 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-01T20:49:37,619 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-01T20:49:37,620 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-01T20:49:37,620 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-01T20:49:37,621 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-01T20:49:37,622 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-01T20:49:37,622 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-01T20:49:37,623 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-01T20:49:37,623 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-12-01T20:49:37,624 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-12-01T20:49:37,624 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-12-01T20:49:37,625 creating build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,625 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,626 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,626 copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,627 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,628 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,629 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,629 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,630 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,630 copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,631 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,632 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,633 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,633 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,634 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,634 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,635 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,635 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,636 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,636 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,637 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,637 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,638 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,640 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,641 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,641 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,641 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,642 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,642 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,643 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-01T20:49:37,643 creating build/lib/deepspeed/ops/csrc/lamb 2023-12-01T20:49:37,644 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2023-12-01T20:49:37,644 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2023-12-01T20:49:37,645 creating build/lib/deepspeed/ops/csrc/lion 2023-12-01T20:49:37,645 copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-12-01T20:49:37,646 copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-12-01T20:49:37,646 copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-12-01T20:49:37,647 copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion 2023-12-01T20:49:37,647 copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion 2023-12-01T20:49:37,648 creating build/lib/deepspeed/ops/csrc/quantization 2023-12-01T20:49:37,648 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-12-01T20:49:37,649 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-12-01T20:49:37,649 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2023-12-01T20:49:37,650 copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-12-01T20:49:37,651 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-12-01T20:49:37,651 copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-12-01T20:49:37,652 copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-12-01T20:49:37,652 creating build/lib/deepspeed/ops/csrc/random_ltd 2023-12-01T20:49:37,653 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-12-01T20:49:37,654 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2023-12-01T20:49:37,654 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-12-01T20:49:37,655 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-12-01T20:49:37,656 creating build/lib/deepspeed/ops/csrc/sparse_attention 2023-12-01T20:49:37,656 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2023-12-01T20:49:37,657 creating build/lib/deepspeed/ops/csrc/spatial 2023-12-01T20:49:37,657 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2023-12-01T20:49:37,658 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-12-01T20:49:37,658 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-12-01T20:49:37,659 creating build/lib/deepspeed/ops/csrc/spatial/includes 2023-12-01T20:49:37,660 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2023-12-01T20:49:37,660 creating build/lib/deepspeed/ops/csrc/transformer 2023-12-01T20:49:37,661 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-12-01T20:49:37,661 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-12-01T20:49:37,662 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2023-12-01T20:49:37,663 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-12-01T20:49:37,663 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-12-01T20:49:37,663 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-12-01T20:49:37,664 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-12-01T20:49:37,664 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-12-01T20:49:37,665 creating build/lib/deepspeed/ops/csrc/transformer/inference 2023-12-01T20:49:37,665 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:37,666 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:37,666 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:37,667 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:37,668 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:37,668 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:37,669 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:37,669 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:37,670 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:37,670 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:37,671 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:37,671 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-12-01T20:49:37,672 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-12-01T20:49:37,672 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-12-01T20:49:37,673 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-12-01T20:49:37,673 creating build/lib/deepspeed/ops/csrc/utils 2023-12-01T20:49:37,674 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2023-12-01T20:49:37,674 creating build/lib/deepspeed/autotuning/config_templates 2023-12-01T20:49:37,675 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2023-12-01T20:49:37,675 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2023-12-01T20:49:37,677 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2023-12-01T20:49:37,680 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2023-12-01T20:49:37,682 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-12-01T20:49:37,684 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-12-01T20:49:37,687 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-12-01T20:49:37,689 creating build/lib/deepspeed/inference/v2/ragged/csrc 2023-12-01T20:49:37,690 copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc 2023-12-01T20:49:37,692 copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc 2023-12-01T20:49:37,694 creating build/lib/deepspeed/inference/v2/ragged/includes 2023-12-01T20:49:37,695 copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes 2023-12-01T20:49:37,697 creating build/lib/deepspeed/inference/v2/kernels/includes 2023-12-01T20:49:37,698 copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes 2023-12-01T20:49:37,701 copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2023-12-01T20:49:37,703 copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2023-12-01T20:49:37,705 copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2023-12-01T20:49:37,709 copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2023-12-01T20:49:37,712 copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2023-12-01T20:49:37,715 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-12-01T20:49:37,716 copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-12-01T20:49:37,719 copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops 2023-12-01T20:49:37,721 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2023-12-01T20:49:37,723 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-12-01T20:49:37,724 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-12-01T20:49:37,727 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-12-01T20:49:37,729 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-12-01T20:49:37,731 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-01T20:49:37,734 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-01T20:49:37,736 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-01T20:49:37,739 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-01T20:49:37,742 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-01T20:49:37,744 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-01T20:49:37,746 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-01T20:49:37,749 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-01T20:49:37,751 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-01T20:49:37,753 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-01T20:49:37,756 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-01T20:49:37,759 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:37,761 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:37,764 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:37,767 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-01T20:49:37,769 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-01T20:49:37,772 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-01T20:49:37,774 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-01T20:49:37,777 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-01T20:49:37,779 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-01T20:49:37,782 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-01T20:49:37,784 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-01T20:49:37,786 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-01T20:49:37,788 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-01T20:49:37,791 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-01T20:49:37,793 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-01T20:49:37,795 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-01T20:49:37,798 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-01T20:49:37,801 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-01T20:49:37,803 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-01T20:49:37,805 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:37,808 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:37,811 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:37,813 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:37,815 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-01T20:49:37,817 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-01T20:49:37,820 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-01T20:49:37,822 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-01T20:49:37,824 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-01T20:49:37,826 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-01T20:49:37,829 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-01T20:49:37,831 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-01T20:49:37,834 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-01T20:49:37,836 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-01T20:49:37,839 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-01T20:49:37,841 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-01T20:49:37,843 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-01T20:49:37,846 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-01T20:49:37,848 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-01T20:49:37,851 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-01T20:49:37,899 running build_scripts 2023-12-01T20:49:37,900 creating build/scripts-3.11 2023-12-01T20:49:37,901 copying and adjusting bin/deepspeed -> build/scripts-3.11 2023-12-01T20:49:37,903 copying and adjusting bin/deepspeed.pt -> build/scripts-3.11 2023-12-01T20:49:37,905 copying and adjusting bin/ds -> build/scripts-3.11 2023-12-01T20:49:37,907 copying bin/ds_ssh -> build/scripts-3.11 2023-12-01T20:49:37,909 copying and adjusting bin/ds_report -> build/scripts-3.11 2023-12-01T20:49:37,910 copying and adjusting bin/ds_bench -> build/scripts-3.11 2023-12-01T20:49:37,912 copying and adjusting bin/dsr -> build/scripts-3.11 2023-12-01T20:49:37,913 copying and adjusting bin/ds_elastic -> build/scripts-3.11 2023-12-01T20:49:37,914 changing mode of build/scripts-3.11/deepspeed from 644 to 755 2023-12-01T20:49:37,915 changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755 2023-12-01T20:49:37,915 changing mode of build/scripts-3.11/ds from 644 to 755 2023-12-01T20:49:37,916 changing mode of build/scripts-3.11/ds_report from 644 to 755 2023-12-01T20:49:37,916 changing mode of build/scripts-3.11/ds_bench from 644 to 755 2023-12-01T20:49:37,917 changing mode of build/scripts-3.11/dsr from 644 to 755 2023-12-01T20:49:37,917 changing mode of build/scripts-3.11/ds_elastic from 644 to 755 2023-12-01T20:49:37,943 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-12-01T20:49:37,944 !! 2023-12-01T20:49:37,945 ******************************************************************************** 2023-12-01T20:49:37,946 Please avoid running ``setup.py`` directly. 2023-12-01T20:49:37,946 Instead, use pypa/build, pypa/installer or other 2023-12-01T20:49:37,947 standards-based tools. 2023-12-01T20:49:37,948 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-12-01T20:49:37,948 ******************************************************************************** 2023-12-01T20:49:37,949 !! 2023-12-01T20:49:37,950 self.initialize_options() 2023-12-01T20:49:37,970 installing to build/bdist.linux-aarch64/wheel 2023-12-01T20:49:37,971 running install 2023-12-01T20:49:37,995 running install_lib 2023-12-01T20:49:38,022 creating build/bdist.linux-aarch64 2023-12-01T20:49:38,023 creating build/bdist.linux-aarch64/wheel 2023-12-01T20:49:38,025 creating build/bdist.linux-aarch64/wheel/deepspeed 2023-12-01T20:49:38,027 creating build/bdist.linux-aarch64/wheel/deepspeed/module_inject 2023-12-01T20:49:38,028 creating build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,030 creating build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers/features 2023-12-01T20:49:38,031 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers/features 2023-12-01T20:49:38,034 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers/features 2023-12-01T20:49:38,036 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers/features 2023-12-01T20:49:38,039 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers/features 2023-12-01T20:49:38,041 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers/features 2023-12-01T20:49:38,043 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers/features 2023-12-01T20:49:38,046 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers/features 2023-12-01T20:49:38,049 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,052 copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,054 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,056 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,058 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,060 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,063 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,065 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,068 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,070 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,072 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,075 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,077 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,079 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,082 copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,084 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,086 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,089 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,091 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject/containers 2023-12-01T20:49:38,094 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject 2023-12-01T20:49:38,096 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject 2023-12-01T20:49:38,099 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject 2023-12-01T20:49:38,101 copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject 2023-12-01T20:49:38,103 copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject 2023-12-01T20:49:38,105 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject 2023-12-01T20:49:38,107 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject 2023-12-01T20:49:38,111 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject 2023-12-01T20:49:38,113 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject 2023-12-01T20:49:38,116 copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject 2023-12-01T20:49:38,118 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject 2023-12-01T20:49:38,120 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject 2023-12-01T20:49:38,123 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-aarch64/wheel/deepspeed/module_inject 2023-12-01T20:49:38,125 creating build/bdist.linux-aarch64/wheel/deepspeed/accelerator 2023-12-01T20:49:38,126 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-aarch64/wheel/deepspeed/accelerator 2023-12-01T20:49:38,128 copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-aarch64/wheel/deepspeed/accelerator 2023-12-01T20:49:38,131 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/accelerator 2023-12-01T20:49:38,133 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-aarch64/wheel/deepspeed/accelerator 2023-12-01T20:49:38,135 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-aarch64/wheel/deepspeed/accelerator 2023-12-01T20:49:38,138 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-aarch64/wheel/deepspeed/accelerator 2023-12-01T20:49:38,140 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-aarch64/wheel/deepspeed/accelerator 2023-12-01T20:49:38,143 creating build/bdist.linux-aarch64/wheel/deepspeed/monitor 2023-12-01T20:49:38,144 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/monitor 2023-12-01T20:49:38,146 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-aarch64/wheel/deepspeed/monitor 2023-12-01T20:49:38,148 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-aarch64/wheel/deepspeed/monitor 2023-12-01T20:49:38,150 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-aarch64/wheel/deepspeed/monitor 2023-12-01T20:49:38,152 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/monitor 2023-12-01T20:49:38,154 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-aarch64/wheel/deepspeed/monitor 2023-12-01T20:49:38,156 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-aarch64/wheel/deepspeed/monitor 2023-12-01T20:49:38,158 creating build/bdist.linux-aarch64/wheel/deepspeed/utils 2023-12-01T20:49:38,159 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-aarch64/wheel/deepspeed/utils 2023-12-01T20:49:38,162 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/utils 2023-12-01T20:49:38,164 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-aarch64/wheel/deepspeed/utils 2023-12-01T20:49:38,166 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-aarch64/wheel/deepspeed/utils 2023-12-01T20:49:38,168 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-aarch64/wheel/deepspeed/utils 2023-12-01T20:49:38,170 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-aarch64/wheel/deepspeed/utils 2023-12-01T20:49:38,172 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-aarch64/wheel/deepspeed/utils 2023-12-01T20:49:38,175 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-aarch64/wheel/deepspeed/utils 2023-12-01T20:49:38,177 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-aarch64/wheel/deepspeed/utils 2023-12-01T20:49:38,180 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-aarch64/wheel/deepspeed/utils 2023-12-01T20:49:38,182 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-aarch64/wheel/deepspeed/utils 2023-12-01T20:49:38,185 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-aarch64/wheel/deepspeed/utils 2023-12-01T20:49:38,187 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-aarch64/wheel/deepspeed/utils 2023-12-01T20:49:38,189 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-aarch64/wheel/deepspeed/utils 2023-12-01T20:49:38,192 creating build/bdist.linux-aarch64/wheel/deepspeed/pipe 2023-12-01T20:49:38,193 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/pipe 2023-12-01T20:49:38,195 copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-aarch64/wheel/deepspeed 2023-12-01T20:49:38,196 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed 2023-12-01T20:49:38,199 creating build/bdist.linux-aarch64/wheel/deepspeed/compression 2023-12-01T20:49:38,200 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-aarch64/wheel/deepspeed/compression 2023-12-01T20:49:38,203 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/compression 2023-12-01T20:49:38,204 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-aarch64/wheel/deepspeed/compression 2023-12-01T20:49:38,207 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/compression 2023-12-01T20:49:38,210 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-aarch64/wheel/deepspeed/compression 2023-12-01T20:49:38,212 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-aarch64/wheel/deepspeed/compression 2023-12-01T20:49:38,215 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-aarch64/wheel/deepspeed/compression 2023-12-01T20:49:38,217 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-aarch64/wheel/deepspeed/compression 2023-12-01T20:49:38,220 creating build/bdist.linux-aarch64/wheel/deepspeed/moe 2023-12-01T20:49:38,221 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-aarch64/wheel/deepspeed/moe 2023-12-01T20:49:38,224 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-aarch64/wheel/deepspeed/moe 2023-12-01T20:49:38,227 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/moe 2023-12-01T20:49:38,229 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/moe 2023-12-01T20:49:38,231 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-aarch64/wheel/deepspeed/moe 2023-12-01T20:49:38,233 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-aarch64/wheel/deepspeed/moe 2023-12-01T20:49:38,236 creating build/bdist.linux-aarch64/wheel/deepspeed/launcher 2023-12-01T20:49:38,237 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/launcher 2023-12-01T20:49:38,239 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-aarch64/wheel/deepspeed/launcher 2023-12-01T20:49:38,241 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-aarch64/wheel/deepspeed/launcher 2023-12-01T20:49:38,244 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-aarch64/wheel/deepspeed/launcher 2023-12-01T20:49:38,247 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-aarch64/wheel/deepspeed/launcher 2023-12-01T20:49:38,249 creating build/bdist.linux-aarch64/wheel/deepspeed/checkpoint 2023-12-01T20:49:38,251 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-aarch64/wheel/deepspeed/checkpoint 2023-12-01T20:49:38,253 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/checkpoint 2023-12-01T20:49:38,255 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/checkpoint 2023-12-01T20:49:38,257 copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-aarch64/wheel/deepspeed/checkpoint 2023-12-01T20:49:38,260 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/checkpoint 2023-12-01T20:49:38,262 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-aarch64/wheel/deepspeed/checkpoint 2023-12-01T20:49:38,264 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/checkpoint 2023-12-01T20:49:38,266 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-aarch64/wheel/deepspeed/checkpoint 2023-12-01T20:49:38,269 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-aarch64/wheel/deepspeed/checkpoint 2023-12-01T20:49:38,271 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-aarch64/wheel/deepspeed/checkpoint 2023-12-01T20:49:38,273 creating build/bdist.linux-aarch64/wheel/deepspeed/ops 2023-12-01T20:49:38,275 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/lion 2023-12-01T20:49:38,276 copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/lion 2023-12-01T20:49:38,278 copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/lion 2023-12-01T20:49:38,280 copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/lion 2023-12-01T20:49:38,282 copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/lion 2023-12-01T20:49:38,285 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/random_ltd 2023-12-01T20:49:38,286 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/random_ltd 2023-12-01T20:49:38,288 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/random_ltd 2023-12-01T20:49:38,290 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops 2023-12-01T20:49:38,292 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/adam 2023-12-01T20:49:38,293 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/adam 2023-12-01T20:49:38,295 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/adam 2023-12-01T20:49:38,297 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/adam 2023-12-01T20:49:38,299 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/adam 2023-12-01T20:49:38,302 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/quantizer 2023-12-01T20:49:38,303 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/quantizer 2023-12-01T20:49:38,306 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/quantizer 2023-12-01T20:49:38,308 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,309 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,312 copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,314 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,316 copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,318 copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,320 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,323 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder/npu 2023-12-01T20:49:38,324 copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder/npu 2023-12-01T20:49:38,326 copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder/npu 2023-12-01T20:49:38,328 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder/npu 2023-12-01T20:49:38,330 copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder/npu 2023-12-01T20:49:38,332 copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder/npu 2023-12-01T20:49:38,334 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder/npu 2023-12-01T20:49:38,335 copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder/npu 2023-12-01T20:49:38,337 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,339 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,341 copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,343 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,345 copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,347 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,349 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,353 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder/cpu 2023-12-01T20:49:38,354 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder/cpu 2023-12-01T20:49:38,356 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder/cpu 2023-12-01T20:49:38,358 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder/cpu 2023-12-01T20:49:38,360 copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder/cpu 2023-12-01T20:49:38,362 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder/cpu 2023-12-01T20:49:38,364 copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder/cpu 2023-12-01T20:49:38,365 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,367 copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,369 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,371 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,374 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,375 copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,377 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,379 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,381 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/op_builder 2023-12-01T20:49:38,384 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/lamb 2023-12-01T20:49:38,384 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/lamb 2023-12-01T20:49:38,386 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/lamb 2023-12-01T20:49:38,389 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc 2023-12-01T20:49:38,390 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/utils 2023-12-01T20:49:38,392 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/utils 2023-12-01T20:49:38,394 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/lion 2023-12-01T20:49:38,395 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/lion 2023-12-01T20:49:38,397 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/lion 2023-12-01T20:49:38,399 copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/lion 2023-12-01T20:49:38,401 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/lion 2023-12-01T20:49:38,404 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/lion 2023-12-01T20:49:38,407 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/random_ltd 2023-12-01T20:49:38,408 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/random_ltd 2023-12-01T20:49:38,410 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/random_ltd 2023-12-01T20:49:38,412 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/random_ltd 2023-12-01T20:49:38,415 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/random_ltd 2023-12-01T20:49:38,418 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/adam 2023-12-01T20:49:38,419 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/adam 2023-12-01T20:49:38,422 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/adam 2023-12-01T20:49:38,424 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/adam 2023-12-01T20:49:38,426 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/adam 2023-12-01T20:49:38,428 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/adam 2023-12-01T20:49:38,431 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/common 2023-12-01T20:49:38,432 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/common 2023-12-01T20:49:38,436 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,436 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,439 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,441 copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,444 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,446 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,449 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,451 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,453 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,455 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,457 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,460 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,462 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,464 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,466 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,469 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,471 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,474 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,476 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,479 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,481 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,483 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,485 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,487 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,490 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,492 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,494 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,498 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,501 copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,503 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/includes 2023-12-01T20:49:38,505 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/lamb 2023-12-01T20:49:38,507 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/lamb 2023-12-01T20:49:38,509 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/lamb 2023-12-01T20:49:38,512 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/spatial 2023-12-01T20:49:38,513 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/spatial/includes 2023-12-01T20:49:38,514 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/spatial/includes 2023-12-01T20:49:38,517 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/spatial/csrc 2023-12-01T20:49:38,518 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/spatial/csrc 2023-12-01T20:49:38,520 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/spatial/csrc 2023-12-01T20:49:38,522 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/sparse_attention 2023-12-01T20:49:38,523 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/sparse_attention 2023-12-01T20:49:38,526 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/cpu 2023-12-01T20:49:38,528 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/cpu/lion 2023-12-01T20:49:38,529 copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/cpu/lion 2023-12-01T20:49:38,531 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/cpu/adam 2023-12-01T20:49:38,532 copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/cpu/adam 2023-12-01T20:49:38,534 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/cpu/comm 2023-12-01T20:49:38,535 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/cpu/comm 2023-12-01T20:49:38,539 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science 2023-12-01T20:49:38,540 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-01T20:49:38,542 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-01T20:49:38,543 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-01T20:49:38,546 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-01T20:49:38,548 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-01T20:49:38,551 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-01T20:49:38,554 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-12-01T20:49:38,555 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-12-01T20:49:38,558 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-12-01T20:49:38,560 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-01T20:49:38,563 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-01T20:49:38,565 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-01T20:49:38,569 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-01T20:49:38,573 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-01T20:49:38,576 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-01T20:49:38,577 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-01T20:49:38,581 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-01T20:49:38,584 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-01T20:49:38,588 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-01T20:49:38,590 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-01T20:49:38,592 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-01T20:49:38,595 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-01T20:49:38,598 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-01T20:49:38,599 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-01T20:49:38,602 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-01T20:49:38,605 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-01T20:49:38,608 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-01T20:49:38,611 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-01T20:49:38,613 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-01T20:49:38,616 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-01T20:49:38,620 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-01T20:49:38,623 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/quantization 2023-12-01T20:49:38,624 copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/quantization 2023-12-01T20:49:38,626 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/quantization 2023-12-01T20:49:38,629 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/quantization 2023-12-01T20:49:38,631 copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/quantization 2023-12-01T20:49:38,634 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/quantization 2023-12-01T20:49:38,637 copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/quantization 2023-12-01T20:49:38,639 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/quantization 2023-12-01T20:49:38,642 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/adagrad 2023-12-01T20:49:38,643 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/adagrad 2023-12-01T20:49:38,646 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio 2023-12-01T20:49:38,647 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/py_test 2023-12-01T20:49:38,648 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/py_test 2023-12-01T20:49:38,651 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/common 2023-12-01T20:49:38,652 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/common 2023-12-01T20:49:38,654 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/common 2023-12-01T20:49:38,656 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/common 2023-12-01T20:49:38,659 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/common 2023-12-01T20:49:38,661 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/common 2023-12-01T20:49:38,663 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/common 2023-12-01T20:49:38,666 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:38,667 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:38,669 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:38,671 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:38,673 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:38,675 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:38,677 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:38,679 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:38,681 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:38,683 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:38,685 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:38,687 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-01T20:49:38,690 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer 2023-12-01T20:49:38,691 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer 2023-12-01T20:49:38,695 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer 2023-12-01T20:49:38,697 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer 2023-12-01T20:49:38,701 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer/inference 2023-12-01T20:49:38,702 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-12-01T20:49:38,703 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-12-01T20:49:38,706 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-12-01T20:49:38,709 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-12-01T20:49:38,712 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:38,713 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:38,716 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:38,718 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:38,720 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:38,724 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:38,727 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:38,729 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:38,732 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:38,735 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:38,738 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-01T20:49:38,740 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer 2023-12-01T20:49:38,743 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer 2023-12-01T20:49:38,746 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer 2023-12-01T20:49:38,748 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer 2023-12-01T20:49:38,751 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-aarch64/wheel/deepspeed/ops/csrc/transformer 2023-12-01T20:49:38,755 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/sparse_attention 2023-12-01T20:49:38,757 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/sparse_attention/trsrc 2023-12-01T20:49:38,758 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-aarch64/wheel/deepspeed/ops/sparse_attention/trsrc 2023-12-01T20:49:38,760 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/sparse_attention/trsrc 2023-12-01T20:49:38,762 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-aarch64/wheel/deepspeed/ops/sparse_attention/trsrc 2023-12-01T20:49:38,764 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-aarch64/wheel/deepspeed/ops/sparse_attention/trsrc 2023-12-01T20:49:38,767 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/sparse_attention 2023-12-01T20:49:38,769 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/sparse_attention 2023-12-01T20:49:38,771 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/sparse_attention 2023-12-01T20:49:38,774 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/sparse_attention 2023-12-01T20:49:38,776 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/sparse_attention 2023-12-01T20:49:38,779 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/sparse_attention 2023-12-01T20:49:38,783 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/sparse_attention 2023-12-01T20:49:38,788 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/deepspeed4science 2023-12-01T20:49:38,789 copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/deepspeed4science 2023-12-01T20:49:38,792 copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/deepspeed4science 2023-12-01T20:49:38,795 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/adagrad 2023-12-01T20:49:38,796 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/adagrad 2023-12-01T20:49:38,799 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/adagrad 2023-12-01T20:49:38,803 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/aio 2023-12-01T20:49:38,804 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/aio 2023-12-01T20:49:38,807 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer 2023-12-01T20:49:38,809 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer 2023-12-01T20:49:38,812 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference 2023-12-01T20:49:38,813 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference 2023-12-01T20:49:38,816 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:38,817 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:38,820 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:38,823 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:38,825 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:38,827 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:38,830 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:38,832 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:38,835 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:38,838 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:38,841 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-01T20:49:38,843 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference 2023-12-01T20:49:38,846 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference 2023-12-01T20:49:38,849 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference 2023-12-01T20:49:38,851 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference 2023-12-01T20:49:38,854 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference 2023-12-01T20:49:38,858 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference 2023-12-01T20:49:38,861 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference 2023-12-01T20:49:38,864 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference 2023-12-01T20:49:38,868 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference 2023-12-01T20:49:38,872 creating build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:38,873 copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:38,877 copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:38,879 copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:38,882 copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:38,884 copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:38,887 copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:38,890 copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:38,893 copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:38,896 copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:38,900 copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer/inference/triton 2023-12-01T20:49:38,902 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-aarch64/wheel/deepspeed/ops/transformer 2023-12-01T20:49:38,906 creating build/bdist.linux-aarch64/wheel/deepspeed/nebula 2023-12-01T20:49:38,907 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/nebula 2023-12-01T20:49:38,910 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-aarch64/wheel/deepspeed/nebula 2023-12-01T20:49:38,913 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-aarch64/wheel/deepspeed/nebula 2023-12-01T20:49:38,916 creating build/bdist.linux-aarch64/wheel/deepspeed/inference 2023-12-01T20:49:38,917 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference 2023-12-01T20:49:38,920 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference 2023-12-01T20:49:38,924 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2 2023-12-01T20:49:38,925 copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2 2023-12-01T20:49:38,929 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/ragged 2023-12-01T20:49:38,930 copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/ragged 2023-12-01T20:49:38,934 copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/ragged 2023-12-01T20:49:38,937 copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/ragged 2023-12-01T20:49:38,940 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/ragged/includes 2023-12-01T20:49:38,941 copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/ragged/includes 2023-12-01T20:49:38,944 copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/ragged 2023-12-01T20:49:38,947 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/ragged/csrc 2023-12-01T20:49:38,949 copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/ragged/csrc 2023-12-01T20:49:38,952 copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/ragged/csrc 2023-12-01T20:49:38,955 copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/ragged 2023-12-01T20:49:38,958 copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/ragged 2023-12-01T20:49:38,960 copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/ragged 2023-12-01T20:49:38,964 copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2 2023-12-01T20:49:38,966 copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2 2023-12-01T20:49:38,969 copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2 2023-12-01T20:49:38,972 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/checkpoint 2023-12-01T20:49:38,973 copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/checkpoint 2023-12-01T20:49:38,976 copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/checkpoint 2023-12-01T20:49:38,978 copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/checkpoint 2023-12-01T20:49:38,980 copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/checkpoint 2023-12-01T20:49:38,983 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations 2023-12-01T20:49:38,984 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-12-01T20:49:38,986 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-12-01T20:49:38,988 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-12-01T20:49:38,990 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-12-01T20:49:38,992 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-12-01T20:49:38,995 copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations 2023-12-01T20:49:38,998 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:38,999 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:39,002 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:39,004 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:39,006 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:39,008 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:39,010 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:39,012 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:39,014 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:39,016 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-01T20:49:39,018 copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations 2023-12-01T20:49:39,020 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-01T20:49:39,021 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-01T20:49:39,024 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-01T20:49:39,026 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-01T20:49:39,028 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-01T20:49:39,031 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:39,032 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:39,034 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:39,036 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:39,038 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:39,040 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:39,042 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:39,044 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:39,046 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:39,049 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-01T20:49:39,051 copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations 2023-12-01T20:49:39,054 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/opt 2023-12-01T20:49:39,055 copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/opt 2023-12-01T20:49:39,057 copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/opt 2023-12-01T20:49:39,059 copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/opt 2023-12-01T20:49:39,061 copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations/opt 2023-12-01T20:49:39,064 copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations 2023-12-01T20:49:39,067 copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations 2023-12-01T20:49:39,070 copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations 2023-12-01T20:49:39,073 copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/model_implementations 2023-12-01T20:49:39,076 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules 2023-12-01T20:49:39,078 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:39,079 copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:39,081 copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:39,084 copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:39,086 copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:39,088 copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:39,091 copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:39,093 copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:39,095 copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-01T20:49:39,097 copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules 2023-12-01T20:49:39,099 copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules 2023-12-01T20:49:39,102 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations 2023-12-01T20:49:39,104 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-12-01T20:49:39,105 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-12-01T20:49:39,107 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-12-01T20:49:39,110 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/unembed 2023-12-01T20:49:39,111 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/unembed 2023-12-01T20:49:39,113 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/unembed 2023-12-01T20:49:39,116 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/embedding 2023-12-01T20:49:39,117 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/embedding 2023-12-01T20:49:39,119 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/embedding 2023-12-01T20:49:39,121 copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations 2023-12-01T20:49:39,123 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-12-01T20:49:39,124 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-12-01T20:49:39,126 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-12-01T20:49:39,129 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2023-12-01T20:49:39,130 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2023-12-01T20:49:39,132 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2023-12-01T20:49:39,135 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-12-01T20:49:39,136 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-12-01T20:49:39,138 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-12-01T20:49:39,141 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-12-01T20:49:39,143 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/attention 2023-12-01T20:49:39,144 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/attention 2023-12-01T20:49:39,147 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/implementations/attention 2023-12-01T20:49:39,150 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/configs 2023-12-01T20:49:39,151 copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/configs 2023-12-01T20:49:39,153 copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/configs 2023-12-01T20:49:39,156 copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/configs 2023-12-01T20:49:39,157 copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/configs 2023-12-01T20:49:39,159 copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/configs 2023-12-01T20:49:39,161 copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/configs 2023-12-01T20:49:39,163 copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules/configs 2023-12-01T20:49:39,165 copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules 2023-12-01T20:49:39,167 copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/modules 2023-12-01T20:49:39,170 copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2 2023-12-01T20:49:39,172 copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2 2023-12-01T20:49:39,174 copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2 2023-12-01T20:49:39,176 copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2 2023-12-01T20:49:39,179 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels 2023-12-01T20:49:39,180 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2023-12-01T20:49:39,181 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2023-12-01T20:49:39,184 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-12-01T20:49:39,185 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-12-01T20:49:39,188 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-01T20:49:39,189 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-01T20:49:39,191 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-01T20:49:39,193 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-01T20:49:39,196 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-01T20:49:39,198 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-01T20:49:39,201 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2023-12-01T20:49:39,203 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-01T20:49:39,204 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-01T20:49:39,207 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-01T20:49:39,209 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-01T20:49:39,210 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-01T20:49:39,212 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-01T20:49:39,214 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-01T20:49:39,217 copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels 2023-12-01T20:49:39,219 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops 2023-12-01T20:49:39,221 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-01T20:49:39,222 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-01T20:49:39,224 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-01T20:49:39,227 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-01T20:49:39,229 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-01T20:49:39,231 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-01T20:49:39,233 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-01T20:49:39,234 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-01T20:49:39,237 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-01T20:49:39,239 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-01T20:49:39,241 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-01T20:49:39,244 copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops 2023-12-01T20:49:39,246 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:39,248 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:39,250 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:39,252 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:39,254 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:39,256 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:39,258 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:39,260 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:39,263 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-01T20:49:39,266 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-01T20:49:39,267 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-01T20:49:39,269 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-01T20:49:39,271 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-01T20:49:39,273 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-01T20:49:39,275 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-01T20:49:39,278 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-01T20:49:39,280 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-01T20:49:39,282 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-01T20:49:39,283 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-01T20:49:39,285 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-01T20:49:39,287 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-01T20:49:39,290 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-01T20:49:39,292 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-01T20:49:39,294 copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/core_ops 2023-12-01T20:49:39,297 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/includes 2023-12-01T20:49:39,298 copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/includes 2023-12-01T20:49:39,300 copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/includes 2023-12-01T20:49:39,302 copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/includes 2023-12-01T20:49:39,305 copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/includes 2023-12-01T20:49:39,309 copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/includes 2023-12-01T20:49:39,311 copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels 2023-12-01T20:49:39,313 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops 2023-12-01T20:49:39,314 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-01T20:49:39,316 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-01T20:49:39,318 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-01T20:49:39,320 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-01T20:49:39,322 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-01T20:49:39,325 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-01T20:49:39,326 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-01T20:49:39,328 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-01T20:49:39,330 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-01T20:49:39,332 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-01T20:49:39,334 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-01T20:49:39,336 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-01T20:49:39,339 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-01T20:49:39,340 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-01T20:49:39,342 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-01T20:49:39,344 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-01T20:49:39,346 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-01T20:49:39,348 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-01T20:49:39,351 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-01T20:49:39,353 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-12-01T20:49:39,354 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-12-01T20:49:39,356 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-12-01T20:49:39,358 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-12-01T20:49:39,360 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops 2023-12-01T20:49:39,362 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:39,363 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:39,366 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:39,368 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:39,371 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:39,373 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:39,375 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:39,377 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:39,379 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-01T20:49:39,382 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-01T20:49:39,383 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-01T20:49:39,385 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-01T20:49:39,387 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-01T20:49:39,389 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-01T20:49:39,391 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-01T20:49:39,393 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-01T20:49:39,395 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-01T20:49:39,396 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-01T20:49:39,398 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-01T20:49:39,400 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-01T20:49:39,402 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-01T20:49:39,404 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-01T20:49:39,412 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-01T20:49:39,414 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops 2023-12-01T20:49:39,416 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-01T20:49:39,417 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-01T20:49:39,419 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-01T20:49:39,422 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-01T20:49:39,424 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-01T20:49:39,427 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-01T20:49:39,429 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-01T20:49:39,431 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-01T20:49:39,433 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-01T20:49:39,435 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-01T20:49:39,437 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-01T20:49:39,439 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-01T20:49:39,442 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-01T20:49:39,444 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-01T20:49:39,446 copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/v2 2023-12-01T20:49:39,448 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference 2023-12-01T20:49:39,452 creating build/bdist.linux-aarch64/wheel/deepspeed/inference/quantization 2023-12-01T20:49:39,453 copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/quantization 2023-12-01T20:49:39,455 copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/quantization 2023-12-01T20:49:39,457 copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/quantization 2023-12-01T20:49:39,460 copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/quantization 2023-12-01T20:49:39,462 copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-aarch64/wheel/deepspeed/inference/quantization 2023-12-01T20:49:39,465 creating build/bdist.linux-aarch64/wheel/deepspeed/runtime 2023-12-01T20:49:39,467 creating build/bdist.linux-aarch64/wheel/deepspeed/runtime/fp16 2023-12-01T20:49:39,468 creating build/bdist.linux-aarch64/wheel/deepspeed/runtime/fp16/onebit 2023-12-01T20:49:39,469 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/fp16/onebit 2023-12-01T20:49:39,472 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/fp16/onebit 2023-12-01T20:49:39,475 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/fp16/onebit 2023-12-01T20:49:39,477 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/fp16/onebit 2023-12-01T20:49:39,480 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/fp16 2023-12-01T20:49:39,483 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/fp16 2023-12-01T20:49:39,485 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/fp16 2023-12-01T20:49:39,487 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/fp16 2023-12-01T20:49:39,491 creating build/bdist.linux-aarch64/wheel/deepspeed/runtime/pipe 2023-12-01T20:49:39,491 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/pipe 2023-12-01T20:49:39,494 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/pipe 2023-12-01T20:49:39,496 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/pipe 2023-12-01T20:49:39,499 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/pipe 2023-12-01T20:49:39,502 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/pipe 2023-12-01T20:49:39,505 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/pipe 2023-12-01T20:49:39,508 creating build/bdist.linux-aarch64/wheel/deepspeed/runtime/checkpoint_engine 2023-12-01T20:49:39,509 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/checkpoint_engine 2023-12-01T20:49:39,512 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/checkpoint_engine 2023-12-01T20:49:39,513 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/checkpoint_engine 2023-12-01T20:49:39,515 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/checkpoint_engine 2023-12-01T20:49:39,517 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime 2023-12-01T20:49:39,520 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime 2023-12-01T20:49:39,522 creating build/bdist.linux-aarch64/wheel/deepspeed/runtime/data_pipeline 2023-12-01T20:49:39,523 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/data_pipeline 2023-12-01T20:49:39,525 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/data_pipeline 2023-12-01T20:49:39,528 creating build/bdist.linux-aarch64/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-12-01T20:49:39,529 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-12-01T20:49:39,532 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-12-01T20:49:39,534 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-12-01T20:49:39,536 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-12-01T20:49:39,538 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-12-01T20:49:39,541 creating build/bdist.linux-aarch64/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-12-01T20:49:39,542 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-12-01T20:49:39,545 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-12-01T20:49:39,547 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-12-01T20:49:39,549 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-12-01T20:49:39,552 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-12-01T20:49:39,555 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/data_pipeline 2023-12-01T20:49:39,557 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/data_pipeline 2023-12-01T20:49:39,560 creating build/bdist.linux-aarch64/wheel/deepspeed/runtime/compression 2023-12-01T20:49:39,561 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/compression 2023-12-01T20:49:39,564 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/compression 2023-12-01T20:49:39,566 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime 2023-12-01T20:49:39,569 creating build/bdist.linux-aarch64/wheel/deepspeed/runtime/swap_tensor 2023-12-01T20:49:39,571 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/swap_tensor 2023-12-01T20:49:39,573 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/swap_tensor 2023-12-01T20:49:39,575 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/swap_tensor 2023-12-01T20:49:39,577 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/swap_tensor 2023-12-01T20:49:39,580 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/swap_tensor 2023-12-01T20:49:39,582 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/swap_tensor 2023-12-01T20:49:39,585 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/swap_tensor 2023-12-01T20:49:39,587 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/swap_tensor 2023-12-01T20:49:39,589 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/swap_tensor 2023-12-01T20:49:39,592 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime 2023-12-01T20:49:39,594 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime 2023-12-01T20:49:39,598 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime 2023-12-01T20:49:39,601 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime 2023-12-01T20:49:39,604 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime 2023-12-01T20:49:39,607 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime 2023-12-01T20:49:39,612 creating build/bdist.linux-aarch64/wheel/deepspeed/runtime/activation_checkpointing 2023-12-01T20:49:39,613 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/activation_checkpointing 2023-12-01T20:49:39,615 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/activation_checkpointing 2023-12-01T20:49:39,618 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/activation_checkpointing 2023-12-01T20:49:39,621 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime 2023-12-01T20:49:39,624 creating build/bdist.linux-aarch64/wheel/deepspeed/runtime/comm 2023-12-01T20:49:39,625 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/comm 2023-12-01T20:49:39,628 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/comm 2023-12-01T20:49:39,630 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/comm 2023-12-01T20:49:39,633 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/comm 2023-12-01T20:49:39,635 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime 2023-12-01T20:49:39,638 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime 2023-12-01T20:49:39,641 creating build/bdist.linux-aarch64/wheel/deepspeed/runtime/zero 2023-12-01T20:49:39,642 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/zero 2023-12-01T20:49:39,644 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/zero 2023-12-01T20:49:39,646 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/zero 2023-12-01T20:49:39,649 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/zero 2023-12-01T20:49:39,653 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/zero 2023-12-01T20:49:39,655 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/zero 2023-12-01T20:49:39,657 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/zero 2023-12-01T20:49:39,660 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/zero 2023-12-01T20:49:39,663 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/zero 2023-12-01T20:49:39,667 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/zero 2023-12-01T20:49:39,669 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/zero 2023-12-01T20:49:39,672 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/zero 2023-12-01T20:49:39,674 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/zero 2023-12-01T20:49:39,677 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/zero 2023-12-01T20:49:39,680 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/zero 2023-12-01T20:49:39,685 copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime/zero 2023-12-01T20:49:39,687 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime 2023-12-01T20:49:39,689 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime 2023-12-01T20:49:39,692 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime 2023-12-01T20:49:39,694 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-aarch64/wheel/deepspeed/runtime 2023-12-01T20:49:39,696 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-aarch64/wheel/deepspeed 2023-12-01T20:49:39,700 creating build/bdist.linux-aarch64/wheel/deepspeed/profiling 2023-12-01T20:49:39,701 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/profiling 2023-12-01T20:49:39,703 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-aarch64/wheel/deepspeed/profiling 2023-12-01T20:49:39,705 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-aarch64/wheel/deepspeed/profiling 2023-12-01T20:49:39,707 creating build/bdist.linux-aarch64/wheel/deepspeed/profiling/flops_profiler 2023-12-01T20:49:39,708 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-aarch64/wheel/deepspeed/profiling/flops_profiler 2023-12-01T20:49:39,712 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/profiling/flops_profiler 2023-12-01T20:49:39,714 creating build/bdist.linux-aarch64/wheel/deepspeed/comm 2023-12-01T20:49:39,715 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-aarch64/wheel/deepspeed/comm 2023-12-01T20:49:39,718 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-aarch64/wheel/deepspeed/comm 2023-12-01T20:49:39,721 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-aarch64/wheel/deepspeed/comm 2023-12-01T20:49:39,722 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/comm 2023-12-01T20:49:39,724 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-aarch64/wheel/deepspeed/comm 2023-12-01T20:49:39,726 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-aarch64/wheel/deepspeed/comm 2023-12-01T20:49:39,729 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/comm 2023-12-01T20:49:39,731 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-aarch64/wheel/deepspeed/comm 2023-12-01T20:49:39,733 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-aarch64/wheel/deepspeed/comm 2023-12-01T20:49:39,735 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-aarch64/wheel/deepspeed 2023-12-01T20:49:39,737 creating build/bdist.linux-aarch64/wheel/deepspeed/model_implementations 2023-12-01T20:49:39,739 creating build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/features 2023-12-01T20:49:39,740 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/features 2023-12-01T20:49:39,742 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/features 2023-12-01T20:49:39,745 creating build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/diffusers 2023-12-01T20:49:39,746 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/diffusers 2023-12-01T20:49:39,748 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/diffusers 2023-12-01T20:49:39,750 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/diffusers 2023-12-01T20:49:39,752 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/model_implementations 2023-12-01T20:49:39,755 creating build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/transformers 2023-12-01T20:49:39,756 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/transformers 2023-12-01T20:49:39,761 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/transformers 2023-12-01T20:49:39,764 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/transformers 2023-12-01T20:49:39,766 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/transformers 2023-12-01T20:49:39,768 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/transformers 2023-12-01T20:49:39,770 copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/transformers 2023-12-01T20:49:39,772 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/transformers 2023-12-01T20:49:39,774 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/transformers 2023-12-01T20:49:39,776 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/transformers 2023-12-01T20:49:39,778 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-aarch64/wheel/deepspeed/model_implementations/transformers 2023-12-01T20:49:39,780 creating build/bdist.linux-aarch64/wheel/deepspeed/autotuning 2023-12-01T20:49:39,781 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-aarch64/wheel/deepspeed/autotuning 2023-12-01T20:49:39,784 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-aarch64/wheel/deepspeed/autotuning 2023-12-01T20:49:39,787 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/autotuning 2023-12-01T20:49:39,789 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-aarch64/wheel/deepspeed/autotuning 2023-12-01T20:49:39,791 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/autotuning 2023-12-01T20:49:39,795 creating build/bdist.linux-aarch64/wheel/deepspeed/autotuning/tuner 2023-12-01T20:49:39,796 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-aarch64/wheel/deepspeed/autotuning/tuner 2023-12-01T20:49:39,798 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/autotuning/tuner 2023-12-01T20:49:39,800 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-aarch64/wheel/deepspeed/autotuning/tuner 2023-12-01T20:49:39,802 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-aarch64/wheel/deepspeed/autotuning/tuner 2023-12-01T20:49:39,804 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/autotuning/tuner 2023-12-01T20:49:39,806 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-aarch64/wheel/deepspeed/autotuning/tuner 2023-12-01T20:49:39,809 creating build/bdist.linux-aarch64/wheel/deepspeed/autotuning/config_templates 2023-12-01T20:49:39,810 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-aarch64/wheel/deepspeed/autotuning/config_templates 2023-12-01T20:49:39,812 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-aarch64/wheel/deepspeed/autotuning/config_templates 2023-12-01T20:49:39,814 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-aarch64/wheel/deepspeed/autotuning/config_templates 2023-12-01T20:49:39,816 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-aarch64/wheel/deepspeed/autotuning/config_templates 2023-12-01T20:49:39,818 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-aarch64/wheel/deepspeed/autotuning 2023-12-01T20:49:39,820 creating build/bdist.linux-aarch64/wheel/deepspeed/sequence 2023-12-01T20:49:39,822 copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-aarch64/wheel/deepspeed/sequence 2023-12-01T20:49:39,824 copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/sequence 2023-12-01T20:49:39,826 copying build/lib/deepspeed/constants.py -> build/bdist.linux-aarch64/wheel/deepspeed 2023-12-01T20:49:39,828 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-aarch64/wheel/deepspeed 2023-12-01T20:49:39,830 creating build/bdist.linux-aarch64/wheel/deepspeed/elasticity 2023-12-01T20:49:39,831 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-aarch64/wheel/deepspeed/elasticity 2023-12-01T20:49:39,833 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-aarch64/wheel/deepspeed/elasticity 2023-12-01T20:49:39,836 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-aarch64/wheel/deepspeed/elasticity 2023-12-01T20:49:39,838 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-aarch64/wheel/deepspeed/elasticity 2023-12-01T20:49:39,840 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-aarch64/wheel/deepspeed/elasticity 2023-12-01T20:49:39,842 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-aarch64/wheel/deepspeed/elasticity 2023-12-01T20:49:39,844 running install_egg_info 2023-12-01T20:49:39,875 Copying deepspeed.egg-info to build/bdist.linux-aarch64/wheel/deepspeed-0.12.4-py3.11.egg-info 2023-12-01T20:49:39,890 running install_scripts 2023-12-01T20:49:39,891 creating build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data 2023-12-01T20:49:39,892 creating build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data/scripts 2023-12-01T20:49:39,892 copying build/scripts-3.11/ds_report -> build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data/scripts 2023-12-01T20:49:39,894 copying build/scripts-3.11/dsr -> build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data/scripts 2023-12-01T20:49:39,896 copying build/scripts-3.11/ds -> build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data/scripts 2023-12-01T20:49:39,898 copying build/scripts-3.11/ds_ssh -> build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data/scripts 2023-12-01T20:49:39,900 copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data/scripts 2023-12-01T20:49:39,902 copying build/scripts-3.11/deepspeed -> build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data/scripts 2023-12-01T20:49:39,904 copying build/scripts-3.11/ds_bench -> build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data/scripts 2023-12-01T20:49:39,906 copying build/scripts-3.11/ds_elastic -> build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data/scripts 2023-12-01T20:49:39,908 changing mode of build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data/scripts/ds_report to 755 2023-12-01T20:49:39,909 changing mode of build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data/scripts/dsr to 755 2023-12-01T20:49:39,909 changing mode of build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data/scripts/ds to 755 2023-12-01T20:49:39,910 changing mode of build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data/scripts/ds_ssh to 755 2023-12-01T20:49:39,911 changing mode of build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data/scripts/deepspeed.pt to 755 2023-12-01T20:49:39,911 changing mode of build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data/scripts/deepspeed to 755 2023-12-01T20:49:39,912 changing mode of build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data/scripts/ds_bench to 755 2023-12-01T20:49:39,912 changing mode of build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.data/scripts/ds_elastic to 755 2023-12-01T20:49:39,955 creating build/bdist.linux-aarch64/wheel/deepspeed-0.12.4.dist-info/WHEEL 2023-12-01T20:49:39,958 creating '/tmp/pip-wheel-cxfrttmp/deepspeed-0.12.4-py3-none-any.whl' and adding 'build/bdist.linux-aarch64/wheel' to it 2023-12-01T20:49:39,962 adding 'deepspeed/__init__.py' 2023-12-01T20:49:39,964 adding 'deepspeed/constants.py' 2023-12-01T20:49:39,965 adding 'deepspeed/env_report.py' 2023-12-01T20:49:39,967 adding 'deepspeed/git_version_info.py' 2023-12-01T20:49:39,968 adding 'deepspeed/git_version_info_installed.py' 2023-12-01T20:49:39,970 adding 'deepspeed/pydantic_v1.py' 2023-12-01T20:49:39,972 adding 'deepspeed/accelerator/__init__.py' 2023-12-01T20:49:39,973 adding 'deepspeed/accelerator/abstract_accelerator.py' 2023-12-01T20:49:39,975 adding 'deepspeed/accelerator/cpu_accelerator.py' 2023-12-01T20:49:39,977 adding 'deepspeed/accelerator/cuda_accelerator.py' 2023-12-01T20:49:39,978 adding 'deepspeed/accelerator/mps_accelerator.py' 2023-12-01T20:49:39,980 adding 'deepspeed/accelerator/npu_accelerator.py' 2023-12-01T20:49:39,981 adding 'deepspeed/accelerator/real_accelerator.py' 2023-12-01T20:49:39,983 adding 'deepspeed/autotuning/__init__.py' 2023-12-01T20:49:39,989 adding 'deepspeed/autotuning/autotuner.py' 2023-12-01T20:49:39,990 adding 'deepspeed/autotuning/config.py' 2023-12-01T20:49:39,992 adding 'deepspeed/autotuning/constants.py' 2023-12-01T20:49:39,994 adding 'deepspeed/autotuning/scheduler.py' 2023-12-01T20:49:39,997 adding 'deepspeed/autotuning/utils.py' 2023-12-01T20:49:39,999 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2023-12-01T20:49:40,000 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2023-12-01T20:49:40,001 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2023-12-01T20:49:40,002 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2023-12-01T20:49:40,004 adding 'deepspeed/autotuning/tuner/__init__.py' 2023-12-01T20:49:40,006 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2023-12-01T20:49:40,007 adding 'deepspeed/autotuning/tuner/cost_model.py' 2023-12-01T20:49:40,008 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2023-12-01T20:49:40,010 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2023-12-01T20:49:40,011 adding 'deepspeed/autotuning/tuner/utils.py' 2023-12-01T20:49:40,013 adding 'deepspeed/checkpoint/__init__.py' 2023-12-01T20:49:40,015 adding 'deepspeed/checkpoint/constants.py' 2023-12-01T20:49:40,017 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2023-12-01T20:49:40,019 adding 'deepspeed/checkpoint/ds_to_universal.py' 2023-12-01T20:49:40,021 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2023-12-01T20:49:40,023 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2023-12-01T20:49:40,024 adding 'deepspeed/checkpoint/reshape_utils.py' 2023-12-01T20:49:40,026 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2023-12-01T20:49:40,027 adding 'deepspeed/checkpoint/utils.py' 2023-12-01T20:49:40,029 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2023-12-01T20:49:40,031 adding 'deepspeed/comm/__init__.py' 2023-12-01T20:49:40,032 adding 'deepspeed/comm/backend.py' 2023-12-01T20:49:40,034 adding 'deepspeed/comm/ccl.py' 2023-12-01T20:49:40,037 adding 'deepspeed/comm/comm.py' 2023-12-01T20:49:40,038 adding 'deepspeed/comm/config.py' 2023-12-01T20:49:40,040 adding 'deepspeed/comm/constants.py' 2023-12-01T20:49:40,041 adding 'deepspeed/comm/reduce_op.py' 2023-12-01T20:49:40,043 adding 'deepspeed/comm/torch.py' 2023-12-01T20:49:40,045 adding 'deepspeed/comm/utils.py' 2023-12-01T20:49:40,047 adding 'deepspeed/compression/__init__.py' 2023-12-01T20:49:40,050 adding 'deepspeed/compression/basic_layer.py' 2023-12-01T20:49:40,052 adding 'deepspeed/compression/compress.py' 2023-12-01T20:49:40,055 adding 'deepspeed/compression/config.py' 2023-12-01T20:49:40,057 adding 'deepspeed/compression/constants.py' 2023-12-01T20:49:40,059 adding 'deepspeed/compression/helper.py' 2023-12-01T20:49:40,061 adding 'deepspeed/compression/scheduler.py' 2023-12-01T20:49:40,063 adding 'deepspeed/compression/utils.py' 2023-12-01T20:49:40,064 adding 'deepspeed/elasticity/__init__.py' 2023-12-01T20:49:40,066 adding 'deepspeed/elasticity/config.py' 2023-12-01T20:49:40,067 adding 'deepspeed/elasticity/constants.py' 2023-12-01T20:49:40,069 adding 'deepspeed/elasticity/elastic_agent.py' 2023-12-01T20:49:40,072 adding 'deepspeed/elasticity/elasticity.py' 2023-12-01T20:49:40,073 adding 'deepspeed/elasticity/utils.py' 2023-12-01T20:49:40,075 adding 'deepspeed/inference/__init__.py' 2023-12-01T20:49:40,077 adding 'deepspeed/inference/config.py' 2023-12-01T20:49:40,080 adding 'deepspeed/inference/engine.py' 2023-12-01T20:49:40,082 adding 'deepspeed/inference/quantization/__init__.py' 2023-12-01T20:49:40,084 adding 'deepspeed/inference/quantization/layers.py' 2023-12-01T20:49:40,085 adding 'deepspeed/inference/quantization/quantization.py' 2023-12-01T20:49:40,087 adding 'deepspeed/inference/quantization/quantization_context.py' 2023-12-01T20:49:40,089 adding 'deepspeed/inference/quantization/utils.py' 2023-12-01T20:49:40,091 adding 'deepspeed/inference/v2/__init__.py' 2023-12-01T20:49:40,092 adding 'deepspeed/inference/v2/allocator.py' 2023-12-01T20:49:40,093 adding 'deepspeed/inference/v2/config_v2.py' 2023-12-01T20:49:40,095 adding 'deepspeed/inference/v2/engine_factory.py' 2023-12-01T20:49:40,096 adding 'deepspeed/inference/v2/engine_v2.py' 2023-12-01T20:49:40,098 adding 'deepspeed/inference/v2/inference_parameter.py' 2023-12-01T20:49:40,100 adding 'deepspeed/inference/v2/inference_utils.py' 2023-12-01T20:49:40,101 adding 'deepspeed/inference/v2/logging.py' 2023-12-01T20:49:40,102 adding 'deepspeed/inference/v2/scheduling_utils.py' 2023-12-01T20:49:40,104 adding 'deepspeed/inference/v2/checkpoint/__init__.py' 2023-12-01T20:49:40,105 adding 'deepspeed/inference/v2/checkpoint/base_engine.py' 2023-12-01T20:49:40,107 adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py' 2023-12-01T20:49:40,108 adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py' 2023-12-01T20:49:40,110 adding 'deepspeed/inference/v2/kernels/__init__.py' 2023-12-01T20:49:40,111 adding 'deepspeed/inference/v2/kernels/ds_kernel.py' 2023-12-01T20:49:40,113 adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py' 2023-12-01T20:49:40,115 adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp' 2023-12-01T20:49:40,117 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py' 2023-12-01T20:49:40,118 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp' 2023-12-01T20:49:40,120 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu' 2023-12-01T20:49:40,121 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h' 2023-12-01T20:49:40,123 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py' 2023-12-01T20:49:40,125 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py' 2023-12-01T20:49:40,126 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h' 2023-12-01T20:49:40,127 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py' 2023-12-01T20:49:40,129 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h' 2023-12-01T20:49:40,131 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py' 2023-12-01T20:49:40,133 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py' 2023-12-01T20:49:40,134 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py' 2023-12-01T20:49:40,136 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py' 2023-12-01T20:49:40,137 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py' 2023-12-01T20:49:40,139 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp' 2023-12-01T20:49:40,141 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu' 2023-12-01T20:49:40,143 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h' 2023-12-01T20:49:40,145 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py' 2023-12-01T20:49:40,146 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp' 2023-12-01T20:49:40,149 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu' 2023-12-01T20:49:40,150 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h' 2023-12-01T20:49:40,151 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py' 2023-12-01T20:49:40,153 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py' 2023-12-01T20:49:40,154 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py' 2023-12-01T20:49:40,156 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py' 2023-12-01T20:49:40,158 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py' 2023-12-01T20:49:40,160 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp' 2023-12-01T20:49:40,161 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu' 2023-12-01T20:49:40,163 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h' 2023-12-01T20:49:40,165 adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py' 2023-12-01T20:49:40,166 adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp' 2023-12-01T20:49:40,168 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py' 2023-12-01T20:49:40,169 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu' 2023-12-01T20:49:40,171 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h' 2023-12-01T20:49:40,172 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py' 2023-12-01T20:49:40,174 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h' 2023-12-01T20:49:40,175 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py' 2023-12-01T20:49:40,177 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py' 2023-12-01T20:49:40,178 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu' 2023-12-01T20:49:40,180 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h' 2023-12-01T20:49:40,181 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py' 2023-12-01T20:49:40,183 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h' 2023-12-01T20:49:40,184 adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h' 2023-12-01T20:49:40,186 adding 'deepspeed/inference/v2/kernels/includes/activation_type.h' 2023-12-01T20:49:40,188 adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h' 2023-12-01T20:49:40,189 adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h' 2023-12-01T20:49:40,192 adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h' 2023-12-01T20:49:40,195 adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h' 2023-12-01T20:49:40,197 adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py' 2023-12-01T20:49:40,198 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp' 2023-12-01T20:49:40,200 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py' 2023-12-01T20:49:40,202 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp' 2023-12-01T20:49:40,204 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h' 2023-12-01T20:49:40,205 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py' 2023-12-01T20:49:40,207 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py' 2023-12-01T20:49:40,209 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h' 2023-12-01T20:49:40,210 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp' 2023-12-01T20:49:40,212 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h' 2023-12-01T20:49:40,213 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py' 2023-12-01T20:49:40,215 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h' 2023-12-01T20:49:40,217 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py' 2023-12-01T20:49:40,219 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp' 2023-12-01T20:49:40,220 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu' 2023-12-01T20:49:40,222 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh' 2023-12-01T20:49:40,223 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h' 2023-12-01T20:49:40,225 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py' 2023-12-01T20:49:40,227 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py' 2023-12-01T20:49:40,228 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp' 2023-12-01T20:49:40,230 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu' 2023-12-01T20:49:40,232 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh' 2023-12-01T20:49:40,233 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h' 2023-12-01T20:49:40,235 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py' 2023-12-01T20:49:40,236 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py' 2023-12-01T20:49:40,238 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py' 2023-12-01T20:49:40,240 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py' 2023-12-01T20:49:40,241 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp' 2023-12-01T20:49:40,243 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu' 2023-12-01T20:49:40,244 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh' 2023-12-01T20:49:40,246 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h' 2023-12-01T20:49:40,248 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py' 2023-12-01T20:49:40,249 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py' 2023-12-01T20:49:40,251 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp' 2023-12-01T20:49:40,252 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu' 2023-12-01T20:49:40,254 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh' 2023-12-01T20:49:40,255 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h' 2023-12-01T20:49:40,257 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py' 2023-12-01T20:49:40,259 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py' 2023-12-01T20:49:40,260 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp' 2023-12-01T20:49:40,262 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu' 2023-12-01T20:49:40,263 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh' 2023-12-01T20:49:40,265 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h' 2023-12-01T20:49:40,267 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py' 2023-12-01T20:49:40,269 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h' 2023-12-01T20:49:40,270 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp' 2023-12-01T20:49:40,271 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h' 2023-12-01T20:49:40,273 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py' 2023-12-01T20:49:40,275 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp' 2023-12-01T20:49:40,276 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu' 2023-12-01T20:49:40,278 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh' 2023-12-01T20:49:40,279 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h' 2023-12-01T20:49:40,280 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py' 2023-12-01T20:49:40,282 adding 'deepspeed/inference/v2/model_implementations/__init__.py' 2023-12-01T20:49:40,284 adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py' 2023-12-01T20:49:40,286 adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py' 2023-12-01T20:49:40,288 adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py' 2023-12-01T20:49:40,290 adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py' 2023-12-01T20:49:40,292 adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py' 2023-12-01T20:49:40,294 adding 'deepspeed/inference/v2/model_implementations/parameter_base.py' 2023-12-01T20:49:40,297 adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py' 2023-12-01T20:49:40,298 adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py' 2023-12-01T20:49:40,300 adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py' 2023-12-01T20:49:40,301 adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py' 2023-12-01T20:49:40,303 adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py' 2023-12-01T20:49:40,305 adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py' 2023-12-01T20:49:40,306 adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py' 2023-12-01T20:49:40,307 adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py' 2023-12-01T20:49:40,308 adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py' 2023-12-01T20:49:40,310 adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py' 2023-12-01T20:49:40,312 adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py' 2023-12-01T20:49:40,314 adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py' 2023-12-01T20:49:40,315 adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py' 2023-12-01T20:49:40,317 adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py' 2023-12-01T20:49:40,318 adding 'deepspeed/inference/v2/model_implementations/mistral/container.py' 2023-12-01T20:49:40,320 adding 'deepspeed/inference/v2/model_implementations/mistral/model.py' 2023-12-01T20:49:40,321 adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py' 2023-12-01T20:49:40,323 adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py' 2023-12-01T20:49:40,325 adding 'deepspeed/inference/v2/model_implementations/opt/container.py' 2023-12-01T20:49:40,326 adding 'deepspeed/inference/v2/model_implementations/opt/model.py' 2023-12-01T20:49:40,328 adding 'deepspeed/inference/v2/model_implementations/opt/policy.py' 2023-12-01T20:49:40,330 adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py' 2023-12-01T20:49:40,331 adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py' 2023-12-01T20:49:40,333 adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py' 2023-12-01T20:49:40,334 adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py' 2023-12-01T20:49:40,336 adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py' 2023-12-01T20:49:40,338 adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py' 2023-12-01T20:49:40,339 adding 'deepspeed/inference/v2/model_implementations/sharding/types.py' 2023-12-01T20:49:40,341 adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py' 2023-12-01T20:49:40,342 adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py' 2023-12-01T20:49:40,345 adding 'deepspeed/inference/v2/modules/__init__.py' 2023-12-01T20:49:40,346 adding 'deepspeed/inference/v2/modules/ds_module.py' 2023-12-01T20:49:40,348 adding 'deepspeed/inference/v2/modules/heuristics.py' 2023-12-01T20:49:40,349 adding 'deepspeed/inference/v2/modules/module_registry.py' 2023-12-01T20:49:40,351 adding 'deepspeed/inference/v2/modules/configs/__init__.py' 2023-12-01T20:49:40,353 adding 'deepspeed/inference/v2/modules/configs/attention_configs.py' 2023-12-01T20:49:40,355 adding 'deepspeed/inference/v2/modules/configs/embedding_config.py' 2023-12-01T20:49:40,356 adding 'deepspeed/inference/v2/modules/configs/linear_config.py' 2023-12-01T20:49:40,357 adding 'deepspeed/inference/v2/modules/configs/moe_config.py' 2023-12-01T20:49:40,358 adding 'deepspeed/inference/v2/modules/configs/norm_config.py' 2023-12-01T20:49:40,360 adding 'deepspeed/inference/v2/modules/configs/unembed_config.py' 2023-12-01T20:49:40,361 adding 'deepspeed/inference/v2/modules/implementations/__init__.py' 2023-12-01T20:49:40,363 adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py' 2023-12-01T20:49:40,365 adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py' 2023-12-01T20:49:40,367 adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py' 2023-12-01T20:49:40,368 adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py' 2023-12-01T20:49:40,370 adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py' 2023-12-01T20:49:40,371 adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py' 2023-12-01T20:49:40,373 adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py' 2023-12-01T20:49:40,375 adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py' 2023-12-01T20:49:40,377 adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py' 2023-12-01T20:49:40,378 adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py' 2023-12-01T20:49:40,380 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py' 2023-12-01T20:49:40,382 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py' 2023-12-01T20:49:40,384 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py' 2023-12-01T20:49:40,386 adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py' 2023-12-01T20:49:40,387 adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py' 2023-12-01T20:49:40,390 adding 'deepspeed/inference/v2/modules/interfaces/__init__.py' 2023-12-01T20:49:40,391 adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py' 2023-12-01T20:49:40,393 adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py' 2023-12-01T20:49:40,395 adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py' 2023-12-01T20:49:40,396 adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py' 2023-12-01T20:49:40,397 adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py' 2023-12-01T20:49:40,399 adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py' 2023-12-01T20:49:40,400 adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py' 2023-12-01T20:49:40,402 adding 'deepspeed/inference/v2/ragged/__init__.py' 2023-12-01T20:49:40,404 adding 'deepspeed/inference/v2/ragged/blocked_allocator.py' 2023-12-01T20:49:40,406 adding 'deepspeed/inference/v2/ragged/kv_cache.py' 2023-12-01T20:49:40,408 adding 'deepspeed/inference/v2/ragged/manager_configs.py' 2023-12-01T20:49:40,410 adding 'deepspeed/inference/v2/ragged/ragged_manager.py' 2023-12-01T20:49:40,412 adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py' 2023-12-01T20:49:40,414 adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py' 2023-12-01T20:49:40,416 adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu' 2023-12-01T20:49:40,417 adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp' 2023-12-01T20:49:40,419 adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h' 2023-12-01T20:49:40,421 adding 'deepspeed/launcher/__init__.py' 2023-12-01T20:49:40,422 adding 'deepspeed/launcher/constants.py' 2023-12-01T20:49:40,424 adding 'deepspeed/launcher/launch.py' 2023-12-01T20:49:40,426 adding 'deepspeed/launcher/multinode_runner.py' 2023-12-01T20:49:40,429 adding 'deepspeed/launcher/runner.py' 2023-12-01T20:49:40,431 adding 'deepspeed/model_implementations/__init__.py' 2023-12-01T20:49:40,433 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2023-12-01T20:49:40,435 adding 'deepspeed/model_implementations/diffusers/unet.py' 2023-12-01T20:49:40,436 adding 'deepspeed/model_implementations/diffusers/vae.py' 2023-12-01T20:49:40,438 adding 'deepspeed/model_implementations/features/__init__.py' 2023-12-01T20:49:40,439 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2023-12-01T20:49:40,441 adding 'deepspeed/model_implementations/transformers/__init__.py' 2023-12-01T20:49:40,443 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2023-12-01T20:49:40,444 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2023-12-01T20:49:40,445 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2023-12-01T20:49:40,447 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2023-12-01T20:49:40,448 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2023-12-01T20:49:40,450 adding 'deepspeed/model_implementations/transformers/ds_llama2.py' 2023-12-01T20:49:40,451 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2023-12-01T20:49:40,452 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2023-12-01T20:49:40,455 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2023-12-01T20:49:40,457 adding 'deepspeed/module_inject/__init__.py' 2023-12-01T20:49:40,460 adding 'deepspeed/module_inject/auto_tp.py' 2023-12-01T20:49:40,461 adding 'deepspeed/module_inject/auto_tp_model_utils.py' 2023-12-01T20:49:40,463 adding 'deepspeed/module_inject/fusedqkv_utils.py' 2023-12-01T20:49:40,464 adding 'deepspeed/module_inject/inject.py' 2023-12-01T20:49:40,466 adding 'deepspeed/module_inject/layers.py' 2023-12-01T20:49:40,468 adding 'deepspeed/module_inject/load_checkpoint.py' 2023-12-01T20:49:40,470 adding 'deepspeed/module_inject/module_quantize.py' 2023-12-01T20:49:40,472 adding 'deepspeed/module_inject/policy.py' 2023-12-01T20:49:40,475 adding 'deepspeed/module_inject/replace_module.py' 2023-12-01T20:49:40,477 adding 'deepspeed/module_inject/replace_policy.py' 2023-12-01T20:49:40,478 adding 'deepspeed/module_inject/tp_shard.py' 2023-12-01T20:49:40,479 adding 'deepspeed/module_inject/utils.py' 2023-12-01T20:49:40,481 adding 'deepspeed/module_inject/containers/__init__.py' 2023-12-01T20:49:40,484 adding 'deepspeed/module_inject/containers/base.py' 2023-12-01T20:49:40,486 adding 'deepspeed/module_inject/containers/base_moe.py' 2023-12-01T20:49:40,487 adding 'deepspeed/module_inject/containers/bert.py' 2023-12-01T20:49:40,489 adding 'deepspeed/module_inject/containers/bloom.py' 2023-12-01T20:49:40,490 adding 'deepspeed/module_inject/containers/clip.py' 2023-12-01T20:49:40,492 adding 'deepspeed/module_inject/containers/distil_bert.py' 2023-12-01T20:49:40,493 adding 'deepspeed/module_inject/containers/gpt2.py' 2023-12-01T20:49:40,495 adding 'deepspeed/module_inject/containers/gptj.py' 2023-12-01T20:49:40,496 adding 'deepspeed/module_inject/containers/gptneo.py' 2023-12-01T20:49:40,498 adding 'deepspeed/module_inject/containers/gptneox.py' 2023-12-01T20:49:40,500 adding 'deepspeed/module_inject/containers/internlm.py' 2023-12-01T20:49:40,502 adding 'deepspeed/module_inject/containers/llama.py' 2023-12-01T20:49:40,503 adding 'deepspeed/module_inject/containers/llama2.py' 2023-12-01T20:49:40,505 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2023-12-01T20:49:40,507 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2023-12-01T20:49:40,509 adding 'deepspeed/module_inject/containers/opt.py' 2023-12-01T20:49:40,510 adding 'deepspeed/module_inject/containers/unet.py' 2023-12-01T20:49:40,511 adding 'deepspeed/module_inject/containers/vae.py' 2023-12-01T20:49:40,513 adding 'deepspeed/module_inject/containers/features/__init__.py' 2023-12-01T20:49:40,515 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2023-12-01T20:49:40,517 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2023-12-01T20:49:40,518 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2023-12-01T20:49:40,520 adding 'deepspeed/module_inject/containers/features/megatron.py' 2023-12-01T20:49:40,521 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2023-12-01T20:49:40,523 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2023-12-01T20:49:40,525 adding 'deepspeed/moe/__init__.py' 2023-12-01T20:49:40,526 adding 'deepspeed/moe/experts.py' 2023-12-01T20:49:40,528 adding 'deepspeed/moe/layer.py' 2023-12-01T20:49:40,530 adding 'deepspeed/moe/mappings.py' 2023-12-01T20:49:40,532 adding 'deepspeed/moe/sharded_moe.py' 2023-12-01T20:49:40,534 adding 'deepspeed/moe/utils.py' 2023-12-01T20:49:40,536 adding 'deepspeed/monitor/__init__.py' 2023-12-01T20:49:40,538 adding 'deepspeed/monitor/config.py' 2023-12-01T20:49:40,539 adding 'deepspeed/monitor/csv_monitor.py' 2023-12-01T20:49:40,540 adding 'deepspeed/monitor/monitor.py' 2023-12-01T20:49:40,542 adding 'deepspeed/monitor/tensorboard.py' 2023-12-01T20:49:40,543 adding 'deepspeed/monitor/utils.py' 2023-12-01T20:49:40,545 adding 'deepspeed/monitor/wandb.py' 2023-12-01T20:49:40,547 adding 'deepspeed/nebula/__init__.py' 2023-12-01T20:49:40,548 adding 'deepspeed/nebula/config.py' 2023-12-01T20:49:40,550 adding 'deepspeed/nebula/constants.py' 2023-12-01T20:49:40,552 adding 'deepspeed/ops/__init__.py' 2023-12-01T20:49:40,553 adding 'deepspeed/ops/adagrad/__init__.py' 2023-12-01T20:49:40,555 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2023-12-01T20:49:40,557 adding 'deepspeed/ops/adam/__init__.py' 2023-12-01T20:49:40,559 adding 'deepspeed/ops/adam/cpu_adam.py' 2023-12-01T20:49:40,560 adding 'deepspeed/ops/adam/fused_adam.py' 2023-12-01T20:49:40,562 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2023-12-01T20:49:40,564 adding 'deepspeed/ops/aio/__init__.py' 2023-12-01T20:49:40,566 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2023-12-01T20:49:40,568 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2023-12-01T20:49:40,570 adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp' 2023-12-01T20:49:40,572 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2023-12-01T20:49:40,573 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2023-12-01T20:49:40,575 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2023-12-01T20:49:40,579 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2023-12-01T20:49:40,580 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2023-12-01T20:49:40,582 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2023-12-01T20:49:40,583 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2023-12-01T20:49:40,585 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2023-12-01T20:49:40,587 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2023-12-01T20:49:40,589 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2023-12-01T20:49:40,590 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2023-12-01T20:49:40,592 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2023-12-01T20:49:40,593 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2023-12-01T20:49:40,595 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2023-12-01T20:49:40,597 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2023-12-01T20:49:40,599 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2023-12-01T20:49:40,600 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2023-12-01T20:49:40,602 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2023-12-01T20:49:40,603 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2023-12-01T20:49:40,605 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2023-12-01T20:49:40,607 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2023-12-01T20:49:40,609 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2023-12-01T20:49:40,611 adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp' 2023-12-01T20:49:40,615 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2023-12-01T20:49:40,617 adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp' 2023-12-01T20:49:40,619 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp' 2023-12-01T20:49:40,621 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu' 2023-12-01T20:49:40,623 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu' 2023-12-01T20:49:40,625 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h' 2023-12-01T20:49:40,633 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h' 2023-12-01T20:49:40,639 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h' 2023-12-01T20:49:40,641 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h' 2023-12-01T20:49:40,644 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h' 2023-12-01T20:49:40,646 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h' 2023-12-01T20:49:40,648 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h' 2023-12-01T20:49:40,651 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h' 2023-12-01T20:49:40,653 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h' 2023-12-01T20:49:40,656 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h' 2023-12-01T20:49:40,658 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h' 2023-12-01T20:49:40,660 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h' 2023-12-01T20:49:40,663 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h' 2023-12-01T20:49:40,670 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h' 2023-12-01T20:49:40,674 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h' 2023-12-01T20:49:40,676 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h' 2023-12-01T20:49:40,680 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h' 2023-12-01T20:49:40,684 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h' 2023-12-01T20:49:40,688 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h' 2023-12-01T20:49:40,691 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h' 2023-12-01T20:49:40,693 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h' 2023-12-01T20:49:40,695 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h' 2023-12-01T20:49:40,697 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h' 2023-12-01T20:49:40,700 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2023-12-01T20:49:40,701 adding 'deepspeed/ops/csrc/includes/Timer.h' 2023-12-01T20:49:40,703 adding 'deepspeed/ops/csrc/includes/activation_type.h' 2023-12-01T20:49:40,704 adding 'deepspeed/ops/csrc/includes/compat.h' 2023-12-01T20:49:40,706 adding 'deepspeed/ops/csrc/includes/context.h' 2023-12-01T20:49:40,708 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2023-12-01T20:49:40,710 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2023-12-01T20:49:40,712 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2023-12-01T20:49:40,714 adding 'deepspeed/ops/csrc/includes/cpu_lion.h' 2023-12-01T20:49:40,715 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2023-12-01T20:49:40,717 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2023-12-01T20:49:40,719 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2023-12-01T20:49:40,720 adding 'deepspeed/ops/csrc/includes/dropout.h' 2023-12-01T20:49:40,722 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2023-12-01T20:49:40,723 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2023-12-01T20:49:40,725 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2023-12-01T20:49:40,726 adding 'deepspeed/ops/csrc/includes/gelu.h' 2023-12-01T20:49:40,728 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2023-12-01T20:49:40,730 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2023-12-01T20:49:40,732 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2023-12-01T20:49:40,734 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2023-12-01T20:49:40,736 adding 'deepspeed/ops/csrc/includes/quantization.h' 2023-12-01T20:49:40,738 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2023-12-01T20:49:40,739 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2023-12-01T20:49:40,742 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2023-12-01T20:49:40,743 adding 'deepspeed/ops/csrc/includes/simd.h' 2023-12-01T20:49:40,745 adding 'deepspeed/ops/csrc/includes/softmax.h' 2023-12-01T20:49:40,746 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2023-12-01T20:49:40,748 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2023-12-01T20:49:40,750 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2023-12-01T20:49:40,752 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2023-12-01T20:49:40,755 adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp' 2023-12-01T20:49:40,756 adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp' 2023-12-01T20:49:40,758 adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp' 2023-12-01T20:49:40,759 adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh' 2023-12-01T20:49:40,761 adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu' 2023-12-01T20:49:40,763 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2023-12-01T20:49:40,766 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2023-12-01T20:49:40,768 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2023-12-01T20:49:40,770 adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu' 2023-12-01T20:49:40,772 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2023-12-01T20:49:40,774 adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu' 2023-12-01T20:49:40,776 adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu' 2023-12-01T20:49:40,778 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2023-12-01T20:49:40,780 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2023-12-01T20:49:40,781 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2023-12-01T20:49:40,783 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2023-12-01T20:49:40,785 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2023-12-01T20:49:40,788 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2023-12-01T20:49:40,789 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2023-12-01T20:49:40,791 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2023-12-01T20:49:40,794 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2023-12-01T20:49:40,797 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2023-12-01T20:49:40,801 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2023-12-01T20:49:40,803 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2023-12-01T20:49:40,805 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2023-12-01T20:49:40,809 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2023-12-01T20:49:40,813 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2023-12-01T20:49:40,815 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2023-12-01T20:49:40,818 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2023-12-01T20:49:40,820 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2023-12-01T20:49:40,823 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2023-12-01T20:49:40,826 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2023-12-01T20:49:40,827 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2023-12-01T20:49:40,833 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2023-12-01T20:49:40,835 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2023-12-01T20:49:40,837 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2023-12-01T20:49:40,840 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2023-12-01T20:49:40,843 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2023-12-01T20:49:40,846 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2023-12-01T20:49:40,848 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2023-12-01T20:49:40,850 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2023-12-01T20:49:40,852 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2023-12-01T20:49:40,853 adding 'deepspeed/ops/deepspeed4science/__init__.py' 2023-12-01T20:49:40,855 adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py' 2023-12-01T20:49:40,857 adding 'deepspeed/ops/lamb/__init__.py' 2023-12-01T20:49:40,859 adding 'deepspeed/ops/lamb/fused_lamb.py' 2023-12-01T20:49:40,861 adding 'deepspeed/ops/lion/__init__.py' 2023-12-01T20:49:40,862 adding 'deepspeed/ops/lion/cpu_lion.py' 2023-12-01T20:49:40,864 adding 'deepspeed/ops/lion/fused_lion.py' 2023-12-01T20:49:40,865 adding 'deepspeed/ops/lion/multi_tensor_apply.py' 2023-12-01T20:49:40,868 adding 'deepspeed/ops/op_builder/__init__.py' 2023-12-01T20:49:40,869 adding 'deepspeed/ops/op_builder/all_ops.py' 2023-12-01T20:49:40,871 adding 'deepspeed/ops/op_builder/async_io.py' 2023-12-01T20:49:40,874 adding 'deepspeed/ops/op_builder/builder.py' 2023-12-01T20:49:40,876 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2023-12-01T20:49:40,877 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2023-12-01T20:49:40,879 adding 'deepspeed/ops/op_builder/cpu_lion.py' 2023-12-01T20:49:40,880 adding 'deepspeed/ops/op_builder/evoformer_attn.py' 2023-12-01T20:49:40,881 adding 'deepspeed/ops/op_builder/fused_adam.py' 2023-12-01T20:49:40,883 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2023-12-01T20:49:40,884 adding 'deepspeed/ops/op_builder/fused_lion.py' 2023-12-01T20:49:40,886 adding 'deepspeed/ops/op_builder/inference_core_ops.py' 2023-12-01T20:49:40,887 adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py' 2023-12-01T20:49:40,889 adding 'deepspeed/ops/op_builder/quantizer.py' 2023-12-01T20:49:40,891 adding 'deepspeed/ops/op_builder/ragged_ops.py' 2023-12-01T20:49:40,892 adding 'deepspeed/ops/op_builder/ragged_utils.py' 2023-12-01T20:49:40,894 adding 'deepspeed/ops/op_builder/random_ltd.py' 2023-12-01T20:49:40,896 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2023-12-01T20:49:40,897 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2023-12-01T20:49:40,899 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2023-12-01T20:49:40,900 adding 'deepspeed/ops/op_builder/transformer.py' 2023-12-01T20:49:40,902 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2023-12-01T20:49:40,904 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2023-12-01T20:49:40,906 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2023-12-01T20:49:40,907 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2023-12-01T20:49:40,908 adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py' 2023-12-01T20:49:40,909 adding 'deepspeed/ops/op_builder/cpu/fused_adam.py' 2023-12-01T20:49:40,911 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2023-12-01T20:49:40,913 adding 'deepspeed/ops/op_builder/npu/__init__.py' 2023-12-01T20:49:40,914 adding 'deepspeed/ops/op_builder/npu/builder.py' 2023-12-01T20:49:40,915 adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py' 2023-12-01T20:49:40,917 adding 'deepspeed/ops/op_builder/npu/cpu_adam.py' 2023-12-01T20:49:40,918 adding 'deepspeed/ops/op_builder/npu/cpu_lion.py' 2023-12-01T20:49:40,919 adding 'deepspeed/ops/op_builder/npu/fused_adam.py' 2023-12-01T20:49:40,921 adding 'deepspeed/ops/op_builder/npu/no_impl.py' 2023-12-01T20:49:40,923 adding 'deepspeed/ops/quantizer/__init__.py' 2023-12-01T20:49:40,924 adding 'deepspeed/ops/quantizer/quantizer.py' 2023-12-01T20:49:40,926 adding 'deepspeed/ops/random_ltd/__init__.py' 2023-12-01T20:49:40,927 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2023-12-01T20:49:40,929 adding 'deepspeed/ops/sparse_attention/__init__.py' 2023-12-01T20:49:40,931 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2023-12-01T20:49:40,934 adding 'deepspeed/ops/sparse_attention/matmul.py' 2023-12-01T20:49:40,937 adding 'deepspeed/ops/sparse_attention/softmax.py' 2023-12-01T20:49:40,939 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2023-12-01T20:49:40,940 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2023-12-01T20:49:40,944 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2023-12-01T20:49:40,946 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2023-12-01T20:49:40,947 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2023-12-01T20:49:40,949 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2023-12-01T20:49:40,950 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2023-12-01T20:49:40,952 adding 'deepspeed/ops/transformer/__init__.py' 2023-12-01T20:49:40,955 adding 'deepspeed/ops/transformer/transformer.py' 2023-12-01T20:49:40,957 adding 'deepspeed/ops/transformer/inference/__init__.py' 2023-12-01T20:49:40,958 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2023-12-01T20:49:40,960 adding 'deepspeed/ops/transformer/inference/config.py' 2023-12-01T20:49:40,961 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2023-12-01T20:49:40,963 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2023-12-01T20:49:40,965 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2023-12-01T20:49:40,967 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2023-12-01T20:49:40,969 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2023-12-01T20:49:40,972 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2023-12-01T20:49:40,974 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2023-12-01T20:49:40,976 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2023-12-01T20:49:40,978 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2023-12-01T20:49:40,980 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2023-12-01T20:49:40,982 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2023-12-01T20:49:40,985 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2023-12-01T20:49:40,987 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2023-12-01T20:49:40,988 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2023-12-01T20:49:40,990 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2023-12-01T20:49:40,991 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2023-12-01T20:49:40,993 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2023-12-01T20:49:40,995 adding 'deepspeed/ops/transformer/inference/triton/__init__.py' 2023-12-01T20:49:40,997 adding 'deepspeed/ops/transformer/inference/triton/attention.py' 2023-12-01T20:49:40,999 adding 'deepspeed/ops/transformer/inference/triton/gelu.py' 2023-12-01T20:49:41,000 adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py' 2023-12-01T20:49:41,002 adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py' 2023-12-01T20:49:41,004 adding 'deepspeed/ops/transformer/inference/triton/mlp.py' 2023-12-01T20:49:41,005 adding 'deepspeed/ops/transformer/inference/triton/ops.py' 2023-12-01T20:49:41,006 adding 'deepspeed/ops/transformer/inference/triton/residual_add.py' 2023-12-01T20:49:41,008 adding 'deepspeed/ops/transformer/inference/triton/softmax.py' 2023-12-01T20:49:41,009 adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py' 2023-12-01T20:49:41,011 adding 'deepspeed/pipe/__init__.py' 2023-12-01T20:49:41,013 adding 'deepspeed/profiling/__init__.py' 2023-12-01T20:49:41,014 adding 'deepspeed/profiling/config.py' 2023-12-01T20:49:41,016 adding 'deepspeed/profiling/constants.py' 2023-12-01T20:49:41,017 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2023-12-01T20:49:41,023 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2023-12-01T20:49:41,025 adding 'deepspeed/runtime/__init__.py' 2023-12-01T20:49:41,027 adding 'deepspeed/runtime/bf16_optimizer.py' 2023-12-01T20:49:41,032 adding 'deepspeed/runtime/config.py' 2023-12-01T20:49:41,034 adding 'deepspeed/runtime/config_utils.py' 2023-12-01T20:49:41,036 adding 'deepspeed/runtime/constants.py' 2023-12-01T20:49:41,037 adding 'deepspeed/runtime/dataloader.py' 2023-12-01T20:49:41,039 adding 'deepspeed/runtime/eigenvalue.py' 2023-12-01T20:49:41,057 adding 'deepspeed/runtime/engine.py' 2023-12-01T20:49:41,060 adding 'deepspeed/runtime/hybrid_engine.py' 2023-12-01T20:49:41,064 adding 'deepspeed/runtime/lr_schedules.py' 2023-12-01T20:49:41,066 adding 'deepspeed/runtime/progressive_layer_drop.py' 2023-12-01T20:49:41,067 adding 'deepspeed/runtime/quantize.py' 2023-12-01T20:49:41,069 adding 'deepspeed/runtime/sparse_tensor.py' 2023-12-01T20:49:41,071 adding 'deepspeed/runtime/state_dict_factory.py' 2023-12-01T20:49:41,076 adding 'deepspeed/runtime/utils.py' 2023-12-01T20:49:41,077 adding 'deepspeed/runtime/weight_quantizer.py' 2023-12-01T20:49:41,079 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2023-12-01T20:49:41,084 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2023-12-01T20:49:41,086 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2023-12-01T20:49:41,088 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2023-12-01T20:49:41,089 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2023-12-01T20:49:41,091 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2023-12-01T20:49:41,092 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2023-12-01T20:49:41,094 adding 'deepspeed/runtime/comm/__init__.py' 2023-12-01T20:49:41,095 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2023-12-01T20:49:41,097 adding 'deepspeed/runtime/comm/mpi.py' 2023-12-01T20:49:41,099 adding 'deepspeed/runtime/comm/nccl.py' 2023-12-01T20:49:41,101 adding 'deepspeed/runtime/compression/__init__.py' 2023-12-01T20:49:41,102 adding 'deepspeed/runtime/compression/cupy.py' 2023-12-01T20:49:41,104 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2023-12-01T20:49:41,106 adding 'deepspeed/runtime/data_pipeline/config.py' 2023-12-01T20:49:41,107 adding 'deepspeed/runtime/data_pipeline/constants.py' 2023-12-01T20:49:41,109 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2023-12-01T20:49:41,111 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2023-12-01T20:49:41,113 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2023-12-01T20:49:41,114 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2023-12-01T20:49:41,116 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2023-12-01T20:49:41,117 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2023-12-01T20:49:41,119 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2023-12-01T20:49:41,121 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2023-12-01T20:49:41,124 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2023-12-01T20:49:41,126 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2023-12-01T20:49:41,128 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2023-12-01T20:49:41,130 adding 'deepspeed/runtime/fp16/__init__.py' 2023-12-01T20:49:41,132 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2023-12-01T20:49:41,134 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2023-12-01T20:49:41,137 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2023-12-01T20:49:41,139 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2023-12-01T20:49:41,141 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2023-12-01T20:49:41,144 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2023-12-01T20:49:41,146 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2023-12-01T20:49:41,148 adding 'deepspeed/runtime/pipe/__init__.py' 2023-12-01T20:49:41,154 adding 'deepspeed/runtime/pipe/engine.py' 2023-12-01T20:49:41,158 adding 'deepspeed/runtime/pipe/module.py' 2023-12-01T20:49:41,160 adding 'deepspeed/runtime/pipe/p2p.py' 2023-12-01T20:49:41,162 adding 'deepspeed/runtime/pipe/schedule.py' 2023-12-01T20:49:41,165 adding 'deepspeed/runtime/pipe/topology.py' 2023-12-01T20:49:41,166 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2023-12-01T20:49:41,168 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2023-12-01T20:49:41,169 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2023-12-01T20:49:41,171 adding 'deepspeed/runtime/swap_tensor/constants.py' 2023-12-01T20:49:41,173 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2023-12-01T20:49:41,175 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2023-12-01T20:49:41,178 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2023-12-01T20:49:41,180 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2023-12-01T20:49:41,181 adding 'deepspeed/runtime/swap_tensor/utils.py' 2023-12-01T20:49:41,183 adding 'deepspeed/runtime/zero/__init__.py' 2023-12-01T20:49:41,185 adding 'deepspeed/runtime/zero/config.py' 2023-12-01T20:49:41,188 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2023-12-01T20:49:41,189 adding 'deepspeed/runtime/zero/linear.py' 2023-12-01T20:49:41,192 adding 'deepspeed/runtime/zero/mics.py' 2023-12-01T20:49:41,194 adding 'deepspeed/runtime/zero/mics_utils.py' 2023-12-01T20:49:41,196 adding 'deepspeed/runtime/zero/offload_config.py' 2023-12-01T20:49:41,199 adding 'deepspeed/runtime/zero/parameter_offload.py' 2023-12-01T20:49:41,210 adding 'deepspeed/runtime/zero/partition_parameters.py' 2023-12-01T20:49:41,214 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2023-12-01T20:49:41,216 adding 'deepspeed/runtime/zero/partitioned_param_profiler.py' 2023-12-01T20:49:41,230 adding 'deepspeed/runtime/zero/stage3.py' 2023-12-01T20:49:41,244 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2023-12-01T20:49:41,246 adding 'deepspeed/runtime/zero/test.py' 2023-12-01T20:49:41,248 adding 'deepspeed/runtime/zero/tiling.py' 2023-12-01T20:49:41,249 adding 'deepspeed/runtime/zero/utils.py' 2023-12-01T20:49:41,251 adding 'deepspeed/sequence/__init__.py' 2023-12-01T20:49:41,253 adding 'deepspeed/sequence/layer.py' 2023-12-01T20:49:41,255 adding 'deepspeed/utils/__init__.py' 2023-12-01T20:49:41,257 adding 'deepspeed/utils/comms_logging.py' 2023-12-01T20:49:41,259 adding 'deepspeed/utils/debug.py' 2023-12-01T20:49:41,260 adding 'deepspeed/utils/exceptions.py' 2023-12-01T20:49:41,263 adding 'deepspeed/utils/groups.py' 2023-12-01T20:49:41,265 adding 'deepspeed/utils/init_on_device.py' 2023-12-01T20:49:41,266 adding 'deepspeed/utils/logging.py' 2023-12-01T20:49:41,267 adding 'deepspeed/utils/mixed_precision_linkage.py' 2023-12-01T20:49:41,269 adding 'deepspeed/utils/numa.py' 2023-12-01T20:49:41,270 adding 'deepspeed/utils/nvtx.py' 2023-12-01T20:49:41,272 adding 'deepspeed/utils/tensor_fragment.py' 2023-12-01T20:49:41,274 adding 'deepspeed/utils/timer.py' 2023-12-01T20:49:41,275 adding 'deepspeed/utils/types.py' 2023-12-01T20:49:41,278 adding 'deepspeed/utils/zero_to_fp32.py' 2023-12-01T20:49:41,280 adding 'deepspeed-0.12.4.data/scripts/deepspeed' 2023-12-01T20:49:41,281 adding 'deepspeed-0.12.4.data/scripts/deepspeed.pt' 2023-12-01T20:49:41,283 adding 'deepspeed-0.12.4.data/scripts/ds' 2023-12-01T20:49:41,284 adding 'deepspeed-0.12.4.data/scripts/ds_bench' 2023-12-01T20:49:41,285 adding 'deepspeed-0.12.4.data/scripts/ds_elastic' 2023-12-01T20:49:41,287 adding 'deepspeed-0.12.4.data/scripts/ds_report' 2023-12-01T20:49:41,288 adding 'deepspeed-0.12.4.data/scripts/ds_ssh' 2023-12-01T20:49:41,289 adding 'deepspeed-0.12.4.data/scripts/dsr' 2023-12-01T20:49:41,295 adding 'deepspeed-0.12.4.dist-info/METADATA' 2023-12-01T20:49:41,296 adding 'deepspeed-0.12.4.dist-info/WHEEL' 2023-12-01T20:49:41,297 adding 'deepspeed-0.12.4.dist-info/entry_points.txt' 2023-12-01T20:49:41,298 adding 'deepspeed-0.12.4.dist-info/top_level.txt' 2023-12-01T20:49:41,310 adding 'deepspeed-0.12.4.dist-info/RECORD' 2023-12-01T20:49:41,339 removing build/bdist.linux-aarch64/wheel 2023-12-01T20:49:41,560 deepspeed build time = 9.713032484054565 secs 2023-12-01T20:49:41,682 Building wheel for deepspeed (setup.py): finished with status 'done' 2023-12-01T20:49:41,696 Created wheel for deepspeed: filename=deepspeed-0.12.4-py3-none-any.whl size=1290596 sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd 2023-12-01T20:49:41,697 Stored in directory: /tmp/pip-ephem-wheel-cache-t7bqfgwb/wheels/52/d9/0f/9942c7349b7d892d3c603eded7551baa1e844aef8a7104ee1a 2023-12-01T20:49:41,736 Successfully built deepspeed 2023-12-01T20:49:41,768 Removed build tracker: '/tmp/pip-build-tracker-ii2xzll0'