2024-03-06T02:37:42,571 Created temporary directory: /tmp/pip-build-tracker-7jp05urq 2024-03-06T02:37:42,572 Initialized build tracking at /tmp/pip-build-tracker-7jp05urq 2024-03-06T02:37:42,573 Created build tracker: /tmp/pip-build-tracker-7jp05urq 2024-03-06T02:37:42,573 Entered build tracker: /tmp/pip-build-tracker-7jp05urq 2024-03-06T02:37:42,574 Created temporary directory: /tmp/pip-wheel-1fx5lwuc 2024-03-06T02:37:42,577 Created temporary directory: /tmp/pip-ephem-wheel-cache-y23rkroo 2024-03-06T02:37:42,599 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-03-06T02:37:42,603 2 location(s) to search for versions of deepspeed: 2024-03-06T02:37:42,603 * https://pypi.org/simple/deepspeed/ 2024-03-06T02:37:42,603 * https://www.piwheels.org/simple/deepspeed/ 2024-03-06T02:37:42,603 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2024-03-06T02:37:42,604 Getting page https://pypi.org/simple/deepspeed/ 2024-03-06T02:37:42,606 Found index url https://pypi.org/simple/ 2024-03-06T02:37:43,846 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2024-03-06T02:37:43,862 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2024-03-06T02:37:43,863 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2024-03-06T02:37:43,863 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2024-03-06T02:37:43,864 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2024-03-06T02:37:43,865 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2024-03-06T02:37:43,865 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2024-03-06T02:37:43,866 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2024-03-06T02:37:43,867 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2024-03-06T02:37:43,868 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2024-03-06T02:37:43,868 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2024-03-06T02:37:43,869 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2024-03-06T02:37:43,870 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2024-03-06T02:37:43,871 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2024-03-06T02:37:43,872 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2024-03-06T02:37:43,873 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2024-03-06T02:37:43,873 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2024-03-06T02:37:43,874 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2024-03-06T02:37:43,874 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2024-03-06T02:37:43,875 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2024-03-06T02:37:43,875 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2024-03-06T02:37:43,876 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2024-03-06T02:37:43,877 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2024-03-06T02:37:43,877 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2024-03-06T02:37:43,878 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2024-03-06T02:37:43,879 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2024-03-06T02:37:43,880 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2024-03-06T02:37:43,881 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2024-03-06T02:37:43,881 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2024-03-06T02:37:43,882 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2024-03-06T02:37:43,883 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2024-03-06T02:37:43,883 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2024-03-06T02:37:43,884 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2024-03-06T02:37:43,885 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2024-03-06T02:37:43,886 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2024-03-06T02:37:43,886 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2024-03-06T02:37:43,887 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2024-03-06T02:37:43,887 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2024-03-06T02:37:43,888 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2024-03-06T02:37:43,889 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2024-03-06T02:37:43,889 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2024-03-06T02:37:43,890 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2024-03-06T02:37:43,891 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2024-03-06T02:37:43,891 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2024-03-06T02:37:43,892 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2024-03-06T02:37:43,893 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2024-03-06T02:37:43,894 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2024-03-06T02:37:43,894 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2024-03-06T02:37:43,895 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2024-03-06T02:37:43,896 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2024-03-06T02:37:43,897 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2024-03-06T02:37:43,898 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2024-03-06T02:37:43,898 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2024-03-06T02:37:43,899 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2024-03-06T02:37:43,899 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2024-03-06T02:37:43,900 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2024-03-06T02:37:43,901 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2024-03-06T02:37:43,902 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2024-03-06T02:37:43,902 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2024-03-06T02:37:43,903 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2024-03-06T02:37:43,904 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2024-03-06T02:37:43,905 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2024-03-06T02:37:43,905 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2024-03-06T02:37:43,906 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2024-03-06T02:37:43,907 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2024-03-06T02:37:43,908 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2024-03-06T02:37:43,909 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2024-03-06T02:37:43,910 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2024-03-06T02:37:43,910 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2024-03-06T02:37:43,911 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2024-03-06T02:37:43,912 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2024-03-06T02:37:43,913 Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5 2024-03-06T02:37:43,913 Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0 2024-03-06T02:37:43,914 Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1 2024-03-06T02:37:43,914 Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2 2024-03-06T02:37:43,915 Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3 2024-03-06T02:37:43,916 Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0 2024-03-06T02:37:43,916 Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1 2024-03-06T02:37:43,917 Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2 2024-03-06T02:37:43,918 Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0 2024-03-06T02:37:43,919 Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1 2024-03-06T02:37:43,919 Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2 2024-03-06T02:37:43,920 Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3 2024-03-06T02:37:43,921 Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4 2024-03-06T02:37:43,921 Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5 2024-03-06T02:37:43,922 Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6 2024-03-06T02:37:43,923 Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0 2024-03-06T02:37:43,924 Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1 2024-03-06T02:37:43,924 Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2 2024-03-06T02:37:43,925 Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3 2024-03-06T02:37:43,925 Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4 2024-03-06T02:37:43,926 Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5 2024-03-06T02:37:43,927 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2024-03-06T02:37:43,927 Getting page https://www.piwheels.org/simple/deepspeed/ 2024-03-06T02:37:43,929 Found index url https://www.piwheels.org/simple/ 2024-03-06T02:37:44,117 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2024-03-06T02:37:44,133 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,134 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,134 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,135 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,136 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,136 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,137 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,138 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,138 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,139 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,140 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,140 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,141 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,141 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,142 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,142 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,143 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,144 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,144 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,145 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,146 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,146 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,147 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,147 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,148 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,149 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,150 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,150 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,150 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,151 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,151 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,152 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,152 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,153 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,154 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,154 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,155 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,155 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,156 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,157 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,157 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,158 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,158 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,159 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,159 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,160 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,160 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,161 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,161 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,162 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,162 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,163 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,163 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,164 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,165 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,165 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,165 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,166 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,166 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,167 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2024-03-06T02:37:44,167 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2024-03-06T02:37:44,168 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2024-03-06T02:37:44,196 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2024-03-06T02:37:44,214 Collecting deepspeed==0.13.5 2024-03-06T02:37:44,217 Created temporary directory: /tmp/pip-unpack-9fi9yfj8 2024-03-06T02:37:44,439 Downloading deepspeed-0.13.5.tar.gz (1.3 MB) 2024-03-06T02:37:46,593 Added deepspeed==0.13.5 from https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz to build tracker '/tmp/pip-build-tracker-7jp05urq' 2024-03-06T02:37:46,595 Running setup.py (path:/tmp/pip-wheel-1fx5lwuc/deepspeed_19b56c8e16b545e7b4e100b2f8d66c43/setup.py) egg_info for package deepspeed 2024-03-06T02:37:46,596 Created temporary directory: /tmp/pip-pip-egg-info-u_ivik3m 2024-03-06T02:37:46,596 Preparing metadata (setup.py): started 2024-03-06T02:37:46,598 Running command python setup.py egg_info 2024-03-06T02:37:47,504 fatal: not a git repository (or any of the parent directories): .git 2024-03-06T02:37:48,155 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2024-03-06T02:37:48,156  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2024-03-06T02:37:48,156 DS_BUILD_OPS=0 2024-03-06T02:37:48,157  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2024-03-06T02:37:48,157  [WARNING]  async_io: please install the libaio-dev package with apt 2024-03-06T02:37:48,158  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2024-03-06T02:37:48,159  [WARNING]  Please install torch if trying to pre-compile kernels 2024-03-06T02:37:48,159  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-03-06T02:37:48,160  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-03-06T02:37:48,161  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-03-06T02:37:48,161  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-03-06T02:37:48,162  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-03-06T02:37:48,162  [WARNING]  unable to import torch, please install it first 2024-03-06T02:37:48,163  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-03-06T02:37:48,163 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False} 2024-03-06T02:37:48,164 version=0.13.5, git_hash=unknown, git_branch=unknown 2024-03-06T02:37:48,164 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm'] 2024-03-06T02:37:48,164 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'deepspeed_not_implemented': False} 2024-03-06T02:37:48,165 ext_modules=[] 2024-03-06T02:37:48,165 running egg_info 2024-03-06T02:37:48,166 creating /tmp/pip-pip-egg-info-u_ivik3m/deepspeed.egg-info 2024-03-06T02:37:48,182 writing /tmp/pip-pip-egg-info-u_ivik3m/deepspeed.egg-info/PKG-INFO 2024-03-06T02:37:48,213 writing dependency_links to /tmp/pip-pip-egg-info-u_ivik3m/deepspeed.egg-info/dependency_links.txt 2024-03-06T02:37:48,215 writing entry points to /tmp/pip-pip-egg-info-u_ivik3m/deepspeed.egg-info/entry_points.txt 2024-03-06T02:37:48,231 writing requirements to /tmp/pip-pip-egg-info-u_ivik3m/deepspeed.egg-info/requires.txt 2024-03-06T02:37:48,232 writing top-level names to /tmp/pip-pip-egg-info-u_ivik3m/deepspeed.egg-info/top_level.txt 2024-03-06T02:37:48,234 writing manifest file '/tmp/pip-pip-egg-info-u_ivik3m/deepspeed.egg-info/SOURCES.txt' 2024-03-06T02:37:48,434 reading manifest file '/tmp/pip-pip-egg-info-u_ivik3m/deepspeed.egg-info/SOURCES.txt' 2024-03-06T02:37:48,436 reading manifest template 'MANIFEST.in' 2024-03-06T02:37:48,437 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2024-03-06T02:37:48,438 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2024-03-06T02:37:49,472 warning: no files found matching '*.hip' under directory 'deepspeed' 2024-03-06T02:37:50,279 warning: no files found matching '*.cc' under directory 'deepspeed' 2024-03-06T02:37:50,765 warning: no files found matching '*.tr' under directory 'csrc' 2024-03-06T02:37:50,865 warning: no files found matching '*.cc' under directory 'csrc' 2024-03-06T02:37:50,898 warning: no files found matching '*.py' under directory 'benchmarks' 2024-03-06T02:37:50,933 writing manifest file '/tmp/pip-pip-egg-info-u_ivik3m/deepspeed.egg-info/SOURCES.txt' 2024-03-06T02:37:50,935 deepspeed build time = 3.426055669784546 secs 2024-03-06T02:37:51,048 Preparing metadata (setup.py): finished with status 'done' 2024-03-06T02:37:51,054 Source in /tmp/pip-wheel-1fx5lwuc/deepspeed_19b56c8e16b545e7b4e100b2f8d66c43 has version 0.13.5, which satisfies requirement deepspeed==0.13.5 from https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz 2024-03-06T02:37:51,055 Removed deepspeed==0.13.5 from https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz from build tracker '/tmp/pip-build-tracker-7jp05urq' 2024-03-06T02:37:51,063 Created temporary directory: /tmp/pip-unpack-uu8m7a5h 2024-03-06T02:37:51,064 Created temporary directory: /tmp/pip-unpack-wpuq81mf 2024-03-06T02:37:51,310 Building wheels for collected packages: deepspeed 2024-03-06T02:37:51,315 Created temporary directory: /tmp/pip-wheel-qdu5shyv 2024-03-06T02:37:51,316 Building wheel for deepspeed (setup.py): started 2024-03-06T02:37:51,317 Destination directory: /tmp/pip-wheel-qdu5shyv 2024-03-06T02:37:51,318 Running command python setup.py bdist_wheel 2024-03-06T02:37:51,779 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2024-03-06T02:37:51,786  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2024-03-06T02:37:51,860 DS_BUILD_OPS=0 2024-03-06T02:37:51,970  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2024-03-06T02:37:52,030  [WARNING]  async_io: please install the libaio-dev package with apt 2024-03-06T02:37:52,030  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2024-03-06T02:37:52,031  [WARNING]  Please install torch if trying to pre-compile kernels 2024-03-06T02:37:52,031  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-03-06T02:37:52,032  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-03-06T02:37:52,033  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-03-06T02:37:52,033  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-03-06T02:37:52,034  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-03-06T02:37:52,035  [WARNING]  unable to import torch, please install it first 2024-03-06T02:37:52,035  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-03-06T02:37:52,036 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False} 2024-03-06T02:37:52,044 fatal: not a git repository (or any of the parent directories): .git 2024-03-06T02:37:52,046 version=0.13.5, git_hash=unknown, git_branch=unknown 2024-03-06T02:37:52,047 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm'] 2024-03-06T02:37:52,048 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'deepspeed_not_implemented': False} 2024-03-06T02:37:52,048 ext_modules=[] 2024-03-06T02:37:52,660 running bdist_wheel 2024-03-06T02:37:52,753 running build 2024-03-06T02:37:52,754 running build_py 2024-03-06T02:37:52,780 creating build 2024-03-06T02:37:52,781 creating build/lib 2024-03-06T02:37:52,782 creating build/lib/deepspeed 2024-03-06T02:37:52,783 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2024-03-06T02:37:52,785 copying deepspeed/pydantic_v1.py -> build/lib/deepspeed 2024-03-06T02:37:52,786 copying deepspeed/env_report.py -> build/lib/deepspeed 2024-03-06T02:37:52,788 copying deepspeed/__init__.py -> build/lib/deepspeed 2024-03-06T02:37:52,790 copying deepspeed/constants.py -> build/lib/deepspeed 2024-03-06T02:37:52,792 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2024-03-06T02:37:52,794 creating build/lib/deepspeed/module_inject 2024-03-06T02:37:52,795 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2024-03-06T02:37:52,797 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2024-03-06T02:37:52,799 copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject 2024-03-06T02:37:52,801 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2024-03-06T02:37:52,803 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2024-03-06T02:37:52,804 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2024-03-06T02:37:52,806 copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject 2024-03-06T02:37:52,808 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2024-03-06T02:37:52,810 copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject 2024-03-06T02:37:52,811 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2024-03-06T02:37:52,813 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2024-03-06T02:37:52,815 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2024-03-06T02:37:52,817 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2024-03-06T02:37:52,820 creating build/lib/deepspeed/pipe 2024-03-06T02:37:52,821 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2024-03-06T02:37:52,823 creating build/lib/deepspeed/elasticity 2024-03-06T02:37:52,824 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2024-03-06T02:37:52,826 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2024-03-06T02:37:52,828 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2024-03-06T02:37:52,830 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2024-03-06T02:37:52,832 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2024-03-06T02:37:52,834 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2024-03-06T02:37:52,836 creating build/lib/deepspeed/runtime 2024-03-06T02:37:52,837 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2024-03-06T02:37:52,840 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2024-03-06T02:37:52,842 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2024-03-06T02:37:52,844 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2024-03-06T02:37:52,846 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2024-03-06T02:37:52,848 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2024-03-06T02:37:52,850 copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime 2024-03-06T02:37:52,852 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2024-03-06T02:37:52,855 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2024-03-06T02:37:52,856 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2024-03-06T02:37:52,858 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2024-03-06T02:37:52,861 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2024-03-06T02:37:52,863 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2024-03-06T02:37:52,865 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2024-03-06T02:37:52,870 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2024-03-06T02:37:52,872 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2024-03-06T02:37:52,874 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2024-03-06T02:37:52,876 creating build/lib/deepspeed/model_implementations 2024-03-06T02:37:52,877 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2024-03-06T02:37:52,879 creating build/lib/deepspeed/nebula 2024-03-06T02:37:52,880 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2024-03-06T02:37:52,881 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2024-03-06T02:37:52,883 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2024-03-06T02:37:52,885 creating build/lib/deepspeed/accelerator 2024-03-06T02:37:52,886 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2024-03-06T02:37:52,888 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2024-03-06T02:37:52,891 copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator 2024-03-06T02:37:52,893 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2024-03-06T02:37:52,894 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2024-03-06T02:37:52,896 copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator 2024-03-06T02:37:52,898 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2024-03-06T02:37:52,900 copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator 2024-03-06T02:37:52,902 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2024-03-06T02:37:52,904 creating build/lib/deepspeed/profiling 2024-03-06T02:37:52,905 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2024-03-06T02:37:52,907 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2024-03-06T02:37:52,909 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2024-03-06T02:37:52,911 creating build/lib/deepspeed/monitor 2024-03-06T02:37:52,912 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2024-03-06T02:37:52,914 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2024-03-06T02:37:52,915 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2024-03-06T02:37:52,917 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2024-03-06T02:37:52,919 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2024-03-06T02:37:52,920 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2024-03-06T02:37:52,922 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2024-03-06T02:37:52,924 creating build/lib/deepspeed/compression 2024-03-06T02:37:52,925 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2024-03-06T02:37:52,927 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2024-03-06T02:37:52,929 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2024-03-06T02:37:52,932 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2024-03-06T02:37:52,935 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2024-03-06T02:37:52,936 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2024-03-06T02:37:52,938 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2024-03-06T02:37:52,940 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2024-03-06T02:37:52,943 creating build/lib/deepspeed/ops 2024-03-06T02:37:52,944 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2024-03-06T02:37:52,946 creating build/lib/deepspeed/autotuning 2024-03-06T02:37:52,947 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2024-03-06T02:37:52,949 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2024-03-06T02:37:52,952 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2024-03-06T02:37:52,954 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2024-03-06T02:37:52,955 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2024-03-06T02:37:52,958 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2024-03-06T02:37:52,960 creating build/lib/deepspeed/launcher 2024-03-06T02:37:52,961 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2024-03-06T02:37:52,963 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2024-03-06T02:37:52,966 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2024-03-06T02:37:52,967 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2024-03-06T02:37:52,969 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2024-03-06T02:37:52,971 copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher 2024-03-06T02:37:52,973 creating build/lib/deepspeed/comm 2024-03-06T02:37:52,974 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2024-03-06T02:37:52,977 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2024-03-06T02:37:52,978 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2024-03-06T02:37:52,980 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2024-03-06T02:37:52,982 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2024-03-06T02:37:52,984 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2024-03-06T02:37:52,987 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2024-03-06T02:37:52,988 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2024-03-06T02:37:52,990 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2024-03-06T02:37:52,992 creating build/lib/deepspeed/checkpoint 2024-03-06T02:37:52,993 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2024-03-06T02:37:52,995 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2024-03-06T02:37:52,997 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2024-03-06T02:37:52,999 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2024-03-06T02:37:53,001 copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint 2024-03-06T02:37:53,003 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2024-03-06T02:37:53,005 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2024-03-06T02:37:53,007 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2024-03-06T02:37:53,009 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2024-03-06T02:37:53,011 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2024-03-06T02:37:53,013 creating build/lib/deepspeed/inference 2024-03-06T02:37:53,015 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2024-03-06T02:37:53,017 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2024-03-06T02:37:53,019 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2024-03-06T02:37:53,022 creating build/lib/deepspeed/moe 2024-03-06T02:37:53,022 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2024-03-06T02:37:53,024 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2024-03-06T02:37:53,027 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2024-03-06T02:37:53,029 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2024-03-06T02:37:53,031 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2024-03-06T02:37:53,032 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2024-03-06T02:37:53,035 creating build/lib/deepspeed/sequence 2024-03-06T02:37:53,036 copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence 2024-03-06T02:37:53,038 copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence 2024-03-06T02:37:53,040 creating build/lib/deepspeed/utils 2024-03-06T02:37:53,041 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2024-03-06T02:37:53,042 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2024-03-06T02:37:53,045 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2024-03-06T02:37:53,046 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2024-03-06T02:37:53,048 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2024-03-06T02:37:53,051 copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils 2024-03-06T02:37:53,053 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2024-03-06T02:37:53,055 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2024-03-06T02:37:53,056 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2024-03-06T02:37:53,058 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2024-03-06T02:37:53,060 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2024-03-06T02:37:53,062 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2024-03-06T02:37:53,064 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2024-03-06T02:37:53,065 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2024-03-06T02:37:53,067 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2024-03-06T02:37:53,070 creating build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,071 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,073 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,074 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,076 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,078 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,080 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,082 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,084 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,086 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,088 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,090 copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,092 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,094 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,096 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,098 copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,100 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,102 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,104 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,105 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2024-03-06T02:37:53,108 creating build/lib/deepspeed/module_inject/containers/features 2024-03-06T02:37:53,109 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2024-03-06T02:37:53,111 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2024-03-06T02:37:53,113 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2024-03-06T02:37:53,115 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2024-03-06T02:37:53,117 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2024-03-06T02:37:53,118 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2024-03-06T02:37:53,120 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2024-03-06T02:37:53,122 creating build/lib/deepspeed/runtime/pipe 2024-03-06T02:37:53,123 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2024-03-06T02:37:53,125 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2024-03-06T02:37:53,128 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2024-03-06T02:37:53,130 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2024-03-06T02:37:53,132 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2024-03-06T02:37:53,134 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2024-03-06T02:37:53,137 creating build/lib/deepspeed/runtime/data_pipeline 2024-03-06T02:37:53,138 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2024-03-06T02:37:53,140 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2024-03-06T02:37:53,142 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2024-03-06T02:37:53,144 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2024-03-06T02:37:53,146 creating build/lib/deepspeed/runtime/compression 2024-03-06T02:37:53,147 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2024-03-06T02:37:53,149 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2024-03-06T02:37:53,151 creating build/lib/deepspeed/runtime/zero 2024-03-06T02:37:53,152 copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero 2024-03-06T02:37:53,154 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2024-03-06T02:37:53,157 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2024-03-06T02:37:53,159 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2024-03-06T02:37:53,161 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2024-03-06T02:37:53,165 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2024-03-06T02:37:53,167 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2024-03-06T02:37:53,170 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2024-03-06T02:37:53,174 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2024-03-06T02:37:53,177 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2024-03-06T02:37:53,179 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2024-03-06T02:37:53,181 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2024-03-06T02:37:53,184 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2024-03-06T02:37:53,186 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2024-03-06T02:37:53,189 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2024-03-06T02:37:53,191 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2024-03-06T02:37:53,196 creating build/lib/deepspeed/runtime/activation_checkpointing 2024-03-06T02:37:53,197 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2024-03-06T02:37:53,199 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2024-03-06T02:37:53,202 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2024-03-06T02:37:53,205 creating build/lib/deepspeed/runtime/comm 2024-03-06T02:37:53,206 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2024-03-06T02:37:53,208 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2024-03-06T02:37:53,211 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2024-03-06T02:37:53,213 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2024-03-06T02:37:53,215 copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm 2024-03-06T02:37:53,218 creating build/lib/deepspeed/runtime/swap_tensor 2024-03-06T02:37:53,219 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2024-03-06T02:37:53,222 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2024-03-06T02:37:53,225 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2024-03-06T02:37:53,227 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2024-03-06T02:37:53,229 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2024-03-06T02:37:53,232 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2024-03-06T02:37:53,234 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2024-03-06T02:37:53,236 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2024-03-06T02:37:53,238 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2024-03-06T02:37:53,241 creating build/lib/deepspeed/runtime/checkpoint_engine 2024-03-06T02:37:53,242 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2024-03-06T02:37:53,244 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2024-03-06T02:37:53,247 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2024-03-06T02:37:53,248 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2024-03-06T02:37:53,251 creating build/lib/deepspeed/runtime/fp16 2024-03-06T02:37:53,252 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2024-03-06T02:37:53,255 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2024-03-06T02:37:53,257 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2024-03-06T02:37:53,259 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2024-03-06T02:37:53,262 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2024-03-06T02:37:53,263 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2024-03-06T02:37:53,266 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2024-03-06T02:37:53,267 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2024-03-06T02:37:53,270 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2024-03-06T02:37:53,272 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2024-03-06T02:37:53,274 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2024-03-06T02:37:53,275 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2024-03-06T02:37:53,278 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2024-03-06T02:37:53,281 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2024-03-06T02:37:53,283 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2024-03-06T02:37:53,286 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2024-03-06T02:37:53,288 creating build/lib/deepspeed/runtime/fp16/onebit 2024-03-06T02:37:53,290 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2024-03-06T02:37:53,293 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2024-03-06T02:37:53,295 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2024-03-06T02:37:53,297 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2024-03-06T02:37:53,301 creating build/lib/deepspeed/model_implementations/diffusers 2024-03-06T02:37:53,302 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2024-03-06T02:37:53,304 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2024-03-06T02:37:53,306 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2024-03-06T02:37:53,309 creating build/lib/deepspeed/model_implementations/transformers 2024-03-06T02:37:53,310 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2024-03-06T02:37:53,312 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2024-03-06T02:37:53,314 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2024-03-06T02:37:53,316 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2024-03-06T02:37:53,318 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2024-03-06T02:37:53,321 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2024-03-06T02:37:53,323 copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers 2024-03-06T02:37:53,325 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2024-03-06T02:37:53,327 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2024-03-06T02:37:53,329 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2024-03-06T02:37:53,332 creating build/lib/deepspeed/model_implementations/features 2024-03-06T02:37:53,333 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2024-03-06T02:37:53,335 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2024-03-06T02:37:53,338 creating build/lib/deepspeed/profiling/flops_profiler 2024-03-06T02:37:53,339 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2024-03-06T02:37:53,343 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2024-03-06T02:37:53,345 creating build/lib/deepspeed/ops/deepspeed4science 2024-03-06T02:37:53,346 copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science 2024-03-06T02:37:53,348 copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science 2024-03-06T02:37:53,351 creating build/lib/deepspeed/ops/aio 2024-03-06T02:37:53,352 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2024-03-06T02:37:53,355 creating build/lib/deepspeed/ops/adagrad 2024-03-06T02:37:53,356 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2024-03-06T02:37:53,358 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2024-03-06T02:37:53,361 creating build/lib/deepspeed/ops/sparse_attention 2024-03-06T02:37:53,362 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2024-03-06T02:37:53,364 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2024-03-06T02:37:53,367 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2024-03-06T02:37:53,370 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2024-03-06T02:37:53,372 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2024-03-06T02:37:53,375 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2024-03-06T02:37:53,377 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2024-03-06T02:37:53,381 creating build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,382 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,385 copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,387 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,389 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,391 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,393 copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,395 copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,397 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,399 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,402 copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,404 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,406 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,408 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,410 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,411 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,413 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,415 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,417 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,418 copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,420 copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,422 copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,424 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2024-03-06T02:37:53,426 creating build/lib/deepspeed/ops/transformer 2024-03-06T02:37:53,427 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2024-03-06T02:37:53,429 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2024-03-06T02:37:53,432 creating build/lib/deepspeed/ops/adam 2024-03-06T02:37:53,433 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2024-03-06T02:37:53,434 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2024-03-06T02:37:53,437 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2024-03-06T02:37:53,439 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2024-03-06T02:37:53,441 creating build/lib/deepspeed/ops/quantizer 2024-03-06T02:37:53,442 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2024-03-06T02:37:53,444 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2024-03-06T02:37:53,447 creating build/lib/deepspeed/ops/random_ltd 2024-03-06T02:37:53,447 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2024-03-06T02:37:53,449 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2024-03-06T02:37:53,452 creating build/lib/deepspeed/ops/lamb 2024-03-06T02:37:53,453 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2024-03-06T02:37:53,455 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2024-03-06T02:37:53,458 creating build/lib/deepspeed/ops/lion 2024-03-06T02:37:53,459 copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion 2024-03-06T02:37:53,461 copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion 2024-03-06T02:37:53,463 copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion 2024-03-06T02:37:53,465 copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion 2024-03-06T02:37:53,472 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2024-03-06T02:37:53,473 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2024-03-06T02:37:53,476 creating build/lib/deepspeed/ops/op_builder/xpu 2024-03-06T02:37:53,477 copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu 2024-03-06T02:37:53,480 copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu 2024-03-06T02:37:53,482 copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu 2024-03-06T02:37:53,484 copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu 2024-03-06T02:37:53,486 copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu 2024-03-06T02:37:53,488 copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu 2024-03-06T02:37:53,491 creating build/lib/deepspeed/ops/op_builder/cpu 2024-03-06T02:37:53,492 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2024-03-06T02:37:53,494 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2024-03-06T02:37:53,496 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2024-03-06T02:37:53,498 copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2024-03-06T02:37:53,500 copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2024-03-06T02:37:53,502 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2024-03-06T02:37:53,504 creating build/lib/deepspeed/ops/op_builder/npu 2024-03-06T02:37:53,506 copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu 2024-03-06T02:37:53,508 copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu 2024-03-06T02:37:53,510 copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu 2024-03-06T02:37:53,513 copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu 2024-03-06T02:37:53,515 copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2024-03-06T02:37:53,517 copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2024-03-06T02:37:53,519 copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu 2024-03-06T02:37:53,521 copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu 2024-03-06T02:37:53,523 copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu 2024-03-06T02:37:53,526 creating build/lib/deepspeed/ops/op_builder/hpu 2024-03-06T02:37:53,527 copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu 2024-03-06T02:37:53,530 copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu 2024-03-06T02:37:53,533 copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu 2024-03-06T02:37:53,536 copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu 2024-03-06T02:37:53,538 copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu 2024-03-06T02:37:53,542 creating build/lib/deepspeed/ops/transformer/inference 2024-03-06T02:37:53,544 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2024-03-06T02:37:53,547 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2024-03-06T02:37:53,550 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2024-03-06T02:37:53,554 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2024-03-06T02:37:53,556 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2024-03-06T02:37:53,559 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2024-03-06T02:37:53,563 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2024-03-06T02:37:53,565 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2024-03-06T02:37:53,568 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2024-03-06T02:37:53,572 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2024-03-06T02:37:53,576 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:53,577 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:53,580 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:53,583 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:53,586 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:53,588 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:53,591 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:53,594 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:53,597 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:53,599 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:53,602 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:53,606 creating build/lib/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:53,607 copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:53,611 copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:53,614 copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:53,616 copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:53,620 copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:53,622 copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:53,626 copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:53,629 copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:53,631 copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:53,634 copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:53,637 creating build/lib/deepspeed/autotuning/tuner 2024-03-06T02:37:53,638 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2024-03-06T02:37:53,641 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2024-03-06T02:37:53,643 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2024-03-06T02:37:53,646 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2024-03-06T02:37:53,648 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2024-03-06T02:37:53,651 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2024-03-06T02:37:53,653 creating build/lib/deepspeed/inference/quantization 2024-03-06T02:37:53,655 copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization 2024-03-06T02:37:53,657 copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization 2024-03-06T02:37:53,659 copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization 2024-03-06T02:37:53,662 copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization 2024-03-06T02:37:53,664 copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization 2024-03-06T02:37:53,667 creating build/lib/deepspeed/inference/v2 2024-03-06T02:37:53,668 copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2 2024-03-06T02:37:53,670 copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2 2024-03-06T02:37:53,673 copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2 2024-03-06T02:37:53,675 copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2 2024-03-06T02:37:53,677 copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2 2024-03-06T02:37:53,679 copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2 2024-03-06T02:37:53,681 copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2 2024-03-06T02:37:53,683 copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2 2024-03-06T02:37:53,685 copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2 2024-03-06T02:37:53,688 creating build/lib/deepspeed/inference/v2/model_implementations 2024-03-06T02:37:53,689 copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations 2024-03-06T02:37:53,692 copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2024-03-06T02:37:53,694 copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations 2024-03-06T02:37:53,696 copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2024-03-06T02:37:53,699 copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2024-03-06T02:37:53,702 copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2024-03-06T02:37:53,704 copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2024-03-06T02:37:53,707 creating build/lib/deepspeed/inference/v2/modules 2024-03-06T02:37:53,709 copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules 2024-03-06T02:37:53,711 copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules 2024-03-06T02:37:53,713 copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules 2024-03-06T02:37:53,715 copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules 2024-03-06T02:37:53,718 creating build/lib/deepspeed/inference/v2/ragged 2024-03-06T02:37:53,719 copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged 2024-03-06T02:37:53,722 copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged 2024-03-06T02:37:53,725 copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged 2024-03-06T02:37:53,727 copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged 2024-03-06T02:37:53,730 copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged 2024-03-06T02:37:53,732 copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged 2024-03-06T02:37:53,734 copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged 2024-03-06T02:37:53,737 creating build/lib/deepspeed/inference/v2/kernels 2024-03-06T02:37:53,738 copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels 2024-03-06T02:37:53,740 copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels 2024-03-06T02:37:53,743 creating build/lib/deepspeed/inference/v2/checkpoint 2024-03-06T02:37:53,744 copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2024-03-06T02:37:53,746 copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint 2024-03-06T02:37:53,748 copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2024-03-06T02:37:53,750 copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2024-03-06T02:37:53,753 creating build/lib/deepspeed/inference/v2/model_implementations/falcon 2024-03-06T02:37:53,755 copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2024-03-06T02:37:53,757 copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2024-03-06T02:37:53,759 copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2024-03-06T02:37:53,761 copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2024-03-06T02:37:53,764 creating build/lib/deepspeed/inference/v2/model_implementations/mixtral 2024-03-06T02:37:53,766 copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2024-03-06T02:37:53,768 copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2024-03-06T02:37:53,770 copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2024-03-06T02:37:53,772 copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2024-03-06T02:37:53,775 creating build/lib/deepspeed/inference/v2/model_implementations/phi 2024-03-06T02:37:53,776 copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2024-03-06T02:37:53,779 copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2024-03-06T02:37:53,781 copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2024-03-06T02:37:53,783 copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2024-03-06T02:37:53,786 creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2024-03-06T02:37:53,788 copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2024-03-06T02:37:53,791 copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2024-03-06T02:37:53,793 copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2024-03-06T02:37:53,795 copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2024-03-06T02:37:53,798 creating build/lib/deepspeed/inference/v2/model_implementations/opt 2024-03-06T02:37:53,799 copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2024-03-06T02:37:53,801 copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2024-03-06T02:37:53,803 copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2024-03-06T02:37:53,805 copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2024-03-06T02:37:53,808 creating build/lib/deepspeed/inference/v2/model_implementations/mistral 2024-03-06T02:37:53,809 copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2024-03-06T02:37:53,811 copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2024-03-06T02:37:53,813 copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2024-03-06T02:37:53,816 copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2024-03-06T02:37:53,819 creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2024-03-06T02:37:53,820 copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2024-03-06T02:37:53,822 copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2024-03-06T02:37:53,824 copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2024-03-06T02:37:53,826 copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2024-03-06T02:37:53,829 creating build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:37:53,830 copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:37:53,832 copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:37:53,834 copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:37:53,836 copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:37:53,837 copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:37:53,839 copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:37:53,841 copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:37:53,843 copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:37:53,845 copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:37:53,848 creating build/lib/deepspeed/inference/v2/model_implementations/qwen 2024-03-06T02:37:53,849 copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2024-03-06T02:37:53,851 copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2024-03-06T02:37:53,852 copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2024-03-06T02:37:53,854 copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2024-03-06T02:37:53,857 creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:37:53,858 copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:37:53,859 copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:37:53,861 copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:37:53,863 copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:37:53,865 copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:37:53,866 copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:37:53,868 copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:37:53,870 copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:37:53,872 copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:37:53,874 creating build/lib/deepspeed/inference/v2/modules/implementations 2024-03-06T02:37:53,875 copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations 2024-03-06T02:37:53,877 creating build/lib/deepspeed/inference/v2/modules/configs 2024-03-06T02:37:53,878 copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2024-03-06T02:37:53,880 copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs 2024-03-06T02:37:53,882 copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2024-03-06T02:37:53,884 copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2024-03-06T02:37:53,886 copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2024-03-06T02:37:53,887 copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs 2024-03-06T02:37:53,889 copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2024-03-06T02:37:53,892 creating build/lib/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:37:53,893 copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:37:53,895 copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:37:53,896 copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:37:53,898 copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:37:53,900 copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:37:53,901 copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:37:53,903 copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:37:53,905 copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:37:53,907 creating build/lib/deepspeed/inference/v2/modules/implementations/embedding 2024-03-06T02:37:53,908 copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2024-03-06T02:37:53,910 copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2024-03-06T02:37:53,912 creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2024-03-06T02:37:53,913 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2024-03-06T02:37:53,915 copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2024-03-06T02:37:53,917 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2024-03-06T02:37:53,919 creating build/lib/deepspeed/inference/v2/modules/implementations/linear 2024-03-06T02:37:53,920 copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2024-03-06T02:37:53,922 copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2024-03-06T02:37:53,924 creating build/lib/deepspeed/inference/v2/modules/implementations/attention 2024-03-06T02:37:53,925 copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2024-03-06T02:37:53,927 copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2024-03-06T02:37:53,930 creating build/lib/deepspeed/inference/v2/modules/implementations/unembed 2024-03-06T02:37:53,931 copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2024-03-06T02:37:53,933 copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2024-03-06T02:37:53,936 creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2024-03-06T02:37:53,936 copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2024-03-06T02:37:53,938 copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2024-03-06T02:37:53,941 creating build/lib/deepspeed/inference/v2/modules/implementations/moe 2024-03-06T02:37:53,942 copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2024-03-06T02:37:53,944 copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2024-03-06T02:37:53,946 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2024-03-06T02:37:53,947 copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2024-03-06T02:37:53,949 creating build/lib/deepspeed/inference/v2/kernels/core_ops 2024-03-06T02:37:53,950 copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops 2024-03-06T02:37:53,952 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops 2024-03-06T02:37:53,953 copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2024-03-06T02:37:53,955 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-03-06T02:37:53,956 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-03-06T02:37:53,958 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-03-06T02:37:53,960 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-03-06T02:37:53,962 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-03-06T02:37:53,963 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-03-06T02:37:53,965 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-03-06T02:37:53,968 creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-03-06T02:37:53,968 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-03-06T02:37:53,971 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-03-06T02:37:53,973 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-03-06T02:37:53,974 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-03-06T02:37:53,976 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-03-06T02:37:53,978 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-03-06T02:37:53,980 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-03-06T02:37:53,982 creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-03-06T02:37:53,983 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-03-06T02:37:53,985 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-03-06T02:37:53,987 creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-03-06T02:37:53,989 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-03-06T02:37:53,991 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-03-06T02:37:53,993 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:37:53,994 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:37:53,996 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:37:53,998 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:37:54,000 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:37:54,001 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:37:54,004 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-03-06T02:37:54,005 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-03-06T02:37:54,007 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-03-06T02:37:54,009 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-03-06T02:37:54,010 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-03-06T02:37:54,012 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-03-06T02:37:54,014 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-03-06T02:37:54,015 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-03-06T02:37:54,017 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-03-06T02:37:54,019 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:37:54,020 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:37:54,022 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:37:54,024 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:37:54,026 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:37:54,028 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-03-06T02:37:54,029 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-03-06T02:37:54,032 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-03-06T02:37:54,034 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-03-06T02:37:54,035 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-03-06T02:37:54,037 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-03-06T02:37:54,039 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-03-06T02:37:54,041 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-03-06T02:37:54,043 copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-03-06T02:37:54,045 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-03-06T02:37:54,046 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-03-06T02:37:54,047 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-03-06T02:37:54,050 running egg_info 2024-03-06T02:37:54,099 writing deepspeed.egg-info/PKG-INFO 2024-03-06T02:37:54,130 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2024-03-06T02:37:54,132 writing entry points to deepspeed.egg-info/entry_points.txt 2024-03-06T02:37:54,148 writing requirements to deepspeed.egg-info/requires.txt 2024-03-06T02:37:54,149 writing top-level names to deepspeed.egg-info/top_level.txt 2024-03-06T02:37:54,258 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2024-03-06T02:37:54,303 reading manifest template 'MANIFEST.in' 2024-03-06T02:37:54,305 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2024-03-06T02:37:54,306 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2024-03-06T02:37:55,615 warning: no files found matching '*.hip' under directory 'deepspeed' 2024-03-06T02:37:56,431 warning: no files found matching '*.cc' under directory 'deepspeed' 2024-03-06T02:37:56,911 warning: no files found matching '*.tr' under directory 'csrc' 2024-03-06T02:37:57,015 warning: no files found matching '*.cc' under directory 'csrc' 2024-03-06T02:37:57,049 warning: no files found matching '*.py' under directory 'benchmarks' 2024-03-06T02:37:57,098 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2024-03-06T02:37:57,106 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2024-03-06T02:37:57,107 !! 2024-03-06T02:37:57,108 ******************************************************************************** 2024-03-06T02:37:57,109 ############################ 2024-03-06T02:37:57,110 # Package would be ignored # 2024-03-06T02:37:57,111 ############################ 2024-03-06T02:37:57,111 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2024-03-06T02:37:57,112 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,113 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,114 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2024-03-06T02:37:57,114 to the `packages` configuration field. 2024-03-06T02:37:57,115 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,116 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,116 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,118 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,119 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,120 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2024-03-06T02:37:57,121 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2024-03-06T02:37:57,122 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,123 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,124 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,125 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,126 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,127 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,127 even if it does not contain any `.py` files. 2024-03-06T02:37:57,128 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,128 directory, all directories are treated like packages. 2024-03-06T02:37:57,128 ******************************************************************************** 2024-03-06T02:37:57,129 !! 2024-03-06T02:37:57,129 check.warn(importable) 2024-03-06T02:37:57,130 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration. 2024-03-06T02:37:57,130 !! 2024-03-06T02:37:57,131 ******************************************************************************** 2024-03-06T02:37:57,132 ############################ 2024-03-06T02:37:57,132 # Package would be ignored # 2024-03-06T02:37:57,133 ############################ 2024-03-06T02:37:57,133 Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1], 2024-03-06T02:37:57,133 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,134 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,135 package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added 2024-03-06T02:37:57,136 to the `packages` configuration field. 2024-03-06T02:37:57,137 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,137 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,138 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,139 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,140 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,141 If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are 2024-03-06T02:37:57,142 already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via 2024-03-06T02:37:57,142 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,143 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,143 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,144 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,145 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,147 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,147 even if it does not contain any `.py` files. 2024-03-06T02:37:57,148 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,148 directory, all directories are treated like packages. 2024-03-06T02:37:57,149 ******************************************************************************** 2024-03-06T02:37:57,150 !! 2024-03-06T02:37:57,151 check.warn(importable) 2024-03-06T02:37:57,152 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration. 2024-03-06T02:37:57,152 !! 2024-03-06T02:37:57,153 ******************************************************************************** 2024-03-06T02:37:57,154 ############################ 2024-03-06T02:37:57,154 # Package would be ignored # 2024-03-06T02:37:57,155 ############################ 2024-03-06T02:37:57,155 Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1], 2024-03-06T02:37:57,155 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,156 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,156 package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added 2024-03-06T02:37:57,157 to the `packages` configuration field. 2024-03-06T02:37:57,158 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,158 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,158 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,159 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,160 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,161 If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are 2024-03-06T02:37:57,161 already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via 2024-03-06T02:37:57,161 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,162 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,162 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,164 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,165 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,166 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,167 even if it does not contain any `.py` files. 2024-03-06T02:37:57,168 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,168 directory, all directories are treated like packages. 2024-03-06T02:37:57,169 ******************************************************************************** 2024-03-06T02:37:57,170 !! 2024-03-06T02:37:57,170 check.warn(importable) 2024-03-06T02:37:57,171 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration. 2024-03-06T02:37:57,171 !! 2024-03-06T02:37:57,172 ******************************************************************************** 2024-03-06T02:37:57,173 ############################ 2024-03-06T02:37:57,173 # Package would be ignored # 2024-03-06T02:37:57,174 ############################ 2024-03-06T02:37:57,174 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1], 2024-03-06T02:37:57,175 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,176 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,176 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added 2024-03-06T02:37:57,177 to the `packages` configuration field. 2024-03-06T02:37:57,178 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,178 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,179 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,180 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,181 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,182 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are 2024-03-06T02:37:57,182 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via 2024-03-06T02:37:57,182 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,183 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,183 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,184 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,185 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,186 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,186 even if it does not contain any `.py` files. 2024-03-06T02:37:57,186 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,187 directory, all directories are treated like packages. 2024-03-06T02:37:57,187 ******************************************************************************** 2024-03-06T02:37:57,188 !! 2024-03-06T02:37:57,188 check.warn(importable) 2024-03-06T02:37:57,189 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration. 2024-03-06T02:37:57,189 !! 2024-03-06T02:37:57,191 ******************************************************************************** 2024-03-06T02:37:57,191 ############################ 2024-03-06T02:37:57,192 # Package would be ignored # 2024-03-06T02:37:57,192 ############################ 2024-03-06T02:37:57,193 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1], 2024-03-06T02:37:57,193 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,194 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,195 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added 2024-03-06T02:37:57,196 to the `packages` configuration field. 2024-03-06T02:37:57,197 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,197 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,198 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,199 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,200 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,201 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are 2024-03-06T02:37:57,201 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via 2024-03-06T02:37:57,202 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,202 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,203 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,204 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,206 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,207 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,207 even if it does not contain any `.py` files. 2024-03-06T02:37:57,208 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,208 directory, all directories are treated like packages. 2024-03-06T02:37:57,208 ******************************************************************************** 2024-03-06T02:37:57,209 !! 2024-03-06T02:37:57,209 check.warn(importable) 2024-03-06T02:37:57,210 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration. 2024-03-06T02:37:57,210 !! 2024-03-06T02:37:57,211 ******************************************************************************** 2024-03-06T02:37:57,211 ############################ 2024-03-06T02:37:57,212 # Package would be ignored # 2024-03-06T02:37:57,212 ############################ 2024-03-06T02:37:57,212 Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1], 2024-03-06T02:37:57,213 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,214 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,214 package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added 2024-03-06T02:37:57,214 to the `packages` configuration field. 2024-03-06T02:37:57,215 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,216 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,216 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,217 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,219 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,220 If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are 2024-03-06T02:37:57,220 already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via 2024-03-06T02:37:57,221 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,222 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,222 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,223 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,224 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,226 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,226 even if it does not contain any `.py` files. 2024-03-06T02:37:57,227 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,227 directory, all directories are treated like packages. 2024-03-06T02:37:57,228 ******************************************************************************** 2024-03-06T02:37:57,229 !! 2024-03-06T02:37:57,229 check.warn(importable) 2024-03-06T02:37:57,230 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration. 2024-03-06T02:37:57,230 !! 2024-03-06T02:37:57,231 ******************************************************************************** 2024-03-06T02:37:57,232 ############################ 2024-03-06T02:37:57,232 # Package would be ignored # 2024-03-06T02:37:57,233 ############################ 2024-03-06T02:37:57,234 Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1], 2024-03-06T02:37:57,234 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,235 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,235 package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added 2024-03-06T02:37:57,236 to the `packages` configuration field. 2024-03-06T02:37:57,236 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,237 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,237 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,238 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,238 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,239 If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are 2024-03-06T02:37:57,239 already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via 2024-03-06T02:37:57,240 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,240 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,241 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,241 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,242 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,244 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,244 even if it does not contain any `.py` files. 2024-03-06T02:37:57,245 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,245 directory, all directories are treated like packages. 2024-03-06T02:37:57,246 ******************************************************************************** 2024-03-06T02:37:57,247 !! 2024-03-06T02:37:57,247 check.warn(importable) 2024-03-06T02:37:57,248 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2024-03-06T02:37:57,249 !! 2024-03-06T02:37:57,250 ******************************************************************************** 2024-03-06T02:37:57,250 ############################ 2024-03-06T02:37:57,251 # Package would be ignored # 2024-03-06T02:37:57,251 ############################ 2024-03-06T02:37:57,252 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2024-03-06T02:37:57,252 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,253 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,253 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2024-03-06T02:37:57,254 to the `packages` configuration field. 2024-03-06T02:37:57,255 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,255 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,256 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,257 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,258 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,260 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2024-03-06T02:37:57,260 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2024-03-06T02:37:57,261 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,262 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,262 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,263 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,264 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,265 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,266 even if it does not contain any `.py` files. 2024-03-06T02:37:57,266 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,267 directory, all directories are treated like packages. 2024-03-06T02:37:57,267 ******************************************************************************** 2024-03-06T02:37:57,268 !! 2024-03-06T02:37:57,269 check.warn(importable) 2024-03-06T02:37:57,269 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2024-03-06T02:37:57,270 !! 2024-03-06T02:37:57,271 ******************************************************************************** 2024-03-06T02:37:57,271 ############################ 2024-03-06T02:37:57,272 # Package would be ignored # 2024-03-06T02:37:57,272 ############################ 2024-03-06T02:37:57,273 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2024-03-06T02:37:57,274 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,275 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,275 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2024-03-06T02:37:57,276 to the `packages` configuration field. 2024-03-06T02:37:57,277 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,278 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,278 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,280 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,281 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,282 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2024-03-06T02:37:57,283 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2024-03-06T02:37:57,284 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,285 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,285 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,287 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,288 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,289 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,290 even if it does not contain any `.py` files. 2024-03-06T02:37:57,291 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,292 directory, all directories are treated like packages. 2024-03-06T02:37:57,292 ******************************************************************************** 2024-03-06T02:37:57,294 !! 2024-03-06T02:37:57,294 check.warn(importable) 2024-03-06T02:37:57,295 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2024-03-06T02:37:57,296 !! 2024-03-06T02:37:57,297 ******************************************************************************** 2024-03-06T02:37:57,298 ############################ 2024-03-06T02:37:57,298 # Package would be ignored # 2024-03-06T02:37:57,298 ############################ 2024-03-06T02:37:57,299 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2024-03-06T02:37:57,299 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,300 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,301 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2024-03-06T02:37:57,301 to the `packages` configuration field. 2024-03-06T02:37:57,302 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,303 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,303 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,304 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,305 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,306 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2024-03-06T02:37:57,307 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2024-03-06T02:37:57,307 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,308 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,308 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,310 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,311 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,313 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,314 even if it does not contain any `.py` files. 2024-03-06T02:37:57,314 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,315 directory, all directories are treated like packages. 2024-03-06T02:37:57,316 ******************************************************************************** 2024-03-06T02:37:57,317 !! 2024-03-06T02:37:57,317 check.warn(importable) 2024-03-06T02:37:57,318 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2024-03-06T02:37:57,319 !! 2024-03-06T02:37:57,320 ******************************************************************************** 2024-03-06T02:37:57,321 ############################ 2024-03-06T02:37:57,321 # Package would be ignored # 2024-03-06T02:37:57,322 ############################ 2024-03-06T02:37:57,322 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2024-03-06T02:37:57,323 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,324 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,325 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2024-03-06T02:37:57,325 to the `packages` configuration field. 2024-03-06T02:37:57,327 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,328 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,328 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,330 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,331 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,331 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2024-03-06T02:37:57,332 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2024-03-06T02:37:57,332 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,333 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,333 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,334 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,335 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,336 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,337 even if it does not contain any `.py` files. 2024-03-06T02:37:57,337 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,338 directory, all directories are treated like packages. 2024-03-06T02:37:57,338 ******************************************************************************** 2024-03-06T02:37:57,339 !! 2024-03-06T02:37:57,340 check.warn(importable) 2024-03-06T02:37:57,340 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2024-03-06T02:37:57,341 !! 2024-03-06T02:37:57,342 ******************************************************************************** 2024-03-06T02:37:57,342 ############################ 2024-03-06T02:37:57,343 # Package would be ignored # 2024-03-06T02:37:57,344 ############################ 2024-03-06T02:37:57,344 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2024-03-06T02:37:57,345 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,346 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,347 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2024-03-06T02:37:57,347 to the `packages` configuration field. 2024-03-06T02:37:57,349 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,349 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,350 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,351 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,353 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,354 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2024-03-06T02:37:57,354 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2024-03-06T02:37:57,355 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,356 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,356 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,357 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,358 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,360 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,361 even if it does not contain any `.py` files. 2024-03-06T02:37:57,361 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,362 directory, all directories are treated like packages. 2024-03-06T02:37:57,362 ******************************************************************************** 2024-03-06T02:37:57,363 !! 2024-03-06T02:37:57,363 check.warn(importable) 2024-03-06T02:37:57,364 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration. 2024-03-06T02:37:57,364 !! 2024-03-06T02:37:57,365 ******************************************************************************** 2024-03-06T02:37:57,365 ############################ 2024-03-06T02:37:57,365 # Package would be ignored # 2024-03-06T02:37:57,366 ############################ 2024-03-06T02:37:57,366 Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1], 2024-03-06T02:37:57,366 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,367 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,367 package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added 2024-03-06T02:37:57,368 to the `packages` configuration field. 2024-03-06T02:37:57,369 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,369 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,369 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,370 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,371 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,372 If you don't want 'deepspeed.ops.csrc.common' to be distributed and are 2024-03-06T02:37:57,373 already explicitly excluding 'deepspeed.ops.csrc.common' via 2024-03-06T02:37:57,373 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,374 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,374 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,376 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,377 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,378 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,379 even if it does not contain any `.py` files. 2024-03-06T02:37:57,379 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,380 directory, all directories are treated like packages. 2024-03-06T02:37:57,380 ******************************************************************************** 2024-03-06T02:37:57,381 !! 2024-03-06T02:37:57,381 check.warn(importable) 2024-03-06T02:37:57,382 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration. 2024-03-06T02:37:57,382 !! 2024-03-06T02:37:57,383 ******************************************************************************** 2024-03-06T02:37:57,384 ############################ 2024-03-06T02:37:57,384 # Package would be ignored # 2024-03-06T02:37:57,385 ############################ 2024-03-06T02:37:57,385 Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1], 2024-03-06T02:37:57,386 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,387 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,388 package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added 2024-03-06T02:37:57,388 to the `packages` configuration field. 2024-03-06T02:37:57,389 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,390 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,390 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,391 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,391 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,392 If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are 2024-03-06T02:37:57,392 already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via 2024-03-06T02:37:57,393 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,393 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,393 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,394 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,395 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,396 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,396 even if it does not contain any `.py` files. 2024-03-06T02:37:57,397 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,397 directory, all directories are treated like packages. 2024-03-06T02:37:57,398 ******************************************************************************** 2024-03-06T02:37:57,399 !! 2024-03-06T02:37:57,399 check.warn(importable) 2024-03-06T02:37:57,400 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2024-03-06T02:37:57,400 !! 2024-03-06T02:37:57,401 ******************************************************************************** 2024-03-06T02:37:57,402 ############################ 2024-03-06T02:37:57,402 # Package would be ignored # 2024-03-06T02:37:57,403 ############################ 2024-03-06T02:37:57,403 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2024-03-06T02:37:57,404 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,405 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,406 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2024-03-06T02:37:57,406 to the `packages` configuration field. 2024-03-06T02:37:57,407 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,408 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,408 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,409 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,410 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,411 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2024-03-06T02:37:57,412 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2024-03-06T02:37:57,412 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,413 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,413 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,415 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,415 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,416 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,417 even if it does not contain any `.py` files. 2024-03-06T02:37:57,417 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,417 directory, all directories are treated like packages. 2024-03-06T02:37:57,418 ******************************************************************************** 2024-03-06T02:37:57,418 !! 2024-03-06T02:37:57,419 check.warn(importable) 2024-03-06T02:37:57,419 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration. 2024-03-06T02:37:57,420 !! 2024-03-06T02:37:57,420 ******************************************************************************** 2024-03-06T02:37:57,421 ############################ 2024-03-06T02:37:57,421 # Package would be ignored # 2024-03-06T02:37:57,421 ############################ 2024-03-06T02:37:57,422 Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1], 2024-03-06T02:37:57,422 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,423 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,423 package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added 2024-03-06T02:37:57,424 to the `packages` configuration field. 2024-03-06T02:37:57,425 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,425 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,426 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,427 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,428 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,429 If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are 2024-03-06T02:37:57,430 already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via 2024-03-06T02:37:57,430 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,431 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,431 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,432 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,433 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,435 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,435 even if it does not contain any `.py` files. 2024-03-06T02:37:57,436 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,436 directory, all directories are treated like packages. 2024-03-06T02:37:57,437 ******************************************************************************** 2024-03-06T02:37:57,438 !! 2024-03-06T02:37:57,438 check.warn(importable) 2024-03-06T02:37:57,439 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration. 2024-03-06T02:37:57,439 !! 2024-03-06T02:37:57,440 ******************************************************************************** 2024-03-06T02:37:57,441 ############################ 2024-03-06T02:37:57,442 # Package would be ignored # 2024-03-06T02:37:57,442 ############################ 2024-03-06T02:37:57,442 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1], 2024-03-06T02:37:57,443 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,443 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,444 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added 2024-03-06T02:37:57,444 to the `packages` configuration field. 2024-03-06T02:37:57,445 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,445 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,446 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,447 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,448 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,448 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are 2024-03-06T02:37:57,449 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via 2024-03-06T02:37:57,449 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,449 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,450 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,451 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,452 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,453 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,454 even if it does not contain any `.py` files. 2024-03-06T02:37:57,455 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,455 directory, all directories are treated like packages. 2024-03-06T02:37:57,456 ******************************************************************************** 2024-03-06T02:37:57,457 !! 2024-03-06T02:37:57,457 check.warn(importable) 2024-03-06T02:37:57,458 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration. 2024-03-06T02:37:57,458 !! 2024-03-06T02:37:57,459 ******************************************************************************** 2024-03-06T02:37:57,460 ############################ 2024-03-06T02:37:57,460 # Package would be ignored # 2024-03-06T02:37:57,461 ############################ 2024-03-06T02:37:57,461 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1], 2024-03-06T02:37:57,462 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,463 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,463 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added 2024-03-06T02:37:57,464 to the `packages` configuration field. 2024-03-06T02:37:57,465 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,465 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,466 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,467 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,468 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,469 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are 2024-03-06T02:37:57,469 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via 2024-03-06T02:37:57,470 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,470 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,470 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,471 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,472 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,473 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,473 even if it does not contain any `.py` files. 2024-03-06T02:37:57,474 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,474 directory, all directories are treated like packages. 2024-03-06T02:37:57,475 ******************************************************************************** 2024-03-06T02:37:57,475 !! 2024-03-06T02:37:57,476 check.warn(importable) 2024-03-06T02:37:57,476 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration. 2024-03-06T02:37:57,476 !! 2024-03-06T02:37:57,478 ******************************************************************************** 2024-03-06T02:37:57,478 ############################ 2024-03-06T02:37:57,479 # Package would be ignored # 2024-03-06T02:37:57,479 ############################ 2024-03-06T02:37:57,480 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1], 2024-03-06T02:37:57,480 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,481 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,482 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added 2024-03-06T02:37:57,483 to the `packages` configuration field. 2024-03-06T02:37:57,484 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,484 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,485 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,486 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,487 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,488 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are 2024-03-06T02:37:57,488 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via 2024-03-06T02:37:57,488 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,489 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,489 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,490 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,492 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,493 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,494 even if it does not contain any `.py` files. 2024-03-06T02:37:57,495 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,495 directory, all directories are treated like packages. 2024-03-06T02:37:57,495 ******************************************************************************** 2024-03-06T02:37:57,496 !! 2024-03-06T02:37:57,496 check.warn(importable) 2024-03-06T02:37:57,496 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration. 2024-03-06T02:37:57,497 !! 2024-03-06T02:37:57,497 ******************************************************************************** 2024-03-06T02:37:57,498 ############################ 2024-03-06T02:37:57,498 # Package would be ignored # 2024-03-06T02:37:57,499 ############################ 2024-03-06T02:37:57,499 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1], 2024-03-06T02:37:57,499 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,500 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,500 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added 2024-03-06T02:37:57,501 to the `packages` configuration field. 2024-03-06T02:37:57,501 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,502 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,502 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,503 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,504 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,505 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are 2024-03-06T02:37:57,506 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via 2024-03-06T02:37:57,506 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,507 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,507 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,509 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,510 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,511 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,511 even if it does not contain any `.py` files. 2024-03-06T02:37:57,512 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,512 directory, all directories are treated like packages. 2024-03-06T02:37:57,513 ******************************************************************************** 2024-03-06T02:37:57,514 !! 2024-03-06T02:37:57,514 check.warn(importable) 2024-03-06T02:37:57,515 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration. 2024-03-06T02:37:57,519 !! 2024-03-06T02:37:57,520 ******************************************************************************** 2024-03-06T02:37:57,521 ############################ 2024-03-06T02:37:57,521 # Package would be ignored # 2024-03-06T02:37:57,522 ############################ 2024-03-06T02:37:57,522 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1], 2024-03-06T02:37:57,523 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,524 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,525 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added 2024-03-06T02:37:57,525 to the `packages` configuration field. 2024-03-06T02:37:57,526 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,526 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,527 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,527 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,528 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,529 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are 2024-03-06T02:37:57,529 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via 2024-03-06T02:37:57,530 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,530 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,534 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,536 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,537 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,538 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,539 even if it does not contain any `.py` files. 2024-03-06T02:37:57,539 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,540 directory, all directories are treated like packages. 2024-03-06T02:37:57,540 ******************************************************************************** 2024-03-06T02:37:57,541 !! 2024-03-06T02:37:57,542 check.warn(importable) 2024-03-06T02:37:57,543 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2024-03-06T02:37:57,543 !! 2024-03-06T02:37:57,544 ******************************************************************************** 2024-03-06T02:37:57,545 ############################ 2024-03-06T02:37:57,545 # Package would be ignored # 2024-03-06T02:37:57,546 ############################ 2024-03-06T02:37:57,546 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2024-03-06T02:37:57,547 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,548 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,549 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2024-03-06T02:37:57,549 to the `packages` configuration field. 2024-03-06T02:37:57,550 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,551 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,551 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,553 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,554 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,555 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2024-03-06T02:37:57,556 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2024-03-06T02:37:57,557 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,557 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,557 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,558 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,559 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,561 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,561 even if it does not contain any `.py` files. 2024-03-06T02:37:57,561 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,562 directory, all directories are treated like packages. 2024-03-06T02:37:57,562 ******************************************************************************** 2024-03-06T02:37:57,564 !! 2024-03-06T02:37:57,564 check.warn(importable) 2024-03-06T02:37:57,564 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2024-03-06T02:37:57,565 !! 2024-03-06T02:37:57,566 ******************************************************************************** 2024-03-06T02:37:57,567 ############################ 2024-03-06T02:37:57,567 # Package would be ignored # 2024-03-06T02:37:57,568 ############################ 2024-03-06T02:37:57,568 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2024-03-06T02:37:57,569 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,570 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,571 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2024-03-06T02:37:57,571 to the `packages` configuration field. 2024-03-06T02:37:57,572 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,573 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,574 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,575 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,576 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,577 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2024-03-06T02:37:57,578 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2024-03-06T02:37:57,578 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,579 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,579 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,581 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,582 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,584 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,584 even if it does not contain any `.py` files. 2024-03-06T02:37:57,585 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,585 directory, all directories are treated like packages. 2024-03-06T02:37:57,586 ******************************************************************************** 2024-03-06T02:37:57,587 !! 2024-03-06T02:37:57,588 check.warn(importable) 2024-03-06T02:37:57,588 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration. 2024-03-06T02:37:57,589 !! 2024-03-06T02:37:57,590 ******************************************************************************** 2024-03-06T02:37:57,590 ############################ 2024-03-06T02:37:57,591 # Package would be ignored # 2024-03-06T02:37:57,591 ############################ 2024-03-06T02:37:57,592 Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1], 2024-03-06T02:37:57,592 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,593 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,593 package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added 2024-03-06T02:37:57,594 to the `packages` configuration field. 2024-03-06T02:37:57,595 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,595 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,596 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,597 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,597 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,598 If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are 2024-03-06T02:37:57,599 already explicitly excluding 'deepspeed.ops.csrc.lion' via 2024-03-06T02:37:57,599 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,600 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,600 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,602 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,603 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,604 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,605 even if it does not contain any `.py` files. 2024-03-06T02:37:57,605 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,606 directory, all directories are treated like packages. 2024-03-06T02:37:57,606 ******************************************************************************** 2024-03-06T02:37:57,607 !! 2024-03-06T02:37:57,608 check.warn(importable) 2024-03-06T02:37:57,608 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2024-03-06T02:37:57,609 !! 2024-03-06T02:37:57,610 ******************************************************************************** 2024-03-06T02:37:57,611 ############################ 2024-03-06T02:37:57,611 # Package would be ignored # 2024-03-06T02:37:57,612 ############################ 2024-03-06T02:37:57,612 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2024-03-06T02:37:57,613 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,614 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,615 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2024-03-06T02:37:57,615 to the `packages` configuration field. 2024-03-06T02:37:57,616 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,617 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,617 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,618 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,619 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,620 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2024-03-06T02:37:57,620 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2024-03-06T02:37:57,621 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,621 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,622 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,623 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,624 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,625 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,625 even if it does not contain any `.py` files. 2024-03-06T02:37:57,626 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,626 directory, all directories are treated like packages. 2024-03-06T02:37:57,627 ******************************************************************************** 2024-03-06T02:37:57,628 !! 2024-03-06T02:37:57,628 check.warn(importable) 2024-03-06T02:37:57,629 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2024-03-06T02:37:57,629 !! 2024-03-06T02:37:57,630 ******************************************************************************** 2024-03-06T02:37:57,631 ############################ 2024-03-06T02:37:57,631 # Package would be ignored # 2024-03-06T02:37:57,632 ############################ 2024-03-06T02:37:57,632 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2024-03-06T02:37:57,633 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,634 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,634 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2024-03-06T02:37:57,635 to the `packages` configuration field. 2024-03-06T02:37:57,636 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,636 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,637 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,638 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,639 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,640 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2024-03-06T02:37:57,641 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2024-03-06T02:37:57,641 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,642 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,642 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,643 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,644 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,646 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,647 even if it does not contain any `.py` files. 2024-03-06T02:37:57,647 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,648 directory, all directories are treated like packages. 2024-03-06T02:37:57,648 ******************************************************************************** 2024-03-06T02:37:57,649 !! 2024-03-06T02:37:57,650 check.warn(importable) 2024-03-06T02:37:57,650 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2024-03-06T02:37:57,651 !! 2024-03-06T02:37:57,652 ******************************************************************************** 2024-03-06T02:37:57,652 ############################ 2024-03-06T02:37:57,653 # Package would be ignored # 2024-03-06T02:37:57,653 ############################ 2024-03-06T02:37:57,653 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2024-03-06T02:37:57,654 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,655 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,655 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2024-03-06T02:37:57,656 to the `packages` configuration field. 2024-03-06T02:37:57,657 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,657 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,658 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,659 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,660 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,661 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2024-03-06T02:37:57,661 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2024-03-06T02:37:57,662 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,663 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,663 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,664 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,665 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,667 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,667 even if it does not contain any `.py` files. 2024-03-06T02:37:57,668 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,668 directory, all directories are treated like packages. 2024-03-06T02:37:57,669 ******************************************************************************** 2024-03-06T02:37:57,670 !! 2024-03-06T02:37:57,670 check.warn(importable) 2024-03-06T02:37:57,671 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2024-03-06T02:37:57,672 !! 2024-03-06T02:37:57,672 ******************************************************************************** 2024-03-06T02:37:57,673 ############################ 2024-03-06T02:37:57,674 # Package would be ignored # 2024-03-06T02:37:57,674 ############################ 2024-03-06T02:37:57,675 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2024-03-06T02:37:57,675 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,676 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,677 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2024-03-06T02:37:57,677 to the `packages` configuration field. 2024-03-06T02:37:57,678 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,679 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,679 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,680 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,681 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,682 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2024-03-06T02:37:57,682 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2024-03-06T02:37:57,683 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,684 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,684 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,686 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,687 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,688 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,689 even if it does not contain any `.py` files. 2024-03-06T02:37:57,690 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,691 directory, all directories are treated like packages. 2024-03-06T02:37:57,691 ******************************************************************************** 2024-03-06T02:37:57,692 !! 2024-03-06T02:37:57,693 check.warn(importable) 2024-03-06T02:37:57,693 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2024-03-06T02:37:57,694 !! 2024-03-06T02:37:57,695 ******************************************************************************** 2024-03-06T02:37:57,695 ############################ 2024-03-06T02:37:57,696 # Package would be ignored # 2024-03-06T02:37:57,696 ############################ 2024-03-06T02:37:57,697 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2024-03-06T02:37:57,698 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,699 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,699 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2024-03-06T02:37:57,700 to the `packages` configuration field. 2024-03-06T02:37:57,701 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,702 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,702 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,703 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,704 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,706 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2024-03-06T02:37:57,706 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2024-03-06T02:37:57,707 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,707 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,708 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,709 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,710 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,711 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,712 even if it does not contain any `.py` files. 2024-03-06T02:37:57,712 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,713 directory, all directories are treated like packages. 2024-03-06T02:37:57,713 ******************************************************************************** 2024-03-06T02:37:57,714 !! 2024-03-06T02:37:57,715 check.warn(importable) 2024-03-06T02:37:57,715 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2024-03-06T02:37:57,715 !! 2024-03-06T02:37:57,716 ******************************************************************************** 2024-03-06T02:37:57,717 ############################ 2024-03-06T02:37:57,718 # Package would be ignored # 2024-03-06T02:37:57,718 ############################ 2024-03-06T02:37:57,718 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2024-03-06T02:37:57,719 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,720 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,721 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2024-03-06T02:37:57,721 to the `packages` configuration field. 2024-03-06T02:37:57,722 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,723 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,723 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,724 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,725 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,726 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2024-03-06T02:37:57,727 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2024-03-06T02:37:57,728 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,728 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,729 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,730 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,731 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,733 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,733 even if it does not contain any `.py` files. 2024-03-06T02:37:57,734 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,734 directory, all directories are treated like packages. 2024-03-06T02:37:57,735 ******************************************************************************** 2024-03-06T02:37:57,736 !! 2024-03-06T02:37:57,737 check.warn(importable) 2024-03-06T02:37:57,737 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2024-03-06T02:37:57,738 !! 2024-03-06T02:37:57,739 ******************************************************************************** 2024-03-06T02:37:57,739 ############################ 2024-03-06T02:37:57,740 # Package would be ignored # 2024-03-06T02:37:57,741 ############################ 2024-03-06T02:37:57,741 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2024-03-06T02:37:57,742 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,743 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,743 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2024-03-06T02:37:57,743 to the `packages` configuration field. 2024-03-06T02:37:57,745 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,745 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,746 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,747 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,748 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,749 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2024-03-06T02:37:57,750 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2024-03-06T02:37:57,750 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,751 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,751 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,752 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,753 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,755 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,755 even if it does not contain any `.py` files. 2024-03-06T02:37:57,756 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,756 directory, all directories are treated like packages. 2024-03-06T02:37:57,757 ******************************************************************************** 2024-03-06T02:37:57,758 !! 2024-03-06T02:37:57,758 check.warn(importable) 2024-03-06T02:37:57,759 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2024-03-06T02:37:57,759 !! 2024-03-06T02:37:57,760 ******************************************************************************** 2024-03-06T02:37:57,761 ############################ 2024-03-06T02:37:57,762 # Package would be ignored # 2024-03-06T02:37:57,762 ############################ 2024-03-06T02:37:57,763 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2024-03-06T02:37:57,763 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,764 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,765 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2024-03-06T02:37:57,765 to the `packages` configuration field. 2024-03-06T02:37:57,767 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,767 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,768 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,769 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,770 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,771 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2024-03-06T02:37:57,771 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2024-03-06T02:37:57,772 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,772 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,773 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,774 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,774 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,776 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,776 even if it does not contain any `.py` files. 2024-03-06T02:37:57,777 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,777 directory, all directories are treated like packages. 2024-03-06T02:37:57,778 ******************************************************************************** 2024-03-06T02:37:57,779 !! 2024-03-06T02:37:57,779 check.warn(importable) 2024-03-06T02:37:57,780 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2024-03-06T02:37:57,781 !! 2024-03-06T02:37:57,782 ******************************************************************************** 2024-03-06T02:37:57,782 ############################ 2024-03-06T02:37:57,783 # Package would be ignored # 2024-03-06T02:37:57,783 ############################ 2024-03-06T02:37:57,784 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2024-03-06T02:37:57,784 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,785 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,786 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2024-03-06T02:37:57,786 to the `packages` configuration field. 2024-03-06T02:37:57,787 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,788 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,789 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,790 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,791 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,792 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2024-03-06T02:37:57,793 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2024-03-06T02:37:57,793 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,794 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,794 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,795 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,797 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,798 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,799 even if it does not contain any `.py` files. 2024-03-06T02:37:57,799 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,800 directory, all directories are treated like packages. 2024-03-06T02:37:57,801 ******************************************************************************** 2024-03-06T02:37:57,801 !! 2024-03-06T02:37:57,802 check.warn(importable) 2024-03-06T02:37:57,802 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration. 2024-03-06T02:37:57,803 !! 2024-03-06T02:37:57,804 ******************************************************************************** 2024-03-06T02:37:57,804 ############################ 2024-03-06T02:37:57,804 # Package would be ignored # 2024-03-06T02:37:57,805 ############################ 2024-03-06T02:37:57,805 Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1], 2024-03-06T02:37:57,806 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,807 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,807 package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added 2024-03-06T02:37:57,808 to the `packages` configuration field. 2024-03-06T02:37:57,809 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,809 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,810 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,811 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,812 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,813 If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are 2024-03-06T02:37:57,813 already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via 2024-03-06T02:37:57,814 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,814 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,815 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,816 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,817 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,818 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,819 even if it does not contain any `.py` files. 2024-03-06T02:37:57,820 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,820 directory, all directories are treated like packages. 2024-03-06T02:37:57,821 ******************************************************************************** 2024-03-06T02:37:57,822 !! 2024-03-06T02:37:57,822 check.warn(importable) 2024-03-06T02:37:57,823 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration. 2024-03-06T02:37:57,823 !! 2024-03-06T02:37:57,824 ******************************************************************************** 2024-03-06T02:37:57,825 ############################ 2024-03-06T02:37:57,825 # Package would be ignored # 2024-03-06T02:37:57,826 ############################ 2024-03-06T02:37:57,827 Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1], 2024-03-06T02:37:57,827 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,828 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,829 package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added 2024-03-06T02:37:57,830 to the `packages` configuration field. 2024-03-06T02:37:57,831 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,831 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,832 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,832 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,833 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,835 If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are 2024-03-06T02:37:57,835 already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via 2024-03-06T02:37:57,835 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,836 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,836 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,837 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,838 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,840 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,840 even if it does not contain any `.py` files. 2024-03-06T02:37:57,841 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,841 directory, all directories are treated like packages. 2024-03-06T02:37:57,842 ******************************************************************************** 2024-03-06T02:37:57,843 !! 2024-03-06T02:37:57,843 check.warn(importable) 2024-03-06T02:37:57,844 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration. 2024-03-06T02:37:57,844 !! 2024-03-06T02:37:57,845 ******************************************************************************** 2024-03-06T02:37:57,846 ############################ 2024-03-06T02:37:57,846 # Package would be ignored # 2024-03-06T02:37:57,847 ############################ 2024-03-06T02:37:57,847 Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1], 2024-03-06T02:37:57,848 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,849 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,849 package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added 2024-03-06T02:37:57,850 to the `packages` configuration field. 2024-03-06T02:37:57,851 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,851 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,852 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,853 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,854 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,855 If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are 2024-03-06T02:37:57,856 already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via 2024-03-06T02:37:57,856 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,857 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,858 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,859 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,860 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,861 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,861 even if it does not contain any `.py` files. 2024-03-06T02:37:57,862 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,862 directory, all directories are treated like packages. 2024-03-06T02:37:57,863 ******************************************************************************** 2024-03-06T02:37:57,864 !! 2024-03-06T02:37:57,864 check.warn(importable) 2024-03-06T02:37:57,865 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration. 2024-03-06T02:37:57,865 !! 2024-03-06T02:37:57,866 ******************************************************************************** 2024-03-06T02:37:57,867 ############################ 2024-03-06T02:37:57,867 # Package would be ignored # 2024-03-06T02:37:57,868 ############################ 2024-03-06T02:37:57,868 Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1], 2024-03-06T02:37:57,868 but it is absent from setuptools' `packages` configuration. 2024-03-06T02:37:57,869 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-06T02:37:57,870 package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added 2024-03-06T02:37:57,871 to the `packages` configuration field. 2024-03-06T02:37:57,872 Alternatively, you can also rely on setuptools' discovery methods 2024-03-06T02:37:57,872 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-06T02:37:57,873 instead of `find_packages(...)`/`find:`). 2024-03-06T02:37:57,874 You can read more about "package discovery" on setuptools documentation page: 2024-03-06T02:37:57,875 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-06T02:37:57,876 If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are 2024-03-06T02:37:57,876 already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via 2024-03-06T02:37:57,877 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-06T02:37:57,877 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-06T02:37:57,878 combination with a more fine grained `package-data` configuration. 2024-03-06T02:37:57,879 You can read more about "package data files" on setuptools documentation page: 2024-03-06T02:37:57,880 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-06T02:37:57,882 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-06T02:37:57,882 even if it does not contain any `.py` files. 2024-03-06T02:37:57,883 On the other hand, currently there is no concept of package data 2024-03-06T02:37:57,883 directory, all directories are treated like packages. 2024-03-06T02:37:57,884 ******************************************************************************** 2024-03-06T02:37:57,885 !! 2024-03-06T02:37:57,885 check.warn(importable) 2024-03-06T02:37:57,886 creating build/lib/deepspeed/ops/csrc 2024-03-06T02:37:57,886 creating build/lib/deepspeed/ops/csrc/adagrad 2024-03-06T02:37:57,887 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2024-03-06T02:37:57,887 creating build/lib/deepspeed/ops/csrc/adam 2024-03-06T02:37:57,888 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2024-03-06T02:37:57,889 copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam 2024-03-06T02:37:57,890 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2024-03-06T02:37:57,890 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2024-03-06T02:37:57,890 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2024-03-06T02:37:57,891 creating build/lib/deepspeed/ops/csrc/aio 2024-03-06T02:37:57,891 creating build/lib/deepspeed/ops/csrc/aio/common 2024-03-06T02:37:57,892 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2024-03-06T02:37:57,892 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2024-03-06T02:37:57,893 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2024-03-06T02:37:57,893 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2024-03-06T02:37:57,894 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2024-03-06T02:37:57,894 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2024-03-06T02:37:57,895 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:57,895 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:57,896 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:57,896 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:57,897 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:57,897 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:57,898 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:57,898 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:57,899 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:57,899 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:57,900 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:57,900 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:57,901 creating build/lib/deepspeed/ops/csrc/aio/py_test 2024-03-06T02:37:57,902 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2024-03-06T02:37:57,902 creating build/lib/deepspeed/ops/csrc/common 2024-03-06T02:37:57,903 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2024-03-06T02:37:57,903 creating build/lib/deepspeed/ops/csrc/cpu 2024-03-06T02:37:57,904 creating build/lib/deepspeed/ops/csrc/cpu/adam 2024-03-06T02:37:57,904 copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam 2024-03-06T02:37:57,905 creating build/lib/deepspeed/ops/csrc/cpu/comm 2024-03-06T02:37:57,905 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2024-03-06T02:37:57,906 creating build/lib/deepspeed/ops/csrc/cpu/lion 2024-03-06T02:37:57,906 copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion 2024-03-06T02:37:57,907 creating build/lib/deepspeed/ops/csrc/deepspeed4science 2024-03-06T02:37:57,907 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-03-06T02:37:57,908 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-03-06T02:37:57,909 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-03-06T02:37:57,909 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-03-06T02:37:57,910 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-03-06T02:37:57,910 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-03-06T02:37:57,911 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-03-06T02:37:57,911 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-03-06T02:37:57,912 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-03-06T02:37:57,912 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-03-06T02:37:57,913 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-03-06T02:37:57,913 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-03-06T02:37:57,914 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-03-06T02:37:57,914 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-03-06T02:37:57,915 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-03-06T02:37:57,915 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-03-06T02:37:57,916 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-03-06T02:37:57,917 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-03-06T02:37:57,917 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-03-06T02:37:57,918 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-03-06T02:37:57,918 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-03-06T02:37:57,919 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-03-06T02:37:57,919 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-03-06T02:37:57,920 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-03-06T02:37:57,920 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-03-06T02:37:57,921 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-03-06T02:37:57,922 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-03-06T02:37:57,922 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-03-06T02:37:57,923 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2024-03-06T02:37:57,923 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2024-03-06T02:37:57,924 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2024-03-06T02:37:57,924 creating build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,925 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,925 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,926 copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,926 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,927 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,927 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,928 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,928 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,929 copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,930 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,931 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,931 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,932 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,932 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,933 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,934 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,934 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,935 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,935 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,936 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,936 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,937 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,938 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,938 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,939 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,939 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,940 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,941 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,941 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2024-03-06T02:37:57,942 creating build/lib/deepspeed/ops/csrc/lamb 2024-03-06T02:37:57,942 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2024-03-06T02:37:57,943 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2024-03-06T02:37:57,943 creating build/lib/deepspeed/ops/csrc/lion 2024-03-06T02:37:57,944 copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion 2024-03-06T02:37:57,944 copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion 2024-03-06T02:37:57,945 copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion 2024-03-06T02:37:57,946 copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion 2024-03-06T02:37:57,946 copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion 2024-03-06T02:37:57,947 creating build/lib/deepspeed/ops/csrc/quantization 2024-03-06T02:37:57,947 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2024-03-06T02:37:57,948 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2024-03-06T02:37:57,948 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2024-03-06T02:37:57,949 copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization 2024-03-06T02:37:57,949 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2024-03-06T02:37:57,950 copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization 2024-03-06T02:37:57,951 copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2024-03-06T02:37:57,951 creating build/lib/deepspeed/ops/csrc/random_ltd 2024-03-06T02:37:57,952 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2024-03-06T02:37:57,952 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2024-03-06T02:37:57,953 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2024-03-06T02:37:57,953 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2024-03-06T02:37:57,954 creating build/lib/deepspeed/ops/csrc/sparse_attention 2024-03-06T02:37:57,954 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2024-03-06T02:37:57,955 creating build/lib/deepspeed/ops/csrc/spatial 2024-03-06T02:37:57,955 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2024-03-06T02:37:57,956 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2024-03-06T02:37:57,957 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2024-03-06T02:37:57,957 creating build/lib/deepspeed/ops/csrc/spatial/includes 2024-03-06T02:37:57,958 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2024-03-06T02:37:57,958 creating build/lib/deepspeed/ops/csrc/transformer 2024-03-06T02:37:57,959 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2024-03-06T02:37:57,959 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2024-03-06T02:37:57,960 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2024-03-06T02:37:57,961 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2024-03-06T02:37:57,961 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2024-03-06T02:37:57,961 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2024-03-06T02:37:57,962 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2024-03-06T02:37:57,962 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2024-03-06T02:37:57,963 creating build/lib/deepspeed/ops/csrc/transformer/inference 2024-03-06T02:37:57,963 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:57,964 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:57,964 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:57,965 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:57,965 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:57,966 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:57,967 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:57,971 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:57,973 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:57,976 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:57,979 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:57,982 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2024-03-06T02:37:57,983 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2024-03-06T02:37:57,986 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2024-03-06T02:37:57,988 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2024-03-06T02:37:57,991 creating build/lib/deepspeed/ops/csrc/utils 2024-03-06T02:37:57,992 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2024-03-06T02:37:57,994 creating build/lib/deepspeed/ops/csrc/xpu 2024-03-06T02:37:57,995 creating build/lib/deepspeed/ops/csrc/xpu/adagrad 2024-03-06T02:37:57,996 copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad 2024-03-06T02:37:57,998 creating build/lib/deepspeed/ops/csrc/xpu/adam 2024-03-06T02:37:57,999 copying deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2024-03-06T02:37:58,002 copying deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2024-03-06T02:37:58,004 copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2024-03-06T02:37:58,006 copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2024-03-06T02:37:58,008 creating build/lib/deepspeed/ops/csrc/xpu/common 2024-03-06T02:37:58,009 copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common 2024-03-06T02:37:58,012 creating build/lib/deepspeed/ops/csrc/xpu/includes 2024-03-06T02:37:58,012 copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2024-03-06T02:37:58,014 copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2024-03-06T02:37:58,016 copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2024-03-06T02:37:58,019 copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2024-03-06T02:37:58,021 copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2024-03-06T02:37:58,023 creating build/lib/deepspeed/autotuning/config_templates 2024-03-06T02:37:58,024 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2024-03-06T02:37:58,026 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2024-03-06T02:37:58,028 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2024-03-06T02:37:58,030 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2024-03-06T02:37:58,032 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2024-03-06T02:37:58,034 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2024-03-06T02:37:58,036 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2024-03-06T02:37:58,038 creating build/lib/deepspeed/inference/v2/ragged/csrc 2024-03-06T02:37:58,039 copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc 2024-03-06T02:37:58,041 copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc 2024-03-06T02:37:58,043 creating build/lib/deepspeed/inference/v2/ragged/includes 2024-03-06T02:37:58,044 copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes 2024-03-06T02:37:58,046 creating build/lib/deepspeed/inference/v2/kernels/includes 2024-03-06T02:37:58,047 copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes 2024-03-06T02:37:58,049 copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2024-03-06T02:37:58,052 copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2024-03-06T02:37:58,054 copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2024-03-06T02:37:58,057 copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2024-03-06T02:37:58,059 copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2024-03-06T02:37:58,061 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2024-03-06T02:37:58,062 copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2024-03-06T02:37:58,064 copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops 2024-03-06T02:37:58,067 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2024-03-06T02:37:58,068 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes 2024-03-06T02:37:58,069 copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes 2024-03-06T02:37:58,071 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2024-03-06T02:37:58,072 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2024-03-06T02:37:58,074 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2024-03-06T02:37:58,076 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2024-03-06T02:37:58,078 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-03-06T02:37:58,080 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-03-06T02:37:58,082 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-03-06T02:37:58,084 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-03-06T02:37:58,086 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-03-06T02:37:58,088 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-03-06T02:37:58,090 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-03-06T02:37:58,093 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-03-06T02:37:58,095 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-03-06T02:37:58,097 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-03-06T02:37:58,099 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-03-06T02:37:58,102 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-03-06T02:37:58,104 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-03-06T02:37:58,106 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-03-06T02:37:58,108 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-03-06T02:37:58,111 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-03-06T02:37:58,112 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-03-06T02:37:58,115 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:37:58,117 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:37:58,119 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:37:58,122 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-03-06T02:37:58,124 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-03-06T02:37:58,126 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-03-06T02:37:58,128 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-03-06T02:37:58,130 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-03-06T02:37:58,132 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-03-06T02:37:58,134 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-03-06T02:37:58,135 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-03-06T02:37:58,138 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-03-06T02:37:58,140 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-03-06T02:37:58,142 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-03-06T02:37:58,144 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-03-06T02:37:58,146 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:37:58,148 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:37:58,151 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:37:58,153 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:37:58,155 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-03-06T02:37:58,157 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-03-06T02:37:58,159 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-03-06T02:37:58,161 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-03-06T02:37:58,163 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-03-06T02:37:58,165 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-03-06T02:37:58,168 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-03-06T02:37:58,170 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-03-06T02:37:58,172 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-03-06T02:37:58,174 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-03-06T02:37:58,176 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-03-06T02:37:58,178 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-03-06T02:37:58,180 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-03-06T02:37:58,182 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-03-06T02:37:58,230 running build_scripts 2024-03-06T02:37:58,230 creating build/scripts-3.11 2024-03-06T02:37:58,231 copying and adjusting bin/deepspeed -> build/scripts-3.11 2024-03-06T02:37:58,233 copying and adjusting bin/deepspeed.pt -> build/scripts-3.11 2024-03-06T02:37:58,234 copying and adjusting bin/ds -> build/scripts-3.11 2024-03-06T02:37:58,236 copying bin/ds_ssh -> build/scripts-3.11 2024-03-06T02:37:58,238 copying and adjusting bin/ds_report -> build/scripts-3.11 2024-03-06T02:37:58,239 copying and adjusting bin/ds_bench -> build/scripts-3.11 2024-03-06T02:37:58,241 copying and adjusting bin/dsr -> build/scripts-3.11 2024-03-06T02:37:58,242 copying and adjusting bin/ds_elastic -> build/scripts-3.11 2024-03-06T02:37:58,243 changing mode of build/scripts-3.11/deepspeed from 644 to 755 2024-03-06T02:37:58,244 changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755 2024-03-06T02:37:58,244 changing mode of build/scripts-3.11/ds from 644 to 755 2024-03-06T02:37:58,245 changing mode of build/scripts-3.11/ds_report from 644 to 755 2024-03-06T02:37:58,245 changing mode of build/scripts-3.11/ds_bench from 644 to 755 2024-03-06T02:37:58,246 changing mode of build/scripts-3.11/dsr from 644 to 755 2024-03-06T02:37:58,247 changing mode of build/scripts-3.11/ds_elastic from 644 to 755 2024-03-06T02:37:58,272 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-03-06T02:37:58,272 !! 2024-03-06T02:37:58,273 ******************************************************************************** 2024-03-06T02:37:58,274 Please avoid running ``setup.py`` directly. 2024-03-06T02:37:58,275 Instead, use pypa/build, pypa/installer or other 2024-03-06T02:37:58,275 standards-based tools. 2024-03-06T02:37:58,276 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-03-06T02:37:58,277 ******************************************************************************** 2024-03-06T02:37:58,278 !! 2024-03-06T02:37:58,279 self.initialize_options() 2024-03-06T02:37:58,297 installing to build/bdist.linux-armv7l/wheel 2024-03-06T02:37:58,298 running install 2024-03-06T02:37:58,323 running install_lib 2024-03-06T02:37:58,348 creating build/bdist.linux-armv7l 2024-03-06T02:37:58,349 creating build/bdist.linux-armv7l/wheel 2024-03-06T02:37:58,351 creating build/bdist.linux-armv7l/wheel/deepspeed 2024-03-06T02:37:58,352 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2024-03-06T02:37:58,355 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-03-06T02:37:58,356 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-03-06T02:37:58,358 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,359 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,361 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,363 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,365 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,367 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,369 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,370 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,372 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,374 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,376 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,378 copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,380 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,383 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,385 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,387 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2024-03-06T02:37:58,388 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2024-03-06T02:37:58,390 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2024-03-06T02:37:58,392 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2024-03-06T02:37:58,395 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2024-03-06T02:37:58,397 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2024-03-06T02:37:58,399 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2024-03-06T02:37:58,401 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2024-03-06T02:37:58,403 copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,405 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,407 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,409 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,411 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-03-06T02:37:58,413 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-03-06T02:37:58,415 copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-03-06T02:37:58,417 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-03-06T02:37:58,419 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-03-06T02:37:58,421 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-03-06T02:37:58,422 copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-03-06T02:37:58,424 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-03-06T02:37:58,427 copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-03-06T02:37:58,429 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-03-06T02:37:58,431 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-03-06T02:37:58,433 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-03-06T02:37:58,436 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-03-06T02:37:58,439 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2024-03-06T02:37:58,440 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2024-03-06T02:37:58,442 copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/deepspeed 2024-03-06T02:37:58,444 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2024-03-06T02:37:58,445 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2024-03-06T02:37:58,447 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2024-03-06T02:37:58,449 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2024-03-06T02:37:58,451 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2024-03-06T02:37:58,454 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2024-03-06T02:37:58,455 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2024-03-06T02:37:58,458 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,459 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,462 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,464 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,467 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2024-03-06T02:37:58,468 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2024-03-06T02:37:58,470 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2024-03-06T02:37:58,473 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2024-03-06T02:37:58,475 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2024-03-06T02:37:58,477 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2024-03-06T02:37:58,479 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2024-03-06T02:37:58,483 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2024-03-06T02:37:58,483 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2024-03-06T02:37:58,486 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2024-03-06T02:37:58,487 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2024-03-06T02:37:58,489 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2024-03-06T02:37:58,490 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2024-03-06T02:37:58,493 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2024-03-06T02:37:58,494 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2024-03-06T02:37:58,496 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2024-03-06T02:37:58,498 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2024-03-06T02:37:58,500 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2024-03-06T02:37:58,502 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2024-03-06T02:37:58,503 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2024-03-06T02:37:58,505 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2024-03-06T02:37:58,508 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2024-03-06T02:37:58,510 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2024-03-06T02:37:58,513 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2024-03-06T02:37:58,515 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,517 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,519 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,521 copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,524 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2024-03-06T02:37:58,525 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2024-03-06T02:37:58,526 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2024-03-06T02:37:58,528 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-03-06T02:37:58,529 copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-03-06T02:37:58,531 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-03-06T02:37:58,533 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-03-06T02:37:58,535 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-03-06T02:37:58,537 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-03-06T02:37:58,541 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-03-06T02:37:58,543 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-03-06T02:37:58,546 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-03-06T02:37:58,550 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-03-06T02:37:58,553 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-03-06T02:37:58,555 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-03-06T02:37:58,556 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-03-06T02:37:58,558 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-03-06T02:37:58,560 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-03-06T02:37:58,562 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-03-06T02:37:58,564 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-03-06T02:37:58,568 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2024-03-06T02:37:58,569 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2024-03-06T02:37:58,571 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2024-03-06T02:37:58,574 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2024-03-06T02:37:58,576 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,579 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2024-03-06T02:37:58,580 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2024-03-06T02:37:58,582 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2024-03-06T02:37:58,584 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2024-03-06T02:37:58,587 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2024-03-06T02:37:58,588 copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2024-03-06T02:37:58,591 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,592 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,595 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-03-06T02:37:58,596 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-03-06T02:37:58,599 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-03-06T02:37:58,601 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-03-06T02:37:58,603 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-03-06T02:37:58,605 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-03-06T02:37:58,607 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-03-06T02:37:58,608 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-03-06T02:37:58,611 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-03-06T02:37:58,612 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-03-06T02:37:58,614 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,617 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,619 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,622 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2024-03-06T02:37:58,623 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2024-03-06T02:37:58,625 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2024-03-06T02:37:58,627 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2024-03-06T02:37:58,629 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2024-03-06T02:37:58,631 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2024-03-06T02:37:58,632 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2024-03-06T02:37:58,635 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2024-03-06T02:37:58,636 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2024-03-06T02:37:58,639 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2024-03-06T02:37:58,641 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2024-03-06T02:37:58,642 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2024-03-06T02:37:58,645 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2024-03-06T02:37:58,647 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2024-03-06T02:37:58,649 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2024-03-06T02:37:58,652 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,656 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,659 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,661 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-03-06T02:37:58,663 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2024-03-06T02:37:58,664 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2024-03-06T02:37:58,665 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2024-03-06T02:37:58,667 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2024-03-06T02:37:58,669 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2024-03-06T02:37:58,671 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-03-06T02:37:58,672 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-03-06T02:37:58,674 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-03-06T02:37:58,676 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-03-06T02:37:58,677 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-03-06T02:37:58,679 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-03-06T02:37:58,681 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-03-06T02:37:58,683 copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-03-06T02:37:58,684 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-03-06T02:37:58,686 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-03-06T02:37:58,688 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-03-06T02:37:58,690 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2024-03-06T02:37:58,692 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2024-03-06T02:37:58,693 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2024-03-06T02:37:58,694 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2024-03-06T02:37:58,697 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2024-03-06T02:37:58,697 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2024-03-06T02:37:58,699 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2024-03-06T02:37:58,701 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2024-03-06T02:37:58,703 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-03-06T02:37:58,704 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-03-06T02:37:58,706 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-03-06T02:37:58,708 copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-03-06T02:37:58,710 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-03-06T02:37:58,712 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-03-06T02:37:58,714 copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-03-06T02:37:58,716 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-03-06T02:37:58,718 copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-03-06T02:37:58,720 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-03-06T02:37:58,723 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2024-03-06T02:37:58,724 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2024-03-06T02:37:58,725 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2024-03-06T02:37:58,728 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2024-03-06T02:37:58,728 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2024-03-06T02:37:58,731 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2024-03-06T02:37:58,733 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2024-03-06T02:37:58,735 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2024-03-06T02:37:58,736 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2024-03-06T02:37:58,738 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2024-03-06T02:37:58,740 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2024-03-06T02:37:58,742 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2024-03-06T02:37:58,743 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2024-03-06T02:37:58,745 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2024-03-06T02:37:58,747 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2024-03-06T02:37:58,749 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-03-06T02:37:58,750 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-03-06T02:37:58,752 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-03-06T02:37:58,755 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-03-06T02:37:58,757 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-03-06T02:37:58,760 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-03-06T02:37:58,762 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-03-06T02:37:58,764 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-03-06T02:37:58,766 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-03-06T02:37:58,768 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2024-03-06T02:37:58,769 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2024-03-06T02:37:58,771 copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2024-03-06T02:37:58,773 copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2024-03-06T02:37:58,775 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2024-03-06T02:37:58,776 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu 2024-03-06T02:37:58,777 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2024-03-06T02:37:58,778 copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2024-03-06T02:37:58,780 copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2024-03-06T02:37:58,782 copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2024-03-06T02:37:58,784 copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2024-03-06T02:37:58,786 copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2024-03-06T02:37:58,789 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad 2024-03-06T02:37:58,790 copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad 2024-03-06T02:37:58,792 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common 2024-03-06T02:37:58,793 copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common 2024-03-06T02:37:58,796 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam 2024-03-06T02:37:58,797 copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam 2024-03-06T02:37:58,799 copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam 2024-03-06T02:37:58,801 copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam 2024-03-06T02:37:58,803 copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam 2024-03-06T02:37:58,805 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science 2024-03-06T02:37:58,806 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-03-06T02:37:58,808 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-03-06T02:37:58,812 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-03-06T02:37:58,814 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-03-06T02:37:58,817 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-03-06T02:37:58,817 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-03-06T02:37:58,820 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-03-06T02:37:58,821 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-03-06T02:37:58,824 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-03-06T02:37:58,828 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-03-06T02:37:58,831 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-03-06T02:37:58,834 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-03-06T02:37:58,836 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-03-06T02:37:58,838 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-03-06T02:37:58,839 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-03-06T02:37:58,841 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-03-06T02:37:58,844 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-03-06T02:37:58,846 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-03-06T02:37:58,850 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2024-03-06T02:37:58,850 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2024-03-06T02:37:58,853 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2024-03-06T02:37:58,855 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-03-06T02:37:58,858 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-03-06T02:37:58,859 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-03-06T02:37:58,863 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-03-06T02:37:58,866 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-03-06T02:37:58,868 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-03-06T02:37:58,870 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-03-06T02:37:58,872 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-03-06T02:37:58,875 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-03-06T02:37:58,877 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-03-06T02:37:58,879 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2024-03-06T02:37:58,880 copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2024-03-06T02:37:58,883 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2024-03-06T02:37:58,885 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2024-03-06T02:37:58,887 copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2024-03-06T02:37:58,889 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2024-03-06T02:37:58,891 copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2024-03-06T02:37:58,894 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2024-03-06T02:37:58,897 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2024-03-06T02:37:58,899 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2024-03-06T02:37:58,900 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2024-03-06T02:37:58,902 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2024-03-06T02:37:58,904 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2024-03-06T02:37:58,905 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2024-03-06T02:37:58,908 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,909 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,912 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,914 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,915 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,917 copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,919 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,921 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,923 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,924 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,927 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,929 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,930 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,932 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,935 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,936 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,939 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,942 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,944 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,946 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,948 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,950 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,953 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,954 copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,957 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,959 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,961 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,963 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,965 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,967 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-03-06T02:37:58,970 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2024-03-06T02:37:58,972 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2024-03-06T02:37:58,973 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2024-03-06T02:37:58,975 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:58,976 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:58,978 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:58,980 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:58,982 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:58,984 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:58,985 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:58,988 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:58,989 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:58,991 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:58,993 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:58,995 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-03-06T02:37:58,997 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2024-03-06T02:37:58,998 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2024-03-06T02:37:59,000 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2024-03-06T02:37:59,002 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2024-03-06T02:37:59,004 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2024-03-06T02:37:59,006 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2024-03-06T02:37:59,008 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2024-03-06T02:37:59,010 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2024-03-06T02:37:59,011 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2024-03-06T02:37:59,014 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2024-03-06T02:37:59,015 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2024-03-06T02:37:59,018 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu 2024-03-06T02:37:59,019 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2024-03-06T02:37:59,020 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2024-03-06T02:37:59,023 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2024-03-06T02:37:59,024 copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2024-03-06T02:37:59,026 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2024-03-06T02:37:59,027 copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2024-03-06T02:37:59,029 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2024-03-06T02:37:59,030 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2024-03-06T02:37:59,032 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-03-06T02:37:59,033 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-03-06T02:37:59,036 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-03-06T02:37:59,039 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-03-06T02:37:59,042 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-03-06T02:37:59,044 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-03-06T02:37:59,046 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-03-06T02:37:59,049 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2024-03-06T02:37:59,051 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:59,052 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:59,056 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:59,059 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:59,061 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:59,064 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:59,066 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:59,068 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:59,071 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:59,073 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:59,076 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-03-06T02:37:59,078 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2024-03-06T02:37:59,079 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2024-03-06T02:37:59,081 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2024-03-06T02:37:59,084 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2024-03-06T02:37:59,086 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-03-06T02:37:59,089 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-03-06T02:37:59,092 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2024-03-06T02:37:59,093 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2024-03-06T02:37:59,095 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2024-03-06T02:37:59,097 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2024-03-06T02:37:59,099 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2024-03-06T02:37:59,101 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2024-03-06T02:37:59,103 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2024-03-06T02:37:59,104 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2024-03-06T02:37:59,107 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2024-03-06T02:37:59,109 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2024-03-06T02:37:59,111 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2024-03-06T02:37:59,114 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2024-03-06T02:37:59,115 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2024-03-06T02:37:59,118 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2024-03-06T02:37:59,120 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2024-03-06T02:37:59,121 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2024-03-06T02:37:59,123 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2024-03-06T02:37:59,124 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2024-03-06T02:37:59,127 copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2024-03-06T02:37:59,128 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2024-03-06T02:37:59,130 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2024-03-06T02:37:59,132 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2024-03-06T02:37:59,135 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2024-03-06T02:37:59,136 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2024-03-06T02:37:59,138 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2024-03-06T02:37:59,139 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2024-03-06T02:37:59,141 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2024-03-06T02:37:59,144 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2024-03-06T02:37:59,144 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2024-03-06T02:37:59,147 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2024-03-06T02:37:59,149 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2024-03-06T02:37:59,152 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2024-03-06T02:37:59,154 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2024-03-06T02:37:59,157 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2024-03-06T02:37:59,158 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2024-03-06T02:37:59,160 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2024-03-06T02:37:59,161 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2024-03-06T02:37:59,164 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2024-03-06T02:37:59,165 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2024-03-06T02:37:59,167 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2024-03-06T02:37:59,170 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2024-03-06T02:37:59,173 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,173 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,176 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2024-03-06T02:37:59,177 copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2024-03-06T02:37:59,179 copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2024-03-06T02:37:59,181 copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2024-03-06T02:37:59,183 copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2024-03-06T02:37:59,185 copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2024-03-06T02:37:59,186 copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2024-03-06T02:37:59,188 copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,190 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,192 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,194 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,196 copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,198 copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,200 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,201 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,204 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2024-03-06T02:37:59,205 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2024-03-06T02:37:59,207 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2024-03-06T02:37:59,209 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2024-03-06T02:37:59,211 copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2024-03-06T02:37:59,212 copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2024-03-06T02:37:59,214 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2024-03-06T02:37:59,216 copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,218 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,219 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,221 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,223 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,225 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,228 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,230 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-03-06T02:37:59,231 copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-03-06T02:37:59,233 copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-03-06T02:37:59,235 copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-03-06T02:37:59,237 copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-03-06T02:37:59,239 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-03-06T02:37:59,241 copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-03-06T02:37:59,243 copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-03-06T02:37:59,245 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-03-06T02:37:59,247 copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-03-06T02:37:59,248 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,250 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,252 copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,254 copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,256 copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,258 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2024-03-06T02:37:59,259 copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2024-03-06T02:37:59,261 copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2024-03-06T02:37:59,262 copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2024-03-06T02:37:59,264 copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2024-03-06T02:37:59,266 copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2024-03-06T02:37:59,267 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-03-06T02:37:59,269 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2024-03-06T02:37:59,270 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2024-03-06T02:37:59,273 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2024-03-06T02:37:59,275 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-03-06T02:37:59,276 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-03-06T02:37:59,279 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-03-06T02:37:59,281 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-03-06T02:37:59,283 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-03-06T02:37:59,285 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-03-06T02:37:59,287 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-03-06T02:37:59,290 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-03-06T02:37:59,292 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-03-06T02:37:59,295 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-03-06T02:37:59,297 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:59,299 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:59,301 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:59,303 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:59,305 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:59,307 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:59,308 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:59,311 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:59,313 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:59,314 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:59,316 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-03-06T02:37:59,318 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-03-06T02:37:59,321 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:59,322 copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:59,324 copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:59,326 copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:59,328 copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:59,330 copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:59,332 copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:59,335 copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:59,337 copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:59,339 copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:59,341 copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-03-06T02:37:59,344 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2024-03-06T02:37:59,345 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2024-03-06T02:37:59,347 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2024-03-06T02:37:59,349 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2024-03-06T02:37:59,351 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2024-03-06T02:37:59,353 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2024-03-06T02:37:59,354 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2024-03-06T02:37:59,356 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2024-03-06T02:37:59,358 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2024-03-06T02:37:59,359 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2024-03-06T02:37:59,361 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2024-03-06T02:38:00,324 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2024-03-06T02:38:00,331 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2024-03-06T02:38:00,331 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2024-03-06T02:38:00,338 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2024-03-06T02:38:00,340 copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2024-03-06T02:38:00,343 copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2024-03-06T02:38:00,346 copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2024-03-06T02:38:00,350 copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2024-03-06T02:38:00,354 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2024-03-06T02:38:00,355 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2024-03-06T02:38:00,360 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2024-03-06T02:38:00,361 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2024-03-06T02:38:00,364 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2024-03-06T02:38:00,367 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2024-03-06T02:38:00,370 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2024-03-06T02:38:00,373 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2024-03-06T02:38:00,376 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2024-03-06T02:38:00,379 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2024-03-06T02:38:00,384 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2024-03-06T02:38:00,388 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2024-03-06T02:38:00,393 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2024-03-06T02:38:00,394 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2024-03-06T02:38:00,398 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2024-03-06T02:38:00,402 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2024-03-06T02:38:00,405 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2024-03-06T02:38:00,409 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2024-03-06T02:38:00,414 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2024-03-06T02:38:00,417 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2024-03-06T02:38:00,422 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2024-03-06T02:38:00,424 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2024-03-06T02:38:00,428 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2024-03-06T02:38:00,436 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2024-03-06T02:38:00,439 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2024-03-06T02:38:00,443 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2024-03-06T02:38:00,448 copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2024-03-06T02:38:00,451 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-03-06T02:38:00,452 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-03-06T02:38:00,456 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-03-06T02:38:00,459 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-03-06T02:38:00,461 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-03-06T02:38:00,464 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-03-06T02:38:00,467 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-03-06T02:38:00,472 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-03-06T02:38:00,475 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-03-06T02:38:00,478 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-03-06T02:38:00,481 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-03-06T02:38:00,483 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-03-06T02:38:00,486 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-03-06T02:38:00,490 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-03-06T02:38:00,493 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-03-06T02:38:00,496 copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-03-06T02:38:00,499 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-03-06T02:38:00,503 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-03-06T02:38:00,506 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-03-06T02:38:00,509 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-03-06T02:38:00,512 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-03-06T02:38:00,515 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2024-03-06T02:38:00,521 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2024-03-06T02:38:00,523 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2024-03-06T02:38:00,525 copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2024-03-06T02:38:00,529 copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2024-03-06T02:38:00,531 copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2024-03-06T02:38:00,535 copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2024-03-06T02:38:00,538 copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2024-03-06T02:38:00,541 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2024-03-06T02:38:00,545 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2024-03-06T02:38:00,548 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-03-06T02:38:00,551 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2024-03-06T02:38:00,553 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2024-03-06T02:38:00,555 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2024-03-06T02:38:00,557 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2024-03-06T02:38:00,560 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2024-03-06T02:38:00,563 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2024-03-06T02:38:00,567 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral 2024-03-06T02:38:00,568 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral 2024-03-06T02:38:00,571 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral 2024-03-06T02:38:00,574 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral 2024-03-06T02:38:00,583 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral 2024-03-06T02:38:00,587 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi 2024-03-06T02:38:00,588 copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi 2024-03-06T02:38:00,591 copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi 2024-03-06T02:38:00,594 copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi 2024-03-06T02:38:00,596 copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi 2024-03-06T02:38:00,600 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2024-03-06T02:38:00,601 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2024-03-06T02:38:00,604 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2024-03-06T02:38:00,606 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2024-03-06T02:38:00,609 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2024-03-06T02:38:00,612 copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2024-03-06T02:38:00,615 copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2024-03-06T02:38:00,617 copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2024-03-06T02:38:00,620 copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2024-03-06T02:38:00,623 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2024-03-06T02:38:00,624 copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2024-03-06T02:38:00,626 copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2024-03-06T02:38:00,629 copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2024-03-06T02:38:00,631 copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2024-03-06T02:38:00,634 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2024-03-06T02:38:00,636 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2024-03-06T02:38:00,638 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2024-03-06T02:38:00,640 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2024-03-06T02:38:00,643 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2024-03-06T02:38:00,646 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2 2024-03-06T02:38:00,648 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2 2024-03-06T02:38:00,650 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2 2024-03-06T02:38:00,653 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2 2024-03-06T02:38:00,656 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2 2024-03-06T02:38:00,661 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:38:00,662 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:38:00,664 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:38:00,667 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:38:00,669 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:38:00,671 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:38:00,673 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:38:00,676 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:38:00,678 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:38:00,681 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-03-06T02:38:00,683 copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2024-03-06T02:38:00,686 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen 2024-03-06T02:38:00,687 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen 2024-03-06T02:38:00,690 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen 2024-03-06T02:38:00,692 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen 2024-03-06T02:38:00,694 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen 2024-03-06T02:38:00,696 copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2024-03-06T02:38:00,702 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:38:00,703 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:38:00,705 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:38:00,708 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:38:00,710 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:38:00,712 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:38:00,714 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:38:00,716 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:38:00,718 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:38:00,720 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-03-06T02:38:00,722 copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2024-03-06T02:38:00,725 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2024-03-06T02:38:00,726 copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2024-03-06T02:38:00,733 copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2024-03-06T02:38:00,737 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2024-03-06T02:38:00,738 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2024-03-06T02:38:00,739 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2024-03-06T02:38:00,742 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2024-03-06T02:38:00,745 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2024-03-06T02:38:00,746 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2024-03-06T02:38:00,749 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2024-03-06T02:38:00,752 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2024-03-06T02:38:00,755 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2024-03-06T02:38:00,756 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2024-03-06T02:38:00,758 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2024-03-06T02:38:00,761 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2024-03-06T02:38:00,762 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2024-03-06T02:38:00,774 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2024-03-06T02:38:00,777 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2024-03-06T02:38:00,778 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2024-03-06T02:38:00,781 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2024-03-06T02:38:00,784 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2024-03-06T02:38:00,785 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2024-03-06T02:38:00,788 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2024-03-06T02:38:00,790 copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2024-03-06T02:38:00,793 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2024-03-06T02:38:00,794 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2024-03-06T02:38:00,797 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2024-03-06T02:38:00,800 copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2024-03-06T02:38:00,802 copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2024-03-06T02:38:00,805 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2024-03-06T02:38:00,806 copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2024-03-06T02:38:00,808 copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2024-03-06T02:38:00,810 copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2024-03-06T02:38:00,812 copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2024-03-06T02:38:00,813 copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2024-03-06T02:38:00,815 copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2024-03-06T02:38:00,817 copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2024-03-06T02:38:00,819 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:38:00,821 copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:38:00,823 copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:38:00,825 copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:38:00,827 copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:38:00,829 copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:38:00,831 copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:38:00,832 copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:38:00,835 copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-03-06T02:38:00,837 copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-03-06T02:38:00,838 copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-03-06T02:38:00,841 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2024-03-06T02:38:00,843 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2024-03-06T02:38:00,844 copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2024-03-06T02:38:00,846 copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2024-03-06T02:38:00,848 copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2024-03-06T02:38:00,851 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2024-03-06T02:38:00,852 copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2024-03-06T02:38:00,854 copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2024-03-06T02:38:00,856 copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2024-03-06T02:38:00,859 copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2024-03-06T02:38:00,861 copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2024-03-06T02:38:00,863 copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2024-03-06T02:38:00,866 copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2024-03-06T02:38:00,868 copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-03-06T02:38:00,871 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2024-03-06T02:38:00,872 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2024-03-06T02:38:00,874 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-03-06T02:38:00,876 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-03-06T02:38:00,878 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-03-06T02:38:00,880 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-03-06T02:38:00,882 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-03-06T02:38:00,884 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-03-06T02:38:00,886 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-03-06T02:38:00,888 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2024-03-06T02:38:00,889 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2024-03-06T02:38:00,891 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2024-03-06T02:38:00,894 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-03-06T02:38:00,894 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-03-06T02:38:00,896 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-03-06T02:38:00,899 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-03-06T02:38:00,901 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-03-06T02:38:00,903 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-03-06T02:38:00,905 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2024-03-06T02:38:00,907 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2024-03-06T02:38:00,908 copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2024-03-06T02:38:00,910 copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2024-03-06T02:38:00,914 copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2024-03-06T02:38:00,917 copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2024-03-06T02:38:00,919 copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2024-03-06T02:38:00,923 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2024-03-06T02:38:00,924 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-03-06T02:38:00,925 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-03-06T02:38:00,927 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-03-06T02:38:00,930 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-03-06T02:38:00,932 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-03-06T02:38:00,935 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-03-06T02:38:00,935 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-03-06T02:38:00,938 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-03-06T02:38:00,940 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-03-06T02:38:00,942 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-03-06T02:38:00,944 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-03-06T02:38:00,946 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-03-06T02:38:00,949 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-03-06T02:38:00,951 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-03-06T02:38:00,952 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-03-06T02:38:00,954 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-03-06T02:38:00,956 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-03-06T02:38:00,958 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-03-06T02:38:00,961 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-03-06T02:38:00,963 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-03-06T02:38:00,964 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-03-06T02:38:00,967 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-03-06T02:38:00,969 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-03-06T02:38:00,971 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-03-06T02:38:00,973 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-03-06T02:38:00,975 copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2024-03-06T02:38:00,977 copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2024-03-06T02:38:00,979 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:38:00,980 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:38:00,982 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:38:00,984 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:38:00,986 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:38:00,988 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:38:00,990 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:38:00,992 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:38:00,994 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-03-06T02:38:00,996 copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2024-03-06T02:38:00,998 copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2024-03-06T02:38:01,000 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2024-03-06T02:38:01,001 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-03-06T02:38:01,002 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-03-06T02:38:01,004 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-03-06T02:38:01,006 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-03-06T02:38:01,008 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-03-06T02:38:01,010 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-03-06T02:38:01,012 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-03-06T02:38:01,015 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-03-06T02:38:01,016 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-03-06T02:38:01,018 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-03-06T02:38:01,020 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-03-06T02:38:01,022 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-03-06T02:38:01,024 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-03-06T02:38:01,026 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-03-06T02:38:01,028 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes 2024-03-06T02:38:01,029 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes 2024-03-06T02:38:01,031 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-03-06T02:38:01,032 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-03-06T02:38:01,034 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-03-06T02:38:01,036 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-03-06T02:38:01,038 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-03-06T02:38:01,040 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-03-06T02:38:01,042 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-03-06T02:38:01,044 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2024-03-06T02:38:01,046 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2024-03-06T02:38:01,048 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2024-03-06T02:38:01,049 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2024-03-06T02:38:01,051 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2024-03-06T02:38:01,052 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2024-03-06T02:38:01,055 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:38:01,056 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:38:01,058 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:38:01,060 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:38:01,062 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:38:01,064 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:38:01,065 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:38:01,067 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:38:01,069 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-03-06T02:38:01,071 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-03-06T02:38:01,072 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-03-06T02:38:01,074 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-03-06T02:38:01,076 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-03-06T02:38:01,078 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-03-06T02:38:01,080 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-03-06T02:38:01,081 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-03-06T02:38:01,083 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-03-06T02:38:01,085 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-03-06T02:38:01,087 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-03-06T02:38:01,089 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-03-06T02:38:01,091 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-03-06T02:38:01,093 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-03-06T02:38:01,094 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-03-06T02:38:01,096 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-03-06T02:38:01,098 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-03-06T02:38:01,100 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-03-06T02:38:01,102 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-03-06T02:38:01,104 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-03-06T02:38:01,106 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-03-06T02:38:01,107 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-03-06T02:38:01,109 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-03-06T02:38:01,111 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-03-06T02:38:01,113 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-03-06T02:38:01,115 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-03-06T02:38:01,117 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-03-06T02:38:01,119 copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-03-06T02:38:01,121 copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-03-06T02:38:01,123 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2024-03-06T02:38:01,124 copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2024-03-06T02:38:01,126 copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2024-03-06T02:38:01,128 copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2024-03-06T02:38:01,129 copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2024-03-06T02:38:01,132 copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-03-06T02:38:01,133 copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-03-06T02:38:01,135 copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-03-06T02:38:01,137 copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-03-06T02:38:01,139 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2024-03-06T02:38:01,142 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2024-03-06T02:38:01,143 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2024-03-06T02:38:01,145 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2024-03-06T02:38:01,147 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2024-03-06T02:38:01,149 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2024-03-06T02:38:01,151 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2024-03-06T02:38:01,153 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2024-03-06T02:38:01,156 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2024-03-06T02:38:01,159 creating build/bdist.linux-armv7l/wheel/deepspeed/sequence 2024-03-06T02:38:01,160 copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2024-03-06T02:38:01,162 copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2024-03-06T02:38:01,165 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-03-06T02:38:01,166 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-03-06T02:38:01,169 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-03-06T02:38:01,172 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-03-06T02:38:01,174 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-03-06T02:38:01,177 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-03-06T02:38:01,179 copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-03-06T02:38:01,182 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-03-06T02:38:01,185 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-03-06T02:38:01,187 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-03-06T02:38:01,190 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-03-06T02:38:01,192 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-03-06T02:38:01,194 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-03-06T02:38:01,197 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-03-06T02:38:01,200 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-03-06T02:38:01,202 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-03-06T02:38:01,205 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2024-03-06T02:38:01,207 running install_egg_info 2024-03-06T02:38:01,248 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.13.5-py3.11.egg-info 2024-03-06T02:38:01,264 running install_scripts 2024-03-06T02:38:01,265 creating build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data 2024-03-06T02:38:01,266 creating build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data/scripts 2024-03-06T02:38:01,267 copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data/scripts 2024-03-06T02:38:01,269 copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data/scripts 2024-03-06T02:38:01,270 copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data/scripts 2024-03-06T02:38:01,272 copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data/scripts 2024-03-06T02:38:01,273 copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data/scripts 2024-03-06T02:38:01,275 copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data/scripts 2024-03-06T02:38:01,276 copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data/scripts 2024-03-06T02:38:01,278 copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data/scripts 2024-03-06T02:38:01,279 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data/scripts/dsr to 755 2024-03-06T02:38:01,280 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data/scripts/ds to 755 2024-03-06T02:38:01,280 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data/scripts/ds_ssh to 755 2024-03-06T02:38:01,281 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data/scripts/ds_report to 755 2024-03-06T02:38:01,281 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data/scripts/ds_elastic to 755 2024-03-06T02:38:01,282 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data/scripts/ds_bench to 755 2024-03-06T02:38:01,282 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data/scripts/deepspeed to 755 2024-03-06T02:38:01,283 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.data/scripts/deepspeed.pt to 755 2024-03-06T02:38:01,326 creating build/bdist.linux-armv7l/wheel/deepspeed-0.13.5.dist-info/WHEEL 2024-03-06T02:38:01,328 creating '/tmp/pip-wheel-qdu5shyv/deepspeed-0.13.5-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-03-06T02:38:01,331 adding 'deepspeed/__init__.py' 2024-03-06T02:38:01,333 adding 'deepspeed/constants.py' 2024-03-06T02:38:01,334 adding 'deepspeed/env_report.py' 2024-03-06T02:38:01,336 adding 'deepspeed/git_version_info.py' 2024-03-06T02:38:01,337 adding 'deepspeed/git_version_info_installed.py' 2024-03-06T02:38:01,338 adding 'deepspeed/pydantic_v1.py' 2024-03-06T02:38:01,340 adding 'deepspeed/accelerator/__init__.py' 2024-03-06T02:38:01,342 adding 'deepspeed/accelerator/abstract_accelerator.py' 2024-03-06T02:38:01,343 adding 'deepspeed/accelerator/cpu_accelerator.py' 2024-03-06T02:38:01,345 adding 'deepspeed/accelerator/cuda_accelerator.py' 2024-03-06T02:38:01,347 adding 'deepspeed/accelerator/hpu_accelerator.py' 2024-03-06T02:38:01,349 adding 'deepspeed/accelerator/mps_accelerator.py' 2024-03-06T02:38:01,350 adding 'deepspeed/accelerator/npu_accelerator.py' 2024-03-06T02:38:01,352 adding 'deepspeed/accelerator/real_accelerator.py' 2024-03-06T02:38:01,354 adding 'deepspeed/accelerator/xpu_accelerator.py' 2024-03-06T02:38:01,355 adding 'deepspeed/autotuning/__init__.py' 2024-03-06T02:38:01,362 adding 'deepspeed/autotuning/autotuner.py' 2024-03-06T02:38:01,363 adding 'deepspeed/autotuning/config.py' 2024-03-06T02:38:01,365 adding 'deepspeed/autotuning/constants.py' 2024-03-06T02:38:01,367 adding 'deepspeed/autotuning/scheduler.py' 2024-03-06T02:38:01,369 adding 'deepspeed/autotuning/utils.py' 2024-03-06T02:38:01,371 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2024-03-06T02:38:01,372 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2024-03-06T02:38:01,373 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2024-03-06T02:38:01,375 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2024-03-06T02:38:01,376 adding 'deepspeed/autotuning/tuner/__init__.py' 2024-03-06T02:38:01,377 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2024-03-06T02:38:01,379 adding 'deepspeed/autotuning/tuner/cost_model.py' 2024-03-06T02:38:01,380 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2024-03-06T02:38:01,381 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2024-03-06T02:38:01,383 adding 'deepspeed/autotuning/tuner/utils.py' 2024-03-06T02:38:01,384 adding 'deepspeed/checkpoint/__init__.py' 2024-03-06T02:38:01,386 adding 'deepspeed/checkpoint/constants.py' 2024-03-06T02:38:01,388 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2024-03-06T02:38:01,390 adding 'deepspeed/checkpoint/ds_to_universal.py' 2024-03-06T02:38:01,391 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2024-03-06T02:38:01,393 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2024-03-06T02:38:01,394 adding 'deepspeed/checkpoint/reshape_utils.py' 2024-03-06T02:38:01,396 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2024-03-06T02:38:01,397 adding 'deepspeed/checkpoint/utils.py' 2024-03-06T02:38:01,398 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2024-03-06T02:38:01,400 adding 'deepspeed/comm/__init__.py' 2024-03-06T02:38:01,401 adding 'deepspeed/comm/backend.py' 2024-03-06T02:38:01,403 adding 'deepspeed/comm/ccl.py' 2024-03-06T02:38:01,406 adding 'deepspeed/comm/comm.py' 2024-03-06T02:38:01,408 adding 'deepspeed/comm/config.py' 2024-03-06T02:38:01,409 adding 'deepspeed/comm/constants.py' 2024-03-06T02:38:01,410 adding 'deepspeed/comm/reduce_op.py' 2024-03-06T02:38:01,412 adding 'deepspeed/comm/torch.py' 2024-03-06T02:38:01,414 adding 'deepspeed/comm/utils.py' 2024-03-06T02:38:01,415 adding 'deepspeed/compression/__init__.py' 2024-03-06T02:38:01,419 adding 'deepspeed/compression/basic_layer.py' 2024-03-06T02:38:01,421 adding 'deepspeed/compression/compress.py' 2024-03-06T02:38:01,423 adding 'deepspeed/compression/config.py' 2024-03-06T02:38:01,424 adding 'deepspeed/compression/constants.py' 2024-03-06T02:38:01,426 adding 'deepspeed/compression/helper.py' 2024-03-06T02:38:01,428 adding 'deepspeed/compression/scheduler.py' 2024-03-06T02:38:01,429 adding 'deepspeed/compression/utils.py' 2024-03-06T02:38:01,431 adding 'deepspeed/elasticity/__init__.py' 2024-03-06T02:38:01,432 adding 'deepspeed/elasticity/config.py' 2024-03-06T02:38:01,434 adding 'deepspeed/elasticity/constants.py' 2024-03-06T02:38:01,435 adding 'deepspeed/elasticity/elastic_agent.py' 2024-03-06T02:38:01,438 adding 'deepspeed/elasticity/elasticity.py' 2024-03-06T02:38:01,439 adding 'deepspeed/elasticity/utils.py' 2024-03-06T02:38:01,441 adding 'deepspeed/inference/__init__.py' 2024-03-06T02:38:01,442 adding 'deepspeed/inference/config.py' 2024-03-06T02:38:01,446 adding 'deepspeed/inference/engine.py' 2024-03-06T02:38:01,448 adding 'deepspeed/inference/quantization/__init__.py' 2024-03-06T02:38:01,449 adding 'deepspeed/inference/quantization/layers.py' 2024-03-06T02:38:01,451 adding 'deepspeed/inference/quantization/quantization.py' 2024-03-06T02:38:01,452 adding 'deepspeed/inference/quantization/quantization_context.py' 2024-03-06T02:38:01,454 adding 'deepspeed/inference/quantization/utils.py' 2024-03-06T02:38:01,456 adding 'deepspeed/inference/v2/__init__.py' 2024-03-06T02:38:01,457 adding 'deepspeed/inference/v2/allocator.py' 2024-03-06T02:38:01,458 adding 'deepspeed/inference/v2/config_v2.py' 2024-03-06T02:38:01,459 adding 'deepspeed/inference/v2/engine_factory.py' 2024-03-06T02:38:01,461 adding 'deepspeed/inference/v2/engine_v2.py' 2024-03-06T02:38:01,463 adding 'deepspeed/inference/v2/inference_parameter.py' 2024-03-06T02:38:01,464 adding 'deepspeed/inference/v2/inference_utils.py' 2024-03-06T02:38:01,465 adding 'deepspeed/inference/v2/logging.py' 2024-03-06T02:38:01,467 adding 'deepspeed/inference/v2/scheduling_utils.py' 2024-03-06T02:38:01,468 adding 'deepspeed/inference/v2/checkpoint/__init__.py' 2024-03-06T02:38:01,470 adding 'deepspeed/inference/v2/checkpoint/base_engine.py' 2024-03-06T02:38:01,471 adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py' 2024-03-06T02:38:01,472 adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py' 2024-03-06T02:38:01,474 adding 'deepspeed/inference/v2/kernels/__init__.py' 2024-03-06T02:38:01,475 adding 'deepspeed/inference/v2/kernels/ds_kernel.py' 2024-03-06T02:38:01,476 adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py' 2024-03-06T02:38:01,477 adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp' 2024-03-06T02:38:01,479 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py' 2024-03-06T02:38:01,480 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp' 2024-03-06T02:38:01,481 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h' 2024-03-06T02:38:01,483 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py' 2024-03-06T02:38:01,484 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu' 2024-03-06T02:38:01,486 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py' 2024-03-06T02:38:01,487 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h' 2024-03-06T02:38:01,488 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py' 2024-03-06T02:38:01,490 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h' 2024-03-06T02:38:01,491 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py' 2024-03-06T02:38:01,493 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py' 2024-03-06T02:38:01,494 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py' 2024-03-06T02:38:01,495 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py' 2024-03-06T02:38:01,496 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py' 2024-03-06T02:38:01,498 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp' 2024-03-06T02:38:01,499 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h' 2024-03-06T02:38:01,501 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu' 2024-03-06T02:38:01,503 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py' 2024-03-06T02:38:01,504 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp' 2024-03-06T02:38:01,505 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h' 2024-03-06T02:38:01,506 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py' 2024-03-06T02:38:01,508 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py' 2024-03-06T02:38:01,509 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu' 2024-03-06T02:38:01,511 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py' 2024-03-06T02:38:01,512 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py' 2024-03-06T02:38:01,514 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py' 2024-03-06T02:38:01,515 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp' 2024-03-06T02:38:01,516 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h' 2024-03-06T02:38:01,518 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu' 2024-03-06T02:38:01,519 adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py' 2024-03-06T02:38:01,521 adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp' 2024-03-06T02:38:01,522 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py' 2024-03-06T02:38:01,524 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu' 2024-03-06T02:38:01,525 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h' 2024-03-06T02:38:01,526 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py' 2024-03-06T02:38:01,527 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h' 2024-03-06T02:38:01,529 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py' 2024-03-06T02:38:01,530 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py' 2024-03-06T02:38:01,531 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu' 2024-03-06T02:38:01,532 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h' 2024-03-06T02:38:01,534 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py' 2024-03-06T02:38:01,535 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h' 2024-03-06T02:38:01,536 adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h' 2024-03-06T02:38:01,538 adding 'deepspeed/inference/v2/kernels/includes/activation_type.h' 2024-03-06T02:38:01,540 adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h' 2024-03-06T02:38:01,541 adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h' 2024-03-06T02:38:01,543 adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h' 2024-03-06T02:38:01,546 adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h' 2024-03-06T02:38:01,548 adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py' 2024-03-06T02:38:01,549 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp' 2024-03-06T02:38:01,551 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py' 2024-03-06T02:38:01,552 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp' 2024-03-06T02:38:01,553 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h' 2024-03-06T02:38:01,554 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py' 2024-03-06T02:38:01,556 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py' 2024-03-06T02:38:01,557 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h' 2024-03-06T02:38:01,558 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp' 2024-03-06T02:38:01,559 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h' 2024-03-06T02:38:01,561 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py' 2024-03-06T02:38:01,562 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h' 2024-03-06T02:38:01,564 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py' 2024-03-06T02:38:01,565 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp' 2024-03-06T02:38:01,567 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh' 2024-03-06T02:38:01,568 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h' 2024-03-06T02:38:01,569 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py' 2024-03-06T02:38:01,571 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu' 2024-03-06T02:38:01,572 adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h' 2024-03-06T02:38:01,574 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py' 2024-03-06T02:38:01,575 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp' 2024-03-06T02:38:01,577 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh' 2024-03-06T02:38:01,578 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h' 2024-03-06T02:38:01,579 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py' 2024-03-06T02:38:01,581 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu' 2024-03-06T02:38:01,583 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py' 2024-03-06T02:38:01,584 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py' 2024-03-06T02:38:01,586 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py' 2024-03-06T02:38:01,587 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp' 2024-03-06T02:38:01,588 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh' 2024-03-06T02:38:01,589 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h' 2024-03-06T02:38:01,590 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py' 2024-03-06T02:38:01,591 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu' 2024-03-06T02:38:01,593 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py' 2024-03-06T02:38:01,594 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp' 2024-03-06T02:38:01,595 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh' 2024-03-06T02:38:01,597 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h' 2024-03-06T02:38:01,598 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py' 2024-03-06T02:38:01,599 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu' 2024-03-06T02:38:01,601 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py' 2024-03-06T02:38:01,602 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp' 2024-03-06T02:38:01,603 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh' 2024-03-06T02:38:01,605 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h' 2024-03-06T02:38:01,606 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py' 2024-03-06T02:38:01,607 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu' 2024-03-06T02:38:01,609 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h' 2024-03-06T02:38:01,610 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp' 2024-03-06T02:38:01,612 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h' 2024-03-06T02:38:01,613 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py' 2024-03-06T02:38:01,615 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp' 2024-03-06T02:38:01,616 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh' 2024-03-06T02:38:01,617 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h' 2024-03-06T02:38:01,618 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py' 2024-03-06T02:38:01,620 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu' 2024-03-06T02:38:01,622 adding 'deepspeed/inference/v2/model_implementations/__init__.py' 2024-03-06T02:38:01,623 adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py' 2024-03-06T02:38:01,625 adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py' 2024-03-06T02:38:01,627 adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py' 2024-03-06T02:38:01,629 adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py' 2024-03-06T02:38:01,632 adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py' 2024-03-06T02:38:01,633 adding 'deepspeed/inference/v2/model_implementations/parameter_base.py' 2024-03-06T02:38:01,635 adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py' 2024-03-06T02:38:01,636 adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py' 2024-03-06T02:38:01,638 adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py' 2024-03-06T02:38:01,639 adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py' 2024-03-06T02:38:01,640 adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py' 2024-03-06T02:38:01,641 adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py' 2024-03-06T02:38:01,643 adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py' 2024-03-06T02:38:01,644 adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py' 2024-03-06T02:38:01,645 adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py' 2024-03-06T02:38:01,647 adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py' 2024-03-06T02:38:01,648 adding 'deepspeed/inference/v2/model_implementations/falcon/container.py' 2024-03-06T02:38:01,649 adding 'deepspeed/inference/v2/model_implementations/falcon/model.py' 2024-03-06T02:38:01,651 adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py' 2024-03-06T02:38:01,652 adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py' 2024-03-06T02:38:01,654 adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py' 2024-03-06T02:38:01,655 adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py' 2024-03-06T02:38:01,656 adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py' 2024-03-06T02:38:01,658 adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py' 2024-03-06T02:38:01,659 adding 'deepspeed/inference/v2/model_implementations/mistral/container.py' 2024-03-06T02:38:01,661 adding 'deepspeed/inference/v2/model_implementations/mistral/model.py' 2024-03-06T02:38:01,662 adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py' 2024-03-06T02:38:01,664 adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py' 2024-03-06T02:38:01,665 adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py' 2024-03-06T02:38:01,667 adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py' 2024-03-06T02:38:01,668 adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py' 2024-03-06T02:38:01,669 adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py' 2024-03-06T02:38:01,671 adding 'deepspeed/inference/v2/model_implementations/opt/container.py' 2024-03-06T02:38:01,672 adding 'deepspeed/inference/v2/model_implementations/opt/model.py' 2024-03-06T02:38:01,673 adding 'deepspeed/inference/v2/model_implementations/opt/policy.py' 2024-03-06T02:38:01,675 adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py' 2024-03-06T02:38:01,677 adding 'deepspeed/inference/v2/model_implementations/phi/containers.py' 2024-03-06T02:38:01,678 adding 'deepspeed/inference/v2/model_implementations/phi/model.py' 2024-03-06T02:38:01,679 adding 'deepspeed/inference/v2/model_implementations/phi/policy.py' 2024-03-06T02:38:01,681 adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py' 2024-03-06T02:38:01,683 adding 'deepspeed/inference/v2/model_implementations/qwen/container.py' 2024-03-06T02:38:01,684 adding 'deepspeed/inference/v2/model_implementations/qwen/model.py' 2024-03-06T02:38:01,686 adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py' 2024-03-06T02:38:01,687 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py' 2024-03-06T02:38:01,689 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py' 2024-03-06T02:38:01,690 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py' 2024-03-06T02:38:01,692 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py' 2024-03-06T02:38:01,693 adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py' 2024-03-06T02:38:01,695 adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py' 2024-03-06T02:38:01,696 adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py' 2024-03-06T02:38:01,697 adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py' 2024-03-06T02:38:01,698 adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py' 2024-03-06T02:38:01,700 adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py' 2024-03-06T02:38:01,701 adding 'deepspeed/inference/v2/model_implementations/sharding/types.py' 2024-03-06T02:38:01,702 adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py' 2024-03-06T02:38:01,703 adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py' 2024-03-06T02:38:01,705 adding 'deepspeed/inference/v2/modules/__init__.py' 2024-03-06T02:38:01,706 adding 'deepspeed/inference/v2/modules/ds_module.py' 2024-03-06T02:38:01,707 adding 'deepspeed/inference/v2/modules/heuristics.py' 2024-03-06T02:38:01,709 adding 'deepspeed/inference/v2/modules/module_registry.py' 2024-03-06T02:38:01,710 adding 'deepspeed/inference/v2/modules/configs/__init__.py' 2024-03-06T02:38:01,712 adding 'deepspeed/inference/v2/modules/configs/attention_configs.py' 2024-03-06T02:38:01,713 adding 'deepspeed/inference/v2/modules/configs/embedding_config.py' 2024-03-06T02:38:01,714 adding 'deepspeed/inference/v2/modules/configs/linear_config.py' 2024-03-06T02:38:01,715 adding 'deepspeed/inference/v2/modules/configs/moe_config.py' 2024-03-06T02:38:01,716 adding 'deepspeed/inference/v2/modules/configs/norm_config.py' 2024-03-06T02:38:01,717 adding 'deepspeed/inference/v2/modules/configs/unembed_config.py' 2024-03-06T02:38:01,719 adding 'deepspeed/inference/v2/modules/implementations/__init__.py' 2024-03-06T02:38:01,721 adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py' 2024-03-06T02:38:01,722 adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py' 2024-03-06T02:38:01,724 adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py' 2024-03-06T02:38:01,725 adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py' 2024-03-06T02:38:01,727 adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py' 2024-03-06T02:38:01,728 adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py' 2024-03-06T02:38:01,730 adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py' 2024-03-06T02:38:01,732 adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py' 2024-03-06T02:38:01,733 adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py' 2024-03-06T02:38:01,734 adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py' 2024-03-06T02:38:01,736 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py' 2024-03-06T02:38:01,737 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py' 2024-03-06T02:38:01,739 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py' 2024-03-06T02:38:01,740 adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py' 2024-03-06T02:38:01,742 adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py' 2024-03-06T02:38:01,744 adding 'deepspeed/inference/v2/modules/interfaces/__init__.py' 2024-03-06T02:38:01,745 adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py' 2024-03-06T02:38:01,746 adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py' 2024-03-06T02:38:01,748 adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py' 2024-03-06T02:38:01,749 adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py' 2024-03-06T02:38:01,750 adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py' 2024-03-06T02:38:01,752 adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py' 2024-03-06T02:38:01,753 adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py' 2024-03-06T02:38:01,755 adding 'deepspeed/inference/v2/ragged/__init__.py' 2024-03-06T02:38:01,756 adding 'deepspeed/inference/v2/ragged/blocked_allocator.py' 2024-03-06T02:38:01,758 adding 'deepspeed/inference/v2/ragged/kv_cache.py' 2024-03-06T02:38:01,759 adding 'deepspeed/inference/v2/ragged/manager_configs.py' 2024-03-06T02:38:01,761 adding 'deepspeed/inference/v2/ragged/ragged_manager.py' 2024-03-06T02:38:01,763 adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py' 2024-03-06T02:38:01,764 adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py' 2024-03-06T02:38:01,766 adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu' 2024-03-06T02:38:01,767 adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp' 2024-03-06T02:38:01,769 adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h' 2024-03-06T02:38:01,770 adding 'deepspeed/launcher/__init__.py' 2024-03-06T02:38:01,771 adding 'deepspeed/launcher/constants.py' 2024-03-06T02:38:01,773 adding 'deepspeed/launcher/launch.py' 2024-03-06T02:38:01,775 adding 'deepspeed/launcher/launcher_helper.py' 2024-03-06T02:38:01,777 adding 'deepspeed/launcher/multinode_runner.py' 2024-03-06T02:38:01,780 adding 'deepspeed/launcher/runner.py' 2024-03-06T02:38:01,782 adding 'deepspeed/model_implementations/__init__.py' 2024-03-06T02:38:01,783 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2024-03-06T02:38:01,784 adding 'deepspeed/model_implementations/diffusers/unet.py' 2024-03-06T02:38:01,786 adding 'deepspeed/model_implementations/diffusers/vae.py' 2024-03-06T02:38:01,787 adding 'deepspeed/model_implementations/features/__init__.py' 2024-03-06T02:38:01,788 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2024-03-06T02:38:01,790 adding 'deepspeed/model_implementations/transformers/__init__.py' 2024-03-06T02:38:01,792 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2024-03-06T02:38:01,793 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2024-03-06T02:38:01,794 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2024-03-06T02:38:01,795 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2024-03-06T02:38:01,796 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2024-03-06T02:38:01,797 adding 'deepspeed/model_implementations/transformers/ds_llama2.py' 2024-03-06T02:38:01,799 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2024-03-06T02:38:01,800 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2024-03-06T02:38:01,801 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2024-03-06T02:38:01,803 adding 'deepspeed/module_inject/__init__.py' 2024-03-06T02:38:01,806 adding 'deepspeed/module_inject/auto_tp.py' 2024-03-06T02:38:01,808 adding 'deepspeed/module_inject/auto_tp_model_utils.py' 2024-03-06T02:38:01,809 adding 'deepspeed/module_inject/fusedqkv_utils.py' 2024-03-06T02:38:01,811 adding 'deepspeed/module_inject/inject.py' 2024-03-06T02:38:01,812 adding 'deepspeed/module_inject/layers.py' 2024-03-06T02:38:01,814 adding 'deepspeed/module_inject/load_checkpoint.py' 2024-03-06T02:38:01,815 adding 'deepspeed/module_inject/module_quantize.py' 2024-03-06T02:38:01,817 adding 'deepspeed/module_inject/policy.py' 2024-03-06T02:38:01,820 adding 'deepspeed/module_inject/replace_module.py' 2024-03-06T02:38:01,822 adding 'deepspeed/module_inject/replace_policy.py' 2024-03-06T02:38:01,823 adding 'deepspeed/module_inject/tp_shard.py' 2024-03-06T02:38:01,824 adding 'deepspeed/module_inject/utils.py' 2024-03-06T02:38:01,826 adding 'deepspeed/module_inject/containers/__init__.py' 2024-03-06T02:38:01,828 adding 'deepspeed/module_inject/containers/base.py' 2024-03-06T02:38:01,829 adding 'deepspeed/module_inject/containers/base_moe.py' 2024-03-06T02:38:01,831 adding 'deepspeed/module_inject/containers/bert.py' 2024-03-06T02:38:01,832 adding 'deepspeed/module_inject/containers/bloom.py' 2024-03-06T02:38:01,834 adding 'deepspeed/module_inject/containers/clip.py' 2024-03-06T02:38:01,835 adding 'deepspeed/module_inject/containers/distil_bert.py' 2024-03-06T02:38:01,836 adding 'deepspeed/module_inject/containers/gpt2.py' 2024-03-06T02:38:01,837 adding 'deepspeed/module_inject/containers/gptj.py' 2024-03-06T02:38:01,839 adding 'deepspeed/module_inject/containers/gptneo.py' 2024-03-06T02:38:01,840 adding 'deepspeed/module_inject/containers/gptneox.py' 2024-03-06T02:38:01,842 adding 'deepspeed/module_inject/containers/internlm.py' 2024-03-06T02:38:01,843 adding 'deepspeed/module_inject/containers/llama.py' 2024-03-06T02:38:01,844 adding 'deepspeed/module_inject/containers/llama2.py' 2024-03-06T02:38:01,846 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2024-03-06T02:38:01,847 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2024-03-06T02:38:01,849 adding 'deepspeed/module_inject/containers/opt.py' 2024-03-06T02:38:01,850 adding 'deepspeed/module_inject/containers/unet.py' 2024-03-06T02:38:01,851 adding 'deepspeed/module_inject/containers/vae.py' 2024-03-06T02:38:01,853 adding 'deepspeed/module_inject/containers/features/__init__.py' 2024-03-06T02:38:01,854 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2024-03-06T02:38:01,856 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2024-03-06T02:38:01,857 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2024-03-06T02:38:01,858 adding 'deepspeed/module_inject/containers/features/megatron.py' 2024-03-06T02:38:01,860 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2024-03-06T02:38:01,861 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2024-03-06T02:38:01,863 adding 'deepspeed/moe/__init__.py' 2024-03-06T02:38:01,864 adding 'deepspeed/moe/experts.py' 2024-03-06T02:38:01,866 adding 'deepspeed/moe/layer.py' 2024-03-06T02:38:01,867 adding 'deepspeed/moe/mappings.py' 2024-03-06T02:38:01,870 adding 'deepspeed/moe/sharded_moe.py' 2024-03-06T02:38:01,872 adding 'deepspeed/moe/utils.py' 2024-03-06T02:38:01,874 adding 'deepspeed/monitor/__init__.py' 2024-03-06T02:38:01,875 adding 'deepspeed/monitor/config.py' 2024-03-06T02:38:01,876 adding 'deepspeed/monitor/csv_monitor.py' 2024-03-06T02:38:01,877 adding 'deepspeed/monitor/monitor.py' 2024-03-06T02:38:01,879 adding 'deepspeed/monitor/tensorboard.py' 2024-03-06T02:38:01,880 adding 'deepspeed/monitor/utils.py' 2024-03-06T02:38:01,881 adding 'deepspeed/monitor/wandb.py' 2024-03-06T02:38:01,883 adding 'deepspeed/nebula/__init__.py' 2024-03-06T02:38:01,884 adding 'deepspeed/nebula/config.py' 2024-03-06T02:38:01,885 adding 'deepspeed/nebula/constants.py' 2024-03-06T02:38:01,887 adding 'deepspeed/ops/__init__.py' 2024-03-06T02:38:01,889 adding 'deepspeed/ops/adagrad/__init__.py' 2024-03-06T02:38:01,890 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2024-03-06T02:38:01,892 adding 'deepspeed/ops/adam/__init__.py' 2024-03-06T02:38:01,894 adding 'deepspeed/ops/adam/cpu_adam.py' 2024-03-06T02:38:01,895 adding 'deepspeed/ops/adam/fused_adam.py' 2024-03-06T02:38:01,897 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2024-03-06T02:38:01,898 adding 'deepspeed/ops/aio/__init__.py' 2024-03-06T02:38:01,901 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2024-03-06T02:38:01,903 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2024-03-06T02:38:01,905 adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp' 2024-03-06T02:38:01,906 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2024-03-06T02:38:01,908 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2024-03-06T02:38:01,909 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2024-03-06T02:38:01,913 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2024-03-06T02:38:01,915 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2024-03-06T02:38:01,916 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2024-03-06T02:38:01,917 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2024-03-06T02:38:01,919 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2024-03-06T02:38:01,920 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2024-03-06T02:38:01,922 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2024-03-06T02:38:01,923 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2024-03-06T02:38:01,924 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2024-03-06T02:38:01,925 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2024-03-06T02:38:01,926 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2024-03-06T02:38:01,927 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2024-03-06T02:38:01,929 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2024-03-06T02:38:01,930 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2024-03-06T02:38:01,931 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2024-03-06T02:38:01,933 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2024-03-06T02:38:01,934 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2024-03-06T02:38:01,935 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2024-03-06T02:38:01,937 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2024-03-06T02:38:01,939 adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp' 2024-03-06T02:38:01,942 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2024-03-06T02:38:01,944 adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp' 2024-03-06T02:38:01,947 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp' 2024-03-06T02:38:01,948 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu' 2024-03-06T02:38:01,950 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu' 2024-03-06T02:38:01,952 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h' 2024-03-06T02:38:01,961 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h' 2024-03-06T02:38:01,966 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h' 2024-03-06T02:38:01,968 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h' 2024-03-06T02:38:01,971 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h' 2024-03-06T02:38:01,972 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h' 2024-03-06T02:38:01,974 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h' 2024-03-06T02:38:01,976 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h' 2024-03-06T02:38:01,978 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h' 2024-03-06T02:38:01,981 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h' 2024-03-06T02:38:01,983 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h' 2024-03-06T02:38:01,985 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h' 2024-03-06T02:38:01,987 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h' 2024-03-06T02:38:01,994 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h' 2024-03-06T02:38:01,998 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h' 2024-03-06T02:38:01,999 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h' 2024-03-06T02:38:02,003 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h' 2024-03-06T02:38:02,007 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h' 2024-03-06T02:38:02,011 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h' 2024-03-06T02:38:02,013 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h' 2024-03-06T02:38:02,014 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h' 2024-03-06T02:38:02,016 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h' 2024-03-06T02:38:02,018 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h' 2024-03-06T02:38:02,020 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2024-03-06T02:38:02,021 adding 'deepspeed/ops/csrc/includes/Timer.h' 2024-03-06T02:38:02,022 adding 'deepspeed/ops/csrc/includes/activation_type.h' 2024-03-06T02:38:02,023 adding 'deepspeed/ops/csrc/includes/compat.h' 2024-03-06T02:38:02,025 adding 'deepspeed/ops/csrc/includes/context.h' 2024-03-06T02:38:02,026 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2024-03-06T02:38:02,028 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2024-03-06T02:38:02,029 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2024-03-06T02:38:02,031 adding 'deepspeed/ops/csrc/includes/cpu_lion.h' 2024-03-06T02:38:02,033 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2024-03-06T02:38:02,034 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2024-03-06T02:38:02,036 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2024-03-06T02:38:02,037 adding 'deepspeed/ops/csrc/includes/dropout.h' 2024-03-06T02:38:02,038 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2024-03-06T02:38:02,040 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2024-03-06T02:38:02,041 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2024-03-06T02:38:02,042 adding 'deepspeed/ops/csrc/includes/gelu.h' 2024-03-06T02:38:02,044 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2024-03-06T02:38:02,045 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2024-03-06T02:38:02,047 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2024-03-06T02:38:02,049 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2024-03-06T02:38:02,050 adding 'deepspeed/ops/csrc/includes/quantization.h' 2024-03-06T02:38:02,052 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2024-03-06T02:38:02,053 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2024-03-06T02:38:02,056 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2024-03-06T02:38:02,057 adding 'deepspeed/ops/csrc/includes/simd.h' 2024-03-06T02:38:02,059 adding 'deepspeed/ops/csrc/includes/softmax.h' 2024-03-06T02:38:02,060 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2024-03-06T02:38:02,062 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2024-03-06T02:38:02,063 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2024-03-06T02:38:02,066 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2024-03-06T02:38:02,067 adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp' 2024-03-06T02:38:02,069 adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp' 2024-03-06T02:38:02,070 adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp' 2024-03-06T02:38:02,072 adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh' 2024-03-06T02:38:02,073 adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu' 2024-03-06T02:38:02,075 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2024-03-06T02:38:02,078 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2024-03-06T02:38:02,079 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2024-03-06T02:38:02,081 adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu' 2024-03-06T02:38:02,083 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2024-03-06T02:38:02,084 adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu' 2024-03-06T02:38:02,086 adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu' 2024-03-06T02:38:02,088 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2024-03-06T02:38:02,089 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2024-03-06T02:38:02,091 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2024-03-06T02:38:02,092 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2024-03-06T02:38:02,094 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2024-03-06T02:38:02,096 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2024-03-06T02:38:02,098 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2024-03-06T02:38:02,099 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2024-03-06T02:38:02,101 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2024-03-06T02:38:02,104 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2024-03-06T02:38:02,108 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2024-03-06T02:38:02,109 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2024-03-06T02:38:02,111 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2024-03-06T02:38:02,115 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2024-03-06T02:38:02,118 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2024-03-06T02:38:02,121 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2024-03-06T02:38:02,123 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2024-03-06T02:38:02,125 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2024-03-06T02:38:02,127 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2024-03-06T02:38:02,130 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2024-03-06T02:38:02,131 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2024-03-06T02:38:02,136 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2024-03-06T02:38:02,138 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2024-03-06T02:38:02,140 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2024-03-06T02:38:02,142 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2024-03-06T02:38:02,145 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2024-03-06T02:38:02,148 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2024-03-06T02:38:02,149 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2024-03-06T02:38:02,151 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2024-03-06T02:38:02,154 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2024-03-06T02:38:02,158 adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp' 2024-03-06T02:38:02,161 adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp' 2024-03-06T02:38:02,163 adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp' 2024-03-06T02:38:02,165 adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp' 2024-03-06T02:38:02,167 adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp' 2024-03-06T02:38:02,170 adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp' 2024-03-06T02:38:02,173 adding 'deepspeed/ops/csrc/xpu/includes/compat.h' 2024-03-06T02:38:02,175 adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h' 2024-03-06T02:38:02,177 adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h' 2024-03-06T02:38:02,179 adding 'deepspeed/ops/csrc/xpu/includes/simd.h' 2024-03-06T02:38:02,180 adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h' 2024-03-06T02:38:02,182 adding 'deepspeed/ops/deepspeed4science/__init__.py' 2024-03-06T02:38:02,183 adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py' 2024-03-06T02:38:02,185 adding 'deepspeed/ops/lamb/__init__.py' 2024-03-06T02:38:02,186 adding 'deepspeed/ops/lamb/fused_lamb.py' 2024-03-06T02:38:02,188 adding 'deepspeed/ops/lion/__init__.py' 2024-03-06T02:38:02,190 adding 'deepspeed/ops/lion/cpu_lion.py' 2024-03-06T02:38:02,191 adding 'deepspeed/ops/lion/fused_lion.py' 2024-03-06T02:38:02,192 adding 'deepspeed/ops/lion/multi_tensor_apply.py' 2024-03-06T02:38:02,195 adding 'deepspeed/ops/op_builder/__init__.py' 2024-03-06T02:38:02,196 adding 'deepspeed/ops/op_builder/all_ops.py' 2024-03-06T02:38:02,197 adding 'deepspeed/ops/op_builder/async_io.py' 2024-03-06T02:38:02,201 adding 'deepspeed/ops/op_builder/builder.py' 2024-03-06T02:38:02,202 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2024-03-06T02:38:02,203 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2024-03-06T02:38:02,204 adding 'deepspeed/ops/op_builder/cpu_lion.py' 2024-03-06T02:38:02,206 adding 'deepspeed/ops/op_builder/evoformer_attn.py' 2024-03-06T02:38:02,207 adding 'deepspeed/ops/op_builder/fused_adam.py' 2024-03-06T02:38:02,208 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2024-03-06T02:38:02,209 adding 'deepspeed/ops/op_builder/fused_lion.py' 2024-03-06T02:38:02,210 adding 'deepspeed/ops/op_builder/inference_core_ops.py' 2024-03-06T02:38:02,212 adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py' 2024-03-06T02:38:02,213 adding 'deepspeed/ops/op_builder/quantizer.py' 2024-03-06T02:38:02,214 adding 'deepspeed/ops/op_builder/ragged_ops.py' 2024-03-06T02:38:02,215 adding 'deepspeed/ops/op_builder/ragged_utils.py' 2024-03-06T02:38:02,216 adding 'deepspeed/ops/op_builder/random_ltd.py' 2024-03-06T02:38:02,218 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2024-03-06T02:38:02,219 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2024-03-06T02:38:02,220 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2024-03-06T02:38:02,221 adding 'deepspeed/ops/op_builder/transformer.py' 2024-03-06T02:38:02,223 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2024-03-06T02:38:02,224 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2024-03-06T02:38:02,226 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2024-03-06T02:38:02,227 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2024-03-06T02:38:02,228 adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py' 2024-03-06T02:38:02,229 adding 'deepspeed/ops/op_builder/cpu/fused_adam.py' 2024-03-06T02:38:02,230 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2024-03-06T02:38:02,232 adding 'deepspeed/ops/op_builder/hpu/__init__.py' 2024-03-06T02:38:02,233 adding 'deepspeed/ops/op_builder/hpu/builder.py' 2024-03-06T02:38:02,235 adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py' 2024-03-06T02:38:02,236 adding 'deepspeed/ops/op_builder/hpu/fused_adam.py' 2024-03-06T02:38:02,237 adding 'deepspeed/ops/op_builder/hpu/no_impl.py' 2024-03-06T02:38:02,239 adding 'deepspeed/ops/op_builder/npu/__init__.py' 2024-03-06T02:38:02,240 adding 'deepspeed/ops/op_builder/npu/async_io.py' 2024-03-06T02:38:02,242 adding 'deepspeed/ops/op_builder/npu/builder.py' 2024-03-06T02:38:02,243 adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py' 2024-03-06T02:38:02,244 adding 'deepspeed/ops/op_builder/npu/cpu_adam.py' 2024-03-06T02:38:02,245 adding 'deepspeed/ops/op_builder/npu/cpu_lion.py' 2024-03-06T02:38:02,246 adding 'deepspeed/ops/op_builder/npu/fused_adam.py' 2024-03-06T02:38:02,248 adding 'deepspeed/ops/op_builder/npu/inference.py' 2024-03-06T02:38:02,250 adding 'deepspeed/ops/op_builder/npu/no_impl.py' 2024-03-06T02:38:02,251 adding 'deepspeed/ops/op_builder/xpu/__init__.py' 2024-03-06T02:38:02,253 adding 'deepspeed/ops/op_builder/xpu/async_io.py' 2024-03-06T02:38:02,254 adding 'deepspeed/ops/op_builder/xpu/builder.py' 2024-03-06T02:38:02,256 adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py' 2024-03-06T02:38:02,257 adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py' 2024-03-06T02:38:02,258 adding 'deepspeed/ops/op_builder/xpu/fused_adam.py' 2024-03-06T02:38:02,260 adding 'deepspeed/ops/quantizer/__init__.py' 2024-03-06T02:38:02,261 adding 'deepspeed/ops/quantizer/quantizer.py' 2024-03-06T02:38:02,262 adding 'deepspeed/ops/random_ltd/__init__.py' 2024-03-06T02:38:02,264 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2024-03-06T02:38:02,265 adding 'deepspeed/ops/sparse_attention/__init__.py' 2024-03-06T02:38:02,267 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2024-03-06T02:38:02,271 adding 'deepspeed/ops/sparse_attention/matmul.py' 2024-03-06T02:38:02,273 adding 'deepspeed/ops/sparse_attention/softmax.py' 2024-03-06T02:38:02,275 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2024-03-06T02:38:02,276 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2024-03-06T02:38:02,280 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2024-03-06T02:38:02,281 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2024-03-06T02:38:02,283 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2024-03-06T02:38:02,284 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2024-03-06T02:38:02,285 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2024-03-06T02:38:02,287 adding 'deepspeed/ops/transformer/__init__.py' 2024-03-06T02:38:02,289 adding 'deepspeed/ops/transformer/transformer.py' 2024-03-06T02:38:02,291 adding 'deepspeed/ops/transformer/inference/__init__.py' 2024-03-06T02:38:02,292 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2024-03-06T02:38:02,294 adding 'deepspeed/ops/transformer/inference/config.py' 2024-03-06T02:38:02,295 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2024-03-06T02:38:02,297 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2024-03-06T02:38:02,298 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2024-03-06T02:38:02,300 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2024-03-06T02:38:02,302 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2024-03-06T02:38:02,304 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2024-03-06T02:38:02,305 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2024-03-06T02:38:02,307 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2024-03-06T02:38:02,308 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2024-03-06T02:38:02,310 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2024-03-06T02:38:02,311 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2024-03-06T02:38:02,312 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2024-03-06T02:38:02,314 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2024-03-06T02:38:02,315 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2024-03-06T02:38:02,316 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2024-03-06T02:38:02,317 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2024-03-06T02:38:02,319 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2024-03-06T02:38:02,321 adding 'deepspeed/ops/transformer/inference/triton/__init__.py' 2024-03-06T02:38:02,323 adding 'deepspeed/ops/transformer/inference/triton/attention.py' 2024-03-06T02:38:02,324 adding 'deepspeed/ops/transformer/inference/triton/gelu.py' 2024-03-06T02:38:02,326 adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py' 2024-03-06T02:38:02,327 adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py' 2024-03-06T02:38:02,329 adding 'deepspeed/ops/transformer/inference/triton/mlp.py' 2024-03-06T02:38:02,330 adding 'deepspeed/ops/transformer/inference/triton/ops.py' 2024-03-06T02:38:02,332 adding 'deepspeed/ops/transformer/inference/triton/residual_add.py' 2024-03-06T02:38:02,333 adding 'deepspeed/ops/transformer/inference/triton/softmax.py' 2024-03-06T02:38:02,335 adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py' 2024-03-06T02:38:02,337 adding 'deepspeed/pipe/__init__.py' 2024-03-06T02:38:02,338 adding 'deepspeed/profiling/__init__.py' 2024-03-06T02:38:02,340 adding 'deepspeed/profiling/config.py' 2024-03-06T02:38:02,341 adding 'deepspeed/profiling/constants.py' 2024-03-06T02:38:02,343 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2024-03-06T02:38:02,348 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2024-03-06T02:38:02,350 adding 'deepspeed/runtime/__init__.py' 2024-03-06T02:38:02,353 adding 'deepspeed/runtime/bf16_optimizer.py' 2024-03-06T02:38:02,355 adding 'deepspeed/runtime/compiler.py' 2024-03-06T02:38:02,359 adding 'deepspeed/runtime/config.py' 2024-03-06T02:38:02,361 adding 'deepspeed/runtime/config_utils.py' 2024-03-06T02:38:02,363 adding 'deepspeed/runtime/constants.py' 2024-03-06T02:38:02,364 adding 'deepspeed/runtime/dataloader.py' 2024-03-06T02:38:02,365 adding 'deepspeed/runtime/eigenvalue.py' 2024-03-06T02:38:02,383 adding 'deepspeed/runtime/engine.py' 2024-03-06T02:38:02,387 adding 'deepspeed/runtime/hybrid_engine.py' 2024-03-06T02:38:02,390 adding 'deepspeed/runtime/lr_schedules.py' 2024-03-06T02:38:02,392 adding 'deepspeed/runtime/progressive_layer_drop.py' 2024-03-06T02:38:02,393 adding 'deepspeed/runtime/quantize.py' 2024-03-06T02:38:02,394 adding 'deepspeed/runtime/sparse_tensor.py' 2024-03-06T02:38:02,397 adding 'deepspeed/runtime/state_dict_factory.py' 2024-03-06T02:38:02,401 adding 'deepspeed/runtime/utils.py' 2024-03-06T02:38:02,403 adding 'deepspeed/runtime/weight_quantizer.py' 2024-03-06T02:38:02,405 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2024-03-06T02:38:02,410 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2024-03-06T02:38:02,411 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2024-03-06T02:38:02,413 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2024-03-06T02:38:02,414 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2024-03-06T02:38:02,415 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2024-03-06T02:38:02,416 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2024-03-06T02:38:02,418 adding 'deepspeed/runtime/comm/__init__.py' 2024-03-06T02:38:02,420 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2024-03-06T02:38:02,421 adding 'deepspeed/runtime/comm/hccl.py' 2024-03-06T02:38:02,423 adding 'deepspeed/runtime/comm/mpi.py' 2024-03-06T02:38:02,424 adding 'deepspeed/runtime/comm/nccl.py' 2024-03-06T02:38:02,426 adding 'deepspeed/runtime/compression/__init__.py' 2024-03-06T02:38:02,427 adding 'deepspeed/runtime/compression/cupy.py' 2024-03-06T02:38:02,429 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2024-03-06T02:38:02,430 adding 'deepspeed/runtime/data_pipeline/config.py' 2024-03-06T02:38:02,432 adding 'deepspeed/runtime/data_pipeline/constants.py' 2024-03-06T02:38:02,433 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2024-03-06T02:38:02,435 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2024-03-06T02:38:02,436 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2024-03-06T02:38:02,438 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2024-03-06T02:38:02,439 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2024-03-06T02:38:02,440 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2024-03-06T02:38:02,442 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2024-03-06T02:38:02,447 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2024-03-06T02:38:02,450 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2024-03-06T02:38:02,452 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2024-03-06T02:38:02,454 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2024-03-06T02:38:02,456 adding 'deepspeed/runtime/fp16/__init__.py' 2024-03-06T02:38:02,458 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2024-03-06T02:38:02,460 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2024-03-06T02:38:02,463 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2024-03-06T02:38:02,465 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2024-03-06T02:38:02,467 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2024-03-06T02:38:02,470 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2024-03-06T02:38:02,473 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2024-03-06T02:38:02,474 adding 'deepspeed/runtime/pipe/__init__.py' 2024-03-06T02:38:02,481 adding 'deepspeed/runtime/pipe/engine.py' 2024-03-06T02:38:02,484 adding 'deepspeed/runtime/pipe/module.py' 2024-03-06T02:38:02,486 adding 'deepspeed/runtime/pipe/p2p.py' 2024-03-06T02:38:02,488 adding 'deepspeed/runtime/pipe/schedule.py' 2024-03-06T02:38:02,491 adding 'deepspeed/runtime/pipe/topology.py' 2024-03-06T02:38:02,493 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2024-03-06T02:38:02,494 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2024-03-06T02:38:02,495 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2024-03-06T02:38:02,496 adding 'deepspeed/runtime/swap_tensor/constants.py' 2024-03-06T02:38:02,499 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2024-03-06T02:38:02,501 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2024-03-06T02:38:02,503 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2024-03-06T02:38:02,505 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2024-03-06T02:38:02,506 adding 'deepspeed/runtime/swap_tensor/utils.py' 2024-03-06T02:38:02,508 adding 'deepspeed/runtime/zero/__init__.py' 2024-03-06T02:38:02,510 adding 'deepspeed/runtime/zero/config.py' 2024-03-06T02:38:02,513 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2024-03-06T02:38:02,514 adding 'deepspeed/runtime/zero/linear.py' 2024-03-06T02:38:02,517 adding 'deepspeed/runtime/zero/mics.py' 2024-03-06T02:38:02,519 adding 'deepspeed/runtime/zero/mics_utils.py' 2024-03-06T02:38:02,520 adding 'deepspeed/runtime/zero/offload_config.py' 2024-03-06T02:38:02,523 adding 'deepspeed/runtime/zero/parameter_offload.py' 2024-03-06T02:38:02,534 adding 'deepspeed/runtime/zero/partition_parameters.py' 2024-03-06T02:38:02,539 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2024-03-06T02:38:02,573 adding 'deepspeed/runtime/zero/partitioned_param_profiler.py' 2024-03-06T02:38:02,588 adding 'deepspeed/runtime/zero/stage3.py' 2024-03-06T02:38:02,602 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2024-03-06T02:38:02,604 adding 'deepspeed/runtime/zero/test.py' 2024-03-06T02:38:02,605 adding 'deepspeed/runtime/zero/tiling.py' 2024-03-06T02:38:02,607 adding 'deepspeed/runtime/zero/utils.py' 2024-03-06T02:38:02,609 adding 'deepspeed/sequence/__init__.py' 2024-03-06T02:38:02,610 adding 'deepspeed/sequence/layer.py' 2024-03-06T02:38:02,612 adding 'deepspeed/utils/__init__.py' 2024-03-06T02:38:02,614 adding 'deepspeed/utils/comms_logging.py' 2024-03-06T02:38:02,616 adding 'deepspeed/utils/debug.py' 2024-03-06T02:38:02,617 adding 'deepspeed/utils/exceptions.py' 2024-03-06T02:38:02,619 adding 'deepspeed/utils/groups.py' 2024-03-06T02:38:02,621 adding 'deepspeed/utils/init_on_device.py' 2024-03-06T02:38:02,622 adding 'deepspeed/utils/logging.py' 2024-03-06T02:38:02,623 adding 'deepspeed/utils/mixed_precision_linkage.py' 2024-03-06T02:38:02,625 adding 'deepspeed/utils/numa.py' 2024-03-06T02:38:02,626 adding 'deepspeed/utils/nvtx.py' 2024-03-06T02:38:02,628 adding 'deepspeed/utils/tensor_fragment.py' 2024-03-06T02:38:02,630 adding 'deepspeed/utils/timer.py' 2024-03-06T02:38:02,631 adding 'deepspeed/utils/types.py' 2024-03-06T02:38:02,632 adding 'deepspeed/utils/z3_leaf_module.py' 2024-03-06T02:38:02,635 adding 'deepspeed/utils/zero_to_fp32.py' 2024-03-06T02:38:02,637 adding 'deepspeed-0.13.5.data/scripts/deepspeed' 2024-03-06T02:38:02,639 adding 'deepspeed-0.13.5.data/scripts/deepspeed.pt' 2024-03-06T02:38:02,640 adding 'deepspeed-0.13.5.data/scripts/ds' 2024-03-06T02:38:02,641 adding 'deepspeed-0.13.5.data/scripts/ds_bench' 2024-03-06T02:38:02,642 adding 'deepspeed-0.13.5.data/scripts/ds_elastic' 2024-03-06T02:38:02,644 adding 'deepspeed-0.13.5.data/scripts/ds_report' 2024-03-06T02:38:02,645 adding 'deepspeed-0.13.5.data/scripts/ds_ssh' 2024-03-06T02:38:02,646 adding 'deepspeed-0.13.5.data/scripts/dsr' 2024-03-06T02:38:02,651 adding 'deepspeed-0.13.5.dist-info/METADATA' 2024-03-06T02:38:02,653 adding 'deepspeed-0.13.5.dist-info/WHEEL' 2024-03-06T02:38:02,653 adding 'deepspeed-0.13.5.dist-info/entry_points.txt' 2024-03-06T02:38:02,654 adding 'deepspeed-0.13.5.dist-info/top_level.txt' 2024-03-06T02:38:02,667 adding 'deepspeed-0.13.5.dist-info/RECORD' 2024-03-06T02:38:02,690 removing build/bdist.linux-armv7l/wheel 2024-03-06T02:38:02,884 deepspeed build time = 10.836087942123413 secs 2024-03-06T02:38:03,004 Building wheel for deepspeed (setup.py): finished with status 'done' 2024-03-06T02:38:03,020 Created wheel for deepspeed: filename=deepspeed-0.13.5-py3-none-any.whl size=1370541 sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b 2024-03-06T02:38:03,022 Stored in directory: /tmp/pip-ephem-wheel-cache-y23rkroo/wheels/48/4e/9f/13d0ec800c9bfce8fb58965b0ec580274306a6c0d702fca344 2024-03-06T02:38:03,059 Successfully built deepspeed 2024-03-06T02:38:03,101 Removed build tracker: '/tmp/pip-build-tracker-7jp05urq'