2023-11-04T04:51:49,337 Created temporary directory: /tmp/pip-build-tracker-r11la7ev 2023-11-04T04:51:49,338 Initialized build tracking at /tmp/pip-build-tracker-r11la7ev 2023-11-04T04:51:49,338 Created build tracker: /tmp/pip-build-tracker-r11la7ev 2023-11-04T04:51:49,339 Entered build tracker: /tmp/pip-build-tracker-r11la7ev 2023-11-04T04:51:49,340 Created temporary directory: /tmp/pip-wheel-pa50jm9j 2023-11-04T04:51:49,342 Created temporary directory: /tmp/pip-ephem-wheel-cache-_hrhc0na 2023-11-04T04:51:49,366 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-11-04T04:51:49,370 2 location(s) to search for versions of deepspeed: 2023-11-04T04:51:49,370 * https://pypi.org/simple/deepspeed/ 2023-11-04T04:51:49,370 * https://www.piwheels.org/simple/deepspeed/ 2023-11-04T04:51:49,371 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2023-11-04T04:51:49,372 Getting page https://pypi.org/simple/deepspeed/ 2023-11-04T04:51:49,373 Found index url https://pypi.org/simple/ 2023-11-04T04:51:49,593 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2023-11-04T04:51:49,608 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-11-04T04:51:49,609 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2023-11-04T04:51:49,609 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-11-04T04:51:49,610 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2023-11-04T04:51:49,611 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-11-04T04:51:49,612 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2023-11-04T04:51:49,612 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-11-04T04:51:49,613 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2023-11-04T04:51:49,614 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-11-04T04:51:49,615 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2023-11-04T04:51:49,615 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2023-11-04T04:51:49,616 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2023-11-04T04:51:49,617 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2023-11-04T04:51:49,618 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2023-11-04T04:51:49,619 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2023-11-04T04:51:49,619 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2023-11-04T04:51:49,620 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2023-11-04T04:51:49,620 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2023-11-04T04:51:49,621 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2023-11-04T04:51:49,621 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2023-11-04T04:51:49,622 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2023-11-04T04:51:49,623 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2023-11-04T04:51:49,623 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2023-11-04T04:51:49,624 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2023-11-04T04:51:49,625 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2023-11-04T04:51:49,626 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2023-11-04T04:51:49,626 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2023-11-04T04:51:49,627 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2023-11-04T04:51:49,628 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2023-11-04T04:51:49,628 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2023-11-04T04:51:49,629 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2023-11-04T04:51:49,630 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2023-11-04T04:51:49,631 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2023-11-04T04:51:49,631 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2023-11-04T04:51:49,632 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2023-11-04T04:51:49,632 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2023-11-04T04:51:49,633 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2023-11-04T04:51:49,634 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2023-11-04T04:51:49,634 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2023-11-04T04:51:49,635 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2023-11-04T04:51:49,636 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2023-11-04T04:51:49,636 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2023-11-04T04:51:49,637 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2023-11-04T04:51:49,638 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2023-11-04T04:51:49,639 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2023-11-04T04:51:49,639 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2023-11-04T04:51:49,640 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2023-11-04T04:51:49,641 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2023-11-04T04:51:49,641 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2023-11-04T04:51:49,642 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2023-11-04T04:51:49,643 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2023-11-04T04:51:49,644 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2023-11-04T04:51:49,644 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2023-11-04T04:51:49,645 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2023-11-04T04:51:49,645 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2023-11-04T04:51:49,646 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2023-11-04T04:51:49,647 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2023-11-04T04:51:49,647 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2023-11-04T04:51:49,648 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2023-11-04T04:51:49,649 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2023-11-04T04:51:49,649 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2023-11-04T04:51:49,650 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2023-11-04T04:51:49,651 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2023-11-04T04:51:49,651 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2023-11-04T04:51:49,652 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2023-11-04T04:51:49,653 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2023-11-04T04:51:49,654 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2023-11-04T04:51:49,654 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2023-11-04T04:51:49,655 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2023-11-04T04:51:49,656 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2023-11-04T04:51:49,656 Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5 2023-11-04T04:51:49,657 Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0 2023-11-04T04:51:49,657 Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1 2023-11-04T04:51:49,658 Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2 2023-11-04T04:51:49,659 Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3 2023-11-04T04:51:49,659 Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0 2023-11-04T04:51:49,660 Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1 2023-11-04T04:51:49,660 Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2 2023-11-04T04:51:49,667 Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0 2023-11-04T04:51:49,668 Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1 2023-11-04T04:51:49,669 Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2 2023-11-04T04:51:49,669 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2023-11-04T04:51:49,670 Getting page https://www.piwheels.org/simple/deepspeed/ 2023-11-04T04:51:49,672 Found index url https://www.piwheels.org/simple/ 2023-11-04T04:51:49,840 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2023-11-04T04:51:49,853 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,854 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,855 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,856 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,856 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,857 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,857 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,858 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,858 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,859 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,859 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,860 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,861 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,861 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,862 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,862 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,863 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,863 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,864 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,865 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,865 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,866 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,866 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,866 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,867 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,868 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,868 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,869 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,869 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,870 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,871 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,871 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,872 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,872 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,873 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,873 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,874 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,874 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,875 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,875 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,876 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,876 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,877 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,877 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,878 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,879 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,879 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,880 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,880 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,881 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:51:49,881 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2023-11-04T04:51:49,882 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2023-11-04T04:51:49,910 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2023-11-04T04:51:49,930 Collecting deepspeed==0.12.1 2023-11-04T04:51:49,932 Created temporary directory: /tmp/pip-unpack-9f5w49z_ 2023-11-04T04:51:50,152 Downloading deepspeed-0.12.1.tar.gz (1.2 MB) 2023-11-04T04:51:52,154 Added deepspeed==0.12.1 from https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz to build tracker '/tmp/pip-build-tracker-r11la7ev' 2023-11-04T04:51:52,155 Running setup.py (path:/tmp/pip-wheel-pa50jm9j/deepspeed_7399b2fe6a534a418d49e75ec84f7936/setup.py) egg_info for package deepspeed 2023-11-04T04:51:52,156 Created temporary directory: /tmp/pip-pip-egg-info-kwjf3fu8 2023-11-04T04:51:52,157 Preparing metadata (setup.py): started 2023-11-04T04:51:52,158 Running command python setup.py egg_info 2023-11-04T04:51:53,001 fatal: not a git repository (or any of the parent directories): .git 2023-11-04T04:51:53,642 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-11-04T04:51:53,643  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-11-04T04:51:53,643 DS_BUILD_OPS=0 2023-11-04T04:51:53,644  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-11-04T04:51:53,644  [WARNING]  async_io: please install the libaio-dev package with apt 2023-11-04T04:51:53,645  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-11-04T04:51:53,645  [WARNING]  Please install torch if trying to pre-compile kernels 2023-11-04T04:51:53,646  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:51:53,647  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:51:53,648  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:51:53,649  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:51:53,649  [WARNING]  unable to import torch, please install it first 2023-11-04T04:51:53,650  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:51:53,650  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:51:53,651 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-11-04T04:51:53,652 version=0.12.1, git_hash=unknown, git_branch=unknown 2023-11-04T04:51:53,653 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm'] 2023-11-04T04:51:53,653 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False} 2023-11-04T04:51:53,653 ext_modules=[] 2023-11-04T04:51:53,654 running egg_info 2023-11-04T04:51:53,654 creating /tmp/pip-pip-egg-info-kwjf3fu8/deepspeed.egg-info 2023-11-04T04:51:53,675 writing /tmp/pip-pip-egg-info-kwjf3fu8/deepspeed.egg-info/PKG-INFO 2023-11-04T04:51:53,706 writing dependency_links to /tmp/pip-pip-egg-info-kwjf3fu8/deepspeed.egg-info/dependency_links.txt 2023-11-04T04:51:53,708 writing entry points to /tmp/pip-pip-egg-info-kwjf3fu8/deepspeed.egg-info/entry_points.txt 2023-11-04T04:51:53,723 writing requirements to /tmp/pip-pip-egg-info-kwjf3fu8/deepspeed.egg-info/requires.txt 2023-11-04T04:51:53,725 writing top-level names to /tmp/pip-pip-egg-info-kwjf3fu8/deepspeed.egg-info/top_level.txt 2023-11-04T04:51:53,727 writing manifest file '/tmp/pip-pip-egg-info-kwjf3fu8/deepspeed.egg-info/SOURCES.txt' 2023-11-04T04:51:53,883 reading manifest file '/tmp/pip-pip-egg-info-kwjf3fu8/deepspeed.egg-info/SOURCES.txt' 2023-11-04T04:51:53,885 reading manifest template 'MANIFEST.in' 2023-11-04T04:51:53,888 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2023-11-04T04:51:53,889 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2023-11-04T04:51:54,864 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-11-04T04:51:55,646 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-11-04T04:51:56,096 warning: no files found matching '*.tr' under directory 'csrc' 2023-11-04T04:51:56,196 warning: no files found matching '*.cc' under directory 'csrc' 2023-11-04T04:51:56,221 warning: no files found matching '*.py' under directory 'benchmarks' 2023-11-04T04:51:56,254 writing manifest file '/tmp/pip-pip-egg-info-kwjf3fu8/deepspeed.egg-info/SOURCES.txt' 2023-11-04T04:51:56,257 deepspeed build time = 3.2525296211242676 secs 2023-11-04T04:51:56,370 Preparing metadata (setup.py): finished with status 'done' 2023-11-04T04:51:56,376 Source in /tmp/pip-wheel-pa50jm9j/deepspeed_7399b2fe6a534a418d49e75ec84f7936 has version 0.12.1, which satisfies requirement deepspeed==0.12.1 from https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz 2023-11-04T04:51:56,377 Removed deepspeed==0.12.1 from https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz from build tracker '/tmp/pip-build-tracker-r11la7ev' 2023-11-04T04:51:56,385 Created temporary directory: /tmp/pip-unpack-qparu5_x 2023-11-04T04:51:56,386 Created temporary directory: /tmp/pip-unpack-haguu449 2023-11-04T04:51:56,624 Building wheels for collected packages: deepspeed 2023-11-04T04:51:56,629 Created temporary directory: /tmp/pip-wheel-knxzdfpz 2023-11-04T04:51:56,629 Building wheel for deepspeed (setup.py): started 2023-11-04T04:51:56,631 Destination directory: /tmp/pip-wheel-knxzdfpz 2023-11-04T04:51:56,631 Running command python setup.py bdist_wheel 2023-11-04T04:51:57,054 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-11-04T04:51:57,061  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-11-04T04:51:57,116 DS_BUILD_OPS=0 2023-11-04T04:51:57,227  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-11-04T04:51:57,284  [WARNING]  async_io: please install the libaio-dev package with apt 2023-11-04T04:51:57,285  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-11-04T04:51:57,285  [WARNING]  Please install torch if trying to pre-compile kernels 2023-11-04T04:51:57,286  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:51:57,286  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:51:57,287  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:51:57,288  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:51:57,288  [WARNING]  unable to import torch, please install it first 2023-11-04T04:51:57,289  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:51:57,290  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:51:57,290 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-11-04T04:51:57,299 fatal: not a git repository (or any of the parent directories): .git 2023-11-04T04:51:57,301 version=0.12.1, git_hash=unknown, git_branch=unknown 2023-11-04T04:51:57,302 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm'] 2023-11-04T04:51:57,303 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False} 2023-11-04T04:51:57,303 ext_modules=[] 2023-11-04T04:51:57,911 running bdist_wheel 2023-11-04T04:51:58,023 running build 2023-11-04T04:51:58,023 running build_py 2023-11-04T04:51:58,050 creating build 2023-11-04T04:51:58,051 creating build/lib 2023-11-04T04:51:58,051 creating build/lib/deepspeed 2023-11-04T04:51:58,053 copying deepspeed/pydantic_v1.py -> build/lib/deepspeed 2023-11-04T04:51:58,055 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2023-11-04T04:51:58,056 copying deepspeed/__init__.py -> build/lib/deepspeed 2023-11-04T04:51:58,059 copying deepspeed/env_report.py -> build/lib/deepspeed 2023-11-04T04:51:58,061 copying deepspeed/constants.py -> build/lib/deepspeed 2023-11-04T04:51:58,062 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2023-11-04T04:51:58,064 creating build/lib/deepspeed/comm 2023-11-04T04:51:58,065 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2023-11-04T04:51:58,067 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2023-11-04T04:51:58,069 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2023-11-04T04:51:58,072 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2023-11-04T04:51:58,074 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2023-11-04T04:51:58,075 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2023-11-04T04:51:58,077 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2023-11-04T04:51:58,089 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2023-11-04T04:51:58,091 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2023-11-04T04:51:58,093 creating build/lib/deepspeed/utils 2023-11-04T04:51:58,093 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2023-11-04T04:51:58,095 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2023-11-04T04:51:58,097 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2023-11-04T04:51:58,099 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2023-11-04T04:51:58,101 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2023-11-04T04:51:58,102 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2023-11-04T04:51:58,104 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2023-11-04T04:51:58,105 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2023-11-04T04:51:58,107 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2023-11-04T04:51:58,109 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2023-11-04T04:51:58,111 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2023-11-04T04:51:58,113 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2023-11-04T04:51:58,115 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2023-11-04T04:51:58,118 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2023-11-04T04:51:58,120 creating build/lib/deepspeed/sequence 2023-11-04T04:51:58,121 copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence 2023-11-04T04:51:58,123 copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence 2023-11-04T04:51:58,125 creating build/lib/deepspeed/module_inject 2023-11-04T04:51:58,126 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2023-11-04T04:51:58,128 copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject 2023-11-04T04:51:58,130 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2023-11-04T04:51:58,132 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2023-11-04T04:51:58,133 copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject 2023-11-04T04:51:58,135 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2023-11-04T04:51:58,138 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2023-11-04T04:51:58,140 copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject 2023-11-04T04:51:58,141 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2023-11-04T04:51:58,143 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2023-11-04T04:51:58,145 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2023-11-04T04:51:58,147 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2023-11-04T04:51:58,149 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2023-11-04T04:51:58,153 creating build/lib/deepspeed/autotuning 2023-11-04T04:51:58,153 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2023-11-04T04:51:58,155 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2023-11-04T04:51:58,158 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2023-11-04T04:51:58,160 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2023-11-04T04:51:58,163 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2023-11-04T04:51:58,165 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2023-11-04T04:51:58,167 creating build/lib/deepspeed/pipe 2023-11-04T04:51:58,168 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2023-11-04T04:51:58,170 creating build/lib/deepspeed/moe 2023-11-04T04:51:58,171 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2023-11-04T04:51:58,173 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2023-11-04T04:51:58,174 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2023-11-04T04:51:58,177 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2023-11-04T04:51:58,178 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2023-11-04T04:51:58,191 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2023-11-04T04:51:58,193 creating build/lib/deepspeed/launcher 2023-11-04T04:51:58,193 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2023-11-04T04:51:58,196 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2023-11-04T04:51:58,198 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2023-11-04T04:51:58,200 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2023-11-04T04:51:58,202 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2023-11-04T04:51:58,204 creating build/lib/deepspeed/accelerator 2023-11-04T04:51:58,205 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-04T04:51:58,207 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2023-11-04T04:51:58,209 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-04T04:51:58,212 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-04T04:51:58,221 copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-04T04:51:58,224 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-04T04:51:58,226 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-04T04:51:58,228 creating build/lib/deepspeed/nebula 2023-11-04T04:51:58,229 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2023-11-04T04:51:58,231 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2023-11-04T04:51:58,233 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2023-11-04T04:51:58,234 creating build/lib/deepspeed/ops 2023-11-04T04:51:58,235 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2023-11-04T04:51:58,238 creating build/lib/deepspeed/checkpoint 2023-11-04T04:51:58,239 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:51:58,241 copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:51:58,243 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:51:58,245 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:51:58,247 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:51:58,249 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:51:58,251 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:51:58,253 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:51:58,255 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:51:58,257 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:51:58,259 creating build/lib/deepspeed/monitor 2023-11-04T04:51:58,260 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2023-11-04T04:51:58,262 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2023-11-04T04:51:58,263 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2023-11-04T04:51:58,265 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2023-11-04T04:51:58,267 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2023-11-04T04:51:58,268 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2023-11-04T04:51:58,269 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2023-11-04T04:51:58,271 creating build/lib/deepspeed/elasticity 2023-11-04T04:51:58,272 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2023-11-04T04:51:58,274 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2023-11-04T04:51:58,276 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2023-11-04T04:51:58,277 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2023-11-04T04:51:58,279 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2023-11-04T04:51:58,281 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2023-11-04T04:51:58,283 creating build/lib/deepspeed/compression 2023-11-04T04:51:58,284 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2023-11-04T04:51:58,287 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2023-11-04T04:51:58,288 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2023-11-04T04:51:58,290 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2023-11-04T04:51:58,292 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2023-11-04T04:51:58,294 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2023-11-04T04:51:58,296 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2023-11-04T04:51:58,298 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2023-11-04T04:51:58,301 creating build/lib/deepspeed/runtime 2023-11-04T04:51:58,302 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2023-11-04T04:51:58,305 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2023-11-04T04:51:58,307 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2023-11-04T04:51:58,309 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2023-11-04T04:51:58,311 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2023-11-04T04:51:58,313 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2023-11-04T04:51:58,316 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2023-11-04T04:51:58,317 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2023-11-04T04:51:58,320 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2023-11-04T04:51:58,322 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2023-11-04T04:51:58,324 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2023-11-04T04:51:58,326 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2023-11-04T04:51:58,332 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2023-11-04T04:51:58,334 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2023-11-04T04:51:58,336 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2023-11-04T04:51:58,339 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2023-11-04T04:51:58,341 creating build/lib/deepspeed/model_implementations 2023-11-04T04:51:58,342 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2023-11-04T04:51:58,344 creating build/lib/deepspeed/inference 2023-11-04T04:51:58,345 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2023-11-04T04:51:58,347 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2023-11-04T04:51:58,350 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2023-11-04T04:51:58,352 creating build/lib/deepspeed/profiling 2023-11-04T04:51:58,353 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2023-11-04T04:51:58,355 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2023-11-04T04:51:58,356 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2023-11-04T04:51:58,358 creating build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,359 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,361 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,363 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,365 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,367 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,368 copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,370 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,372 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,374 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,375 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,377 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,379 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,380 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,382 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,384 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,386 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,388 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,390 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,392 copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:51:58,394 creating build/lib/deepspeed/module_inject/containers/features 2023-11-04T04:51:58,395 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-04T04:51:58,398 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-04T04:51:58,399 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-04T04:51:58,401 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-04T04:51:58,403 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-04T04:51:58,405 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-04T04:51:58,407 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-04T04:51:58,410 creating build/lib/deepspeed/autotuning/tuner 2023-11-04T04:51:58,411 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2023-11-04T04:51:58,413 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2023-11-04T04:51:58,415 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-11-04T04:51:58,417 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2023-11-04T04:51:58,419 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-11-04T04:51:58,420 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-11-04T04:51:58,423 creating build/lib/deepspeed/ops/adagrad 2023-11-04T04:51:58,424 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2023-11-04T04:51:58,426 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2023-11-04T04:51:58,429 creating build/lib/deepspeed/ops/adam 2023-11-04T04:51:58,430 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2023-11-04T04:51:58,433 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2023-11-04T04:51:58,435 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2023-11-04T04:51:58,436 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2023-11-04T04:51:58,439 creating build/lib/deepspeed/ops/lion 2023-11-04T04:51:58,441 copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion 2023-11-04T04:51:58,443 copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion 2023-11-04T04:51:58,445 copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion 2023-11-04T04:51:58,470 copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion 2023-11-04T04:51:58,473 creating build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,474 copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,476 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,478 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,480 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,482 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,484 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,486 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,488 copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,490 copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,492 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,494 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,496 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,498 copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,500 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,502 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,504 copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,506 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,508 copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,510 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,512 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,515 copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,517 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:51:58,519 creating build/lib/deepspeed/ops/random_ltd 2023-11-04T04:51:58,520 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2023-11-04T04:51:58,522 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2023-11-04T04:51:58,525 creating build/lib/deepspeed/ops/deepspeed4science 2023-11-04T04:51:58,526 copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science 2023-11-04T04:51:58,528 copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science 2023-11-04T04:51:58,531 creating build/lib/deepspeed/ops/transformer 2023-11-04T04:51:58,532 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2023-11-04T04:51:58,534 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2023-11-04T04:51:58,537 creating build/lib/deepspeed/ops/quantizer 2023-11-04T04:51:58,538 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2023-11-04T04:51:58,540 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2023-11-04T04:51:58,542 creating build/lib/deepspeed/ops/sparse_attention 2023-11-04T04:51:58,543 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-04T04:51:58,545 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-04T04:51:58,547 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-04T04:51:58,550 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-04T04:51:58,553 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-04T04:51:58,555 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-04T04:51:58,558 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-04T04:51:58,561 creating build/lib/deepspeed/ops/aio 2023-11-04T04:51:58,562 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2023-11-04T04:51:58,565 creating build/lib/deepspeed/ops/lamb 2023-11-04T04:51:58,566 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2023-11-04T04:51:58,568 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2023-11-04T04:51:58,571 creating build/lib/deepspeed/ops/op_builder/cpu 2023-11-04T04:51:58,572 copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-04T04:51:58,574 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-04T04:51:58,576 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-04T04:51:58,578 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-04T04:51:58,580 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-04T04:51:58,582 copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-04T04:51:58,584 creating build/lib/deepspeed/ops/op_builder/npu 2023-11-04T04:51:58,586 copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu 2023-11-04T04:51:58,588 copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu 2023-11-04T04:51:58,590 copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu 2023-11-04T04:51:58,592 copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2023-11-04T04:51:58,595 creating build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:51:58,596 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:51:58,599 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:51:58,600 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:51:58,603 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:51:58,605 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:51:58,607 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:51:58,610 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:51:58,612 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:51:58,615 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:51:58,617 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:51:58,620 creating build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:51:58,621 copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:51:58,624 copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:51:58,626 copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:51:58,628 copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:51:58,631 copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:51:58,633 copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:51:58,635 copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:51:58,637 copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:51:58,640 copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:51:58,643 copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:51:58,645 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:51:58,647 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:51:58,649 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:51:58,651 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:51:58,653 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:51:58,655 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:51:58,657 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:51:58,659 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:51:58,661 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:51:58,662 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:51:58,664 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:51:58,666 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:51:58,667 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:51:58,669 creating build/lib/deepspeed/runtime/checkpoint_engine 2023-11-04T04:51:58,670 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-11-04T04:51:58,672 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-11-04T04:51:58,673 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-11-04T04:51:58,675 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-11-04T04:51:58,677 creating build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:51:58,678 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:51:58,680 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:51:58,682 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:51:58,684 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:51:58,685 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:51:58,687 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:51:58,690 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:51:58,691 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:51:58,694 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:51:58,697 creating build/lib/deepspeed/runtime/comm 2023-11-04T04:51:58,698 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2023-11-04T04:51:58,700 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2023-11-04T04:51:58,703 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2023-11-04T04:51:58,704 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2023-11-04T04:51:58,707 creating build/lib/deepspeed/runtime/pipe 2023-11-04T04:51:58,709 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2023-11-04T04:51:58,711 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2023-11-04T04:51:58,713 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2023-11-04T04:51:58,716 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2023-11-04T04:51:58,719 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2023-11-04T04:51:58,722 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2023-11-04T04:51:58,725 creating build/lib/deepspeed/runtime/activation_checkpointing 2023-11-04T04:51:58,726 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-11-04T04:51:58,728 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-11-04T04:51:58,731 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-11-04T04:51:58,734 creating build/lib/deepspeed/runtime/zero 2023-11-04T04:51:58,735 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:51:58,739 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:51:58,743 copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:51:58,745 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:51:58,746 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:51:58,748 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:51:58,751 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:51:58,753 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:51:58,755 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:51:58,757 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:51:58,760 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:51:58,762 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:51:58,764 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:51:58,767 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:51:58,768 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:51:58,771 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:51:58,773 creating build/lib/deepspeed/runtime/compression 2023-11-04T04:51:58,774 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2023-11-04T04:51:58,776 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2023-11-04T04:51:58,778 creating build/lib/deepspeed/runtime/fp16 2023-11-04T04:51:58,779 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2023-11-04T04:51:58,781 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2023-11-04T04:51:58,782 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-11-04T04:51:58,785 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-11-04T04:51:58,787 creating build/lib/deepspeed/runtime/data_pipeline 2023-11-04T04:51:58,788 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2023-11-04T04:51:58,791 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2023-11-04T04:51:58,792 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2023-11-04T04:51:58,794 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2023-11-04T04:51:58,796 creating build/lib/deepspeed/runtime/fp16/onebit 2023-11-04T04:51:58,797 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-11-04T04:51:58,800 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-11-04T04:51:58,802 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-11-04T04:51:58,804 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-11-04T04:51:58,807 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:51:58,808 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:51:58,810 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:51:58,812 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:51:58,815 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:51:58,817 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:51:58,820 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:51:58,821 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:51:58,823 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:51:58,825 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:51:58,827 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:51:58,830 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:51:58,833 creating build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:51:58,834 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:51:58,836 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:51:58,838 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:51:58,840 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:51:58,842 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:51:58,844 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:51:58,846 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:51:58,849 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:51:58,851 copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:51:58,854 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:51:58,857 creating build/lib/deepspeed/model_implementations/diffusers 2023-11-04T04:51:58,858 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2023-11-04T04:51:58,860 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2023-11-04T04:51:58,862 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2023-11-04T04:51:58,866 creating build/lib/deepspeed/model_implementations/features 2023-11-04T04:51:58,867 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2023-11-04T04:51:58,869 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2023-11-04T04:51:58,872 creating build/lib/deepspeed/inference/quantization 2023-11-04T04:51:58,873 copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization 2023-11-04T04:51:58,875 copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization 2023-11-04T04:51:58,880 copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization 2023-11-04T04:51:58,882 copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization 2023-11-04T04:51:58,885 copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization 2023-11-04T04:51:58,888 creating build/lib/deepspeed/inference/v2 2023-11-04T04:51:58,889 copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2 2023-11-04T04:51:58,891 copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2 2023-11-04T04:51:58,894 copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2 2023-11-04T04:51:58,896 copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2 2023-11-04T04:51:58,898 copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2 2023-11-04T04:51:58,900 copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2 2023-11-04T04:51:58,902 copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2 2023-11-04T04:51:58,905 copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2 2023-11-04T04:51:58,908 creating build/lib/deepspeed/inference/v2/modules 2023-11-04T04:51:58,909 copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules 2023-11-04T04:51:58,911 copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules 2023-11-04T04:51:58,914 copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules 2023-11-04T04:51:58,916 copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules 2023-11-04T04:51:58,919 creating build/lib/deepspeed/inference/v2/ragged 2023-11-04T04:51:58,920 copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-04T04:51:58,923 copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-04T04:51:58,925 copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-04T04:51:58,927 copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-04T04:51:58,930 copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-04T04:51:58,932 copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-04T04:51:58,934 copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-04T04:51:58,937 creating build/lib/deepspeed/inference/v2/kernels 2023-11-04T04:51:58,938 copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels 2023-11-04T04:51:58,940 copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels 2023-11-04T04:51:58,942 creating build/lib/deepspeed/inference/v2/checkpoint 2023-11-04T04:51:58,943 copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-11-04T04:51:58,945 copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-11-04T04:51:58,947 copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-11-04T04:51:58,949 copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-11-04T04:51:58,953 creating build/lib/deepspeed/inference/v2/model_implementations 2023-11-04T04:51:58,953 copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-04T04:51:58,956 copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-04T04:51:58,957 copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-04T04:51:58,960 copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-04T04:51:58,962 copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-04T04:51:58,964 copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-04T04:51:58,967 creating build/lib/deepspeed/inference/v2/modules/configs 2023-11-04T04:51:58,968 copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-04T04:51:58,970 copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-04T04:51:58,972 copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-04T04:51:58,973 copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-04T04:51:58,975 copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-04T04:51:58,977 copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-04T04:51:58,979 copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-04T04:51:58,981 creating build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:51:58,982 copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:51:58,984 copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:51:58,986 copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:51:58,987 copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:51:58,989 copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:51:58,991 copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:51:58,993 copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:51:58,995 copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:51:58,997 creating build/lib/deepspeed/inference/v2/modules/implementations 2023-11-04T04:51:58,998 copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations 2023-11-04T04:51:59,000 creating build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-11-04T04:51:59,002 copying deepspeed/inference/v2/modules/implementations/linear/cutlass_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-11-04T04:51:59,004 copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-11-04T04:51:59,005 copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-11-04T04:51:59,008 creating build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:51:59,009 copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:51:59,011 copying deepspeed/inference/v2/modules/implementations/moe/test.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:51:59,013 copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:51:59,015 copying deepspeed/inference/v2/modules/implementations/moe/gate_fn.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:51:59,017 creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-04T04:51:59,018 copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-04T04:51:59,020 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-04T04:51:59,021 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-04T04:51:59,024 creating build/lib/deepspeed/inference/v2/modules/implementations/attention 2023-11-04T04:51:59,024 copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2023-11-04T04:51:59,026 copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2023-11-04T04:51:59,029 creating build/lib/deepspeed/inference/v2/modules/implementations/unembed 2023-11-04T04:51:59,030 copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2023-11-04T04:51:59,032 copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2023-11-04T04:51:59,034 creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-04T04:51:59,035 copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-04T04:51:59,037 copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-04T04:51:59,039 creating build/lib/deepspeed/inference/v2/modules/implementations/embedding 2023-11-04T04:51:59,040 copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2023-11-04T04:51:59,042 copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2023-11-04T04:51:59,044 creating build/lib/deepspeed/inference/v2/kernels/core_ops 2023-11-04T04:51:59,045 copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops 2023-11-04T04:51:59,047 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops 2023-11-04T04:51:59,048 copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2023-11-04T04:51:59,051 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-04T04:51:59,052 copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-04T04:51:59,054 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:51:59,055 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:51:59,057 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:51:59,058 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:51:59,060 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:51:59,062 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:51:59,063 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:51:59,065 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:51:59,067 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:51:59,068 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:51:59,070 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:51:59,072 creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:51:59,073 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:51:59,075 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:51:59,077 creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:51:59,078 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:51:59,080 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:51:59,082 creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:51:59,083 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:51:59,085 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:51:59,087 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:51:59,088 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:51:59,090 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:51:59,092 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:51:59,093 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:51:59,095 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:51:59,098 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:51:59,099 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:51:59,100 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:51:59,102 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:51:59,103 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:51:59,105 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:51:59,107 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:51:59,108 copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:51:59,110 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:51:59,112 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:51:59,113 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:51:59,115 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:51:59,116 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:51:59,118 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:51:59,121 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:51:59,121 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:51:59,123 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:51:59,125 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:51:59,126 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:51:59,128 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:51:59,130 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:51:59,131 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:51:59,133 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:51:59,136 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:51:59,136 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:51:59,139 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:51:59,140 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:51:59,143 creating build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:51:59,144 copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:51:59,146 copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:51:59,148 copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:51:59,149 copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:51:59,152 creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:51:59,152 copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:51:59,154 copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:51:59,156 copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:51:59,158 copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:51:59,160 creating build/lib/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:51:59,161 copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:51:59,163 copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:51:59,165 copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:51:59,167 copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:51:59,170 creating build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:51:59,171 copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:51:59,172 copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:51:59,174 copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:51:59,176 copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:51:59,178 copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:51:59,180 copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:51:59,182 copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:51:59,184 copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:51:59,186 copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:51:59,189 creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:51:59,190 copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:51:59,192 copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:51:59,194 copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:51:59,196 copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:51:59,197 copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:51:59,199 copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:51:59,200 copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:51:59,202 copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:51:59,204 copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:51:59,206 creating build/lib/deepspeed/profiling/flops_profiler 2023-11-04T04:51:59,207 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2023-11-04T04:51:59,209 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2023-11-04T04:51:59,212 running egg_info 2023-11-04T04:51:59,262 writing deepspeed.egg-info/PKG-INFO 2023-11-04T04:51:59,293 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2023-11-04T04:51:59,295 writing entry points to deepspeed.egg-info/entry_points.txt 2023-11-04T04:51:59,310 writing requirements to deepspeed.egg-info/requires.txt 2023-11-04T04:51:59,311 writing top-level names to deepspeed.egg-info/top_level.txt 2023-11-04T04:51:59,387 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-11-04T04:51:59,434 reading manifest template 'MANIFEST.in' 2023-11-04T04:51:59,435 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2023-11-04T04:51:59,436 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2023-11-04T04:52:00,427 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-11-04T04:52:01,165 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-11-04T04:52:01,621 warning: no files found matching '*.tr' under directory 'csrc' 2023-11-04T04:52:01,732 warning: no files found matching '*.cc' under directory 'csrc' 2023-11-04T04:52:01,754 warning: no files found matching '*.py' under directory 'benchmarks' 2023-11-04T04:52:01,797 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-11-04T04:52:01,805 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2023-11-04T04:52:01,805 !! 2023-11-04T04:52:01,806 ******************************************************************************** 2023-11-04T04:52:01,807 ############################ 2023-11-04T04:52:01,807 # Package would be ignored # 2023-11-04T04:52:01,808 ############################ 2023-11-04T04:52:01,809 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2023-11-04T04:52:01,809 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:01,810 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:01,811 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2023-11-04T04:52:01,811 to the `packages` configuration field. 2023-11-04T04:52:01,812 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:01,812 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:01,813 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:01,813 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:01,815 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:01,815 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2023-11-04T04:52:01,816 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2023-11-04T04:52:01,816 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:01,817 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:01,817 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:01,818 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:01,819 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:01,820 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:01,821 even if it does not contain any `.py` files. 2023-11-04T04:52:01,821 On the other hand, currently there is no concept of package data 2023-11-04T04:52:01,822 directory, all directories are treated like packages. 2023-11-04T04:52:01,822 ******************************************************************************** 2023-11-04T04:52:01,823 !! 2023-11-04T04:52:01,824 check.warn(importable) 2023-11-04T04:52:01,824 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration. 2023-11-04T04:52:01,825 !! 2023-11-04T04:52:01,826 ******************************************************************************** 2023-11-04T04:52:01,826 ############################ 2023-11-04T04:52:01,827 # Package would be ignored # 2023-11-04T04:52:01,827 ############################ 2023-11-04T04:52:01,828 Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1], 2023-11-04T04:52:01,829 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:01,830 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:01,830 package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added 2023-11-04T04:52:01,831 to the `packages` configuration field. 2023-11-04T04:52:01,832 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:01,832 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:01,833 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:01,834 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:01,835 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:01,837 If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are 2023-11-04T04:52:01,837 already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via 2023-11-04T04:52:01,838 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:01,838 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:01,839 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:01,840 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:01,840 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:01,841 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:01,842 even if it does not contain any `.py` files. 2023-11-04T04:52:01,842 On the other hand, currently there is no concept of package data 2023-11-04T04:52:01,842 directory, all directories are treated like packages. 2023-11-04T04:52:01,843 ******************************************************************************** 2023-11-04T04:52:01,843 !! 2023-11-04T04:52:01,844 check.warn(importable) 2023-11-04T04:52:01,844 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration. 2023-11-04T04:52:01,844 !! 2023-11-04T04:52:01,845 ******************************************************************************** 2023-11-04T04:52:01,846 ############################ 2023-11-04T04:52:01,846 # Package would be ignored # 2023-11-04T04:52:01,846 ############################ 2023-11-04T04:52:01,847 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1], 2023-11-04T04:52:01,847 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:01,848 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:01,849 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added 2023-11-04T04:52:01,849 to the `packages` configuration field. 2023-11-04T04:52:01,850 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:01,850 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:01,851 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:01,852 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:01,853 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:01,854 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are 2023-11-04T04:52:01,854 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via 2023-11-04T04:52:01,855 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:01,855 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:01,855 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:01,856 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:01,857 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:01,859 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:01,859 even if it does not contain any `.py` files. 2023-11-04T04:52:01,859 On the other hand, currently there is no concept of package data 2023-11-04T04:52:01,860 directory, all directories are treated like packages. 2023-11-04T04:52:01,860 ******************************************************************************** 2023-11-04T04:52:01,862 !! 2023-11-04T04:52:01,862 check.warn(importable) 2023-11-04T04:52:01,862 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration. 2023-11-04T04:52:01,863 !! 2023-11-04T04:52:01,863 ******************************************************************************** 2023-11-04T04:52:01,864 ############################ 2023-11-04T04:52:01,864 # Package would be ignored # 2023-11-04T04:52:01,864 ############################ 2023-11-04T04:52:01,865 Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1], 2023-11-04T04:52:01,865 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:01,866 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:01,866 package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added 2023-11-04T04:52:01,866 to the `packages` configuration field. 2023-11-04T04:52:01,867 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:01,867 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:01,868 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:01,868 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:01,869 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:01,870 If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are 2023-11-04T04:52:01,870 already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via 2023-11-04T04:52:01,871 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:01,871 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:01,872 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:01,872 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:01,873 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:01,874 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:01,875 even if it does not contain any `.py` files. 2023-11-04T04:52:01,875 On the other hand, currently there is no concept of package data 2023-11-04T04:52:01,876 directory, all directories are treated like packages. 2023-11-04T04:52:01,876 ******************************************************************************** 2023-11-04T04:52:01,877 !! 2023-11-04T04:52:01,878 check.warn(importable) 2023-11-04T04:52:01,878 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration. 2023-11-04T04:52:01,878 !! 2023-11-04T04:52:01,879 ******************************************************************************** 2023-11-04T04:52:01,880 ############################ 2023-11-04T04:52:01,880 # Package would be ignored # 2023-11-04T04:52:01,881 ############################ 2023-11-04T04:52:01,881 Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1], 2023-11-04T04:52:01,881 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:01,882 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:01,883 package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added 2023-11-04T04:52:01,883 to the `packages` configuration field. 2023-11-04T04:52:01,884 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:01,885 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:01,885 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:01,886 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:01,887 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:01,887 If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are 2023-11-04T04:52:01,888 already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via 2023-11-04T04:52:01,888 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:01,888 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:01,889 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:01,889 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:01,890 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:01,892 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:01,892 even if it does not contain any `.py` files. 2023-11-04T04:52:01,892 On the other hand, currently there is no concept of package data 2023-11-04T04:52:01,893 directory, all directories are treated like packages. 2023-11-04T04:52:01,893 ******************************************************************************** 2023-11-04T04:52:01,894 !! 2023-11-04T04:52:01,894 check.warn(importable) 2023-11-04T04:52:01,895 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2023-11-04T04:52:01,895 !! 2023-11-04T04:52:01,896 ******************************************************************************** 2023-11-04T04:52:01,896 ############################ 2023-11-04T04:52:01,897 # Package would be ignored # 2023-11-04T04:52:01,897 ############################ 2023-11-04T04:52:01,898 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2023-11-04T04:52:01,898 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:01,899 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:01,900 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2023-11-04T04:52:01,900 to the `packages` configuration field. 2023-11-04T04:52:01,901 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:01,902 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:01,902 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:01,903 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:01,904 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:01,905 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2023-11-04T04:52:01,905 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2023-11-04T04:52:01,906 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:01,906 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:01,907 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:01,908 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:01,909 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:01,910 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:01,910 even if it does not contain any `.py` files. 2023-11-04T04:52:01,911 On the other hand, currently there is no concept of package data 2023-11-04T04:52:01,911 directory, all directories are treated like packages. 2023-11-04T04:52:01,911 ******************************************************************************** 2023-11-04T04:52:01,912 !! 2023-11-04T04:52:01,912 check.warn(importable) 2023-11-04T04:52:01,913 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2023-11-04T04:52:01,913 !! 2023-11-04T04:52:01,914 ******************************************************************************** 2023-11-04T04:52:01,914 ############################ 2023-11-04T04:52:01,914 # Package would be ignored # 2023-11-04T04:52:01,915 ############################ 2023-11-04T04:52:01,915 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2023-11-04T04:52:01,915 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:01,916 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:01,916 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2023-11-04T04:52:01,917 to the `packages` configuration field. 2023-11-04T04:52:01,917 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:01,918 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:01,918 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:01,919 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:01,920 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:01,921 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2023-11-04T04:52:01,921 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2023-11-04T04:52:01,921 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:01,922 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:01,922 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:01,923 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:01,924 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:01,925 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:01,926 even if it does not contain any `.py` files. 2023-11-04T04:52:01,926 On the other hand, currently there is no concept of package data 2023-11-04T04:52:01,926 directory, all directories are treated like packages. 2023-11-04T04:52:01,927 ******************************************************************************** 2023-11-04T04:52:01,928 !! 2023-11-04T04:52:01,928 check.warn(importable) 2023-11-04T04:52:01,929 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2023-11-04T04:52:01,929 !! 2023-11-04T04:52:01,930 ******************************************************************************** 2023-11-04T04:52:01,930 ############################ 2023-11-04T04:52:01,931 # Package would be ignored # 2023-11-04T04:52:01,931 ############################ 2023-11-04T04:52:01,931 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2023-11-04T04:52:01,932 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:01,933 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:01,933 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2023-11-04T04:52:01,933 to the `packages` configuration field. 2023-11-04T04:52:01,934 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:01,934 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:01,935 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:01,935 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:01,936 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:01,937 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2023-11-04T04:52:01,937 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2023-11-04T04:52:01,937 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:01,938 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:01,938 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:01,939 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:01,939 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:01,941 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:01,941 even if it does not contain any `.py` files. 2023-11-04T04:52:01,941 On the other hand, currently there is no concept of package data 2023-11-04T04:52:01,942 directory, all directories are treated like packages. 2023-11-04T04:52:01,942 ******************************************************************************** 2023-11-04T04:52:01,943 !! 2023-11-04T04:52:01,943 check.warn(importable) 2023-11-04T04:52:01,944 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2023-11-04T04:52:01,944 !! 2023-11-04T04:52:01,945 ******************************************************************************** 2023-11-04T04:52:01,945 ############################ 2023-11-04T04:52:01,946 # Package would be ignored # 2023-11-04T04:52:01,946 ############################ 2023-11-04T04:52:01,947 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2023-11-04T04:52:01,947 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:01,948 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:01,949 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2023-11-04T04:52:01,949 to the `packages` configuration field. 2023-11-04T04:52:01,950 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:01,950 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:01,951 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:01,952 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:01,953 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:01,954 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2023-11-04T04:52:01,954 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2023-11-04T04:52:01,955 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:01,955 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:01,956 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:01,957 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:01,958 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:01,959 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:01,959 even if it does not contain any `.py` files. 2023-11-04T04:52:01,960 On the other hand, currently there is no concept of package data 2023-11-04T04:52:01,960 directory, all directories are treated like packages. 2023-11-04T04:52:01,960 ******************************************************************************** 2023-11-04T04:52:01,961 !! 2023-11-04T04:52:01,961 check.warn(importable) 2023-11-04T04:52:01,962 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2023-11-04T04:52:01,962 !! 2023-11-04T04:52:01,963 ******************************************************************************** 2023-11-04T04:52:01,963 ############################ 2023-11-04T04:52:01,964 # Package would be ignored # 2023-11-04T04:52:01,964 ############################ 2023-11-04T04:52:01,964 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2023-11-04T04:52:01,965 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:01,965 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:01,966 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2023-11-04T04:52:01,966 to the `packages` configuration field. 2023-11-04T04:52:01,967 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:01,967 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:01,968 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:01,968 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:01,969 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:01,971 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2023-11-04T04:52:01,971 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2023-11-04T04:52:01,971 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:01,972 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:01,972 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:01,973 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:01,974 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:01,975 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:01,976 even if it does not contain any `.py` files. 2023-11-04T04:52:01,976 On the other hand, currently there is no concept of package data 2023-11-04T04:52:01,977 directory, all directories are treated like packages. 2023-11-04T04:52:01,977 ******************************************************************************** 2023-11-04T04:52:01,978 !! 2023-11-04T04:52:01,978 check.warn(importable) 2023-11-04T04:52:01,979 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration. 2023-11-04T04:52:01,979 !! 2023-11-04T04:52:01,980 ******************************************************************************** 2023-11-04T04:52:01,981 ############################ 2023-11-04T04:52:01,981 # Package would be ignored # 2023-11-04T04:52:01,981 ############################ 2023-11-04T04:52:01,981 Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1], 2023-11-04T04:52:01,982 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:01,983 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:01,983 package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added 2023-11-04T04:52:01,983 to the `packages` configuration field. 2023-11-04T04:52:01,984 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:01,984 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:01,985 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:01,985 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:01,986 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:01,987 If you don't want 'deepspeed.ops.csrc.common' to be distributed and are 2023-11-04T04:52:01,987 already explicitly excluding 'deepspeed.ops.csrc.common' via 2023-11-04T04:52:01,987 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:01,988 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:01,988 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:01,989 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:01,990 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:01,991 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:01,991 even if it does not contain any `.py` files. 2023-11-04T04:52:01,992 On the other hand, currently there is no concept of package data 2023-11-04T04:52:01,992 directory, all directories are treated like packages. 2023-11-04T04:52:01,993 ******************************************************************************** 2023-11-04T04:52:01,994 !! 2023-11-04T04:52:01,994 check.warn(importable) 2023-11-04T04:52:01,995 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration. 2023-11-04T04:52:01,995 !! 2023-11-04T04:52:01,996 ******************************************************************************** 2023-11-04T04:52:01,996 ############################ 2023-11-04T04:52:01,997 # Package would be ignored # 2023-11-04T04:52:01,997 ############################ 2023-11-04T04:52:01,998 Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1], 2023-11-04T04:52:01,998 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:01,999 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:01,999 package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added 2023-11-04T04:52:02,000 to the `packages` configuration field. 2023-11-04T04:52:02,001 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,001 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,002 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,002 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,003 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,004 If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are 2023-11-04T04:52:02,004 already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via 2023-11-04T04:52:02,005 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,005 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,005 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,006 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,007 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,008 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,008 even if it does not contain any `.py` files. 2023-11-04T04:52:02,008 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,009 directory, all directories are treated like packages. 2023-11-04T04:52:02,009 ******************************************************************************** 2023-11-04T04:52:02,010 !! 2023-11-04T04:52:02,011 check.warn(importable) 2023-11-04T04:52:02,011 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2023-11-04T04:52:02,012 !! 2023-11-04T04:52:02,012 ******************************************************************************** 2023-11-04T04:52:02,013 ############################ 2023-11-04T04:52:02,013 # Package would be ignored # 2023-11-04T04:52:02,013 ############################ 2023-11-04T04:52:02,014 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2023-11-04T04:52:02,014 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,015 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,016 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2023-11-04T04:52:02,016 to the `packages` configuration field. 2023-11-04T04:52:02,017 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,018 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,018 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,019 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,020 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,021 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2023-11-04T04:52:02,022 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2023-11-04T04:52:02,022 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,023 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,023 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,024 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,025 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,027 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,027 even if it does not contain any `.py` files. 2023-11-04T04:52:02,028 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,028 directory, all directories are treated like packages. 2023-11-04T04:52:02,028 ******************************************************************************** 2023-11-04T04:52:02,030 !! 2023-11-04T04:52:02,030 check.warn(importable) 2023-11-04T04:52:02,030 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration. 2023-11-04T04:52:02,031 !! 2023-11-04T04:52:02,031 ******************************************************************************** 2023-11-04T04:52:02,032 ############################ 2023-11-04T04:52:02,032 # Package would be ignored # 2023-11-04T04:52:02,032 ############################ 2023-11-04T04:52:02,033 Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1], 2023-11-04T04:52:02,033 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,034 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,034 package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added 2023-11-04T04:52:02,034 to the `packages` configuration field. 2023-11-04T04:52:02,035 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,036 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,036 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,037 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,038 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,039 If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are 2023-11-04T04:52:02,039 already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via 2023-11-04T04:52:02,039 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,040 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,040 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,041 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,042 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,043 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,044 even if it does not contain any `.py` files. 2023-11-04T04:52:02,044 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,045 directory, all directories are treated like packages. 2023-11-04T04:52:02,045 ******************************************************************************** 2023-11-04T04:52:02,046 !! 2023-11-04T04:52:02,046 check.warn(importable) 2023-11-04T04:52:02,047 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration. 2023-11-04T04:52:02,047 !! 2023-11-04T04:52:02,048 ******************************************************************************** 2023-11-04T04:52:02,049 ############################ 2023-11-04T04:52:02,049 # Package would be ignored # 2023-11-04T04:52:02,050 ############################ 2023-11-04T04:52:02,050 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1], 2023-11-04T04:52:02,051 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,052 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,052 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added 2023-11-04T04:52:02,053 to the `packages` configuration field. 2023-11-04T04:52:02,054 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,054 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,054 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,055 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,056 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,057 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are 2023-11-04T04:52:02,057 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via 2023-11-04T04:52:02,058 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,058 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,058 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,059 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,060 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,061 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,062 even if it does not contain any `.py` files. 2023-11-04T04:52:02,062 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,063 directory, all directories are treated like packages. 2023-11-04T04:52:02,063 ******************************************************************************** 2023-11-04T04:52:02,064 !! 2023-11-04T04:52:02,065 check.warn(importable) 2023-11-04T04:52:02,065 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration. 2023-11-04T04:52:02,066 !! 2023-11-04T04:52:02,067 ******************************************************************************** 2023-11-04T04:52:02,067 ############################ 2023-11-04T04:52:02,068 # Package would be ignored # 2023-11-04T04:52:02,069 ############################ 2023-11-04T04:52:02,069 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1], 2023-11-04T04:52:02,070 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,071 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,071 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added 2023-11-04T04:52:02,072 to the `packages` configuration field. 2023-11-04T04:52:02,073 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,073 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,074 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,075 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,076 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,077 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are 2023-11-04T04:52:02,078 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via 2023-11-04T04:52:02,078 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,079 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,080 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,081 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,082 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,083 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,084 even if it does not contain any `.py` files. 2023-11-04T04:52:02,084 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,084 directory, all directories are treated like packages. 2023-11-04T04:52:02,085 ******************************************************************************** 2023-11-04T04:52:02,086 !! 2023-11-04T04:52:02,086 check.warn(importable) 2023-11-04T04:52:02,087 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration. 2023-11-04T04:52:02,087 !! 2023-11-04T04:52:02,088 ******************************************************************************** 2023-11-04T04:52:02,089 ############################ 2023-11-04T04:52:02,089 # Package would be ignored # 2023-11-04T04:52:02,090 ############################ 2023-11-04T04:52:02,090 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1], 2023-11-04T04:52:02,091 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,092 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,092 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added 2023-11-04T04:52:02,093 to the `packages` configuration field. 2023-11-04T04:52:02,094 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,094 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,095 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,096 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,097 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,098 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are 2023-11-04T04:52:02,098 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via 2023-11-04T04:52:02,099 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,099 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,100 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,101 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,102 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,104 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,104 even if it does not contain any `.py` files. 2023-11-04T04:52:02,105 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,105 directory, all directories are treated like packages. 2023-11-04T04:52:02,106 ******************************************************************************** 2023-11-04T04:52:02,107 !! 2023-11-04T04:52:02,107 check.warn(importable) 2023-11-04T04:52:02,108 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration. 2023-11-04T04:52:02,109 !! 2023-11-04T04:52:02,110 ******************************************************************************** 2023-11-04T04:52:02,110 ############################ 2023-11-04T04:52:02,111 # Package would be ignored # 2023-11-04T04:52:02,111 ############################ 2023-11-04T04:52:02,112 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1], 2023-11-04T04:52:02,112 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,113 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,113 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added 2023-11-04T04:52:02,114 to the `packages` configuration field. 2023-11-04T04:52:02,115 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,115 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,116 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,117 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,118 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,119 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are 2023-11-04T04:52:02,119 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via 2023-11-04T04:52:02,120 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,120 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,121 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,122 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,123 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,124 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,125 even if it does not contain any `.py` files. 2023-11-04T04:52:02,125 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,126 directory, all directories are treated like packages. 2023-11-04T04:52:02,126 ******************************************************************************** 2023-11-04T04:52:02,128 !! 2023-11-04T04:52:02,128 check.warn(importable) 2023-11-04T04:52:02,129 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration. 2023-11-04T04:52:02,129 !! 2023-11-04T04:52:02,130 ******************************************************************************** 2023-11-04T04:52:02,131 ############################ 2023-11-04T04:52:02,131 # Package would be ignored # 2023-11-04T04:52:02,146 ############################ 2023-11-04T04:52:02,146 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1], 2023-11-04T04:52:02,147 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,148 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,149 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added 2023-11-04T04:52:02,149 to the `packages` configuration field. 2023-11-04T04:52:02,150 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,151 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,151 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,152 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,153 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,154 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are 2023-11-04T04:52:02,155 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via 2023-11-04T04:52:02,155 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,155 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,156 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,157 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,158 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,160 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,160 even if it does not contain any `.py` files. 2023-11-04T04:52:02,160 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,161 directory, all directories are treated like packages. 2023-11-04T04:52:02,161 ******************************************************************************** 2023-11-04T04:52:02,163 !! 2023-11-04T04:52:02,164 check.warn(importable) 2023-11-04T04:52:02,165 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2023-11-04T04:52:02,166 !! 2023-11-04T04:52:02,168 ******************************************************************************** 2023-11-04T04:52:02,168 ############################ 2023-11-04T04:52:02,169 # Package would be ignored # 2023-11-04T04:52:02,169 ############################ 2023-11-04T04:52:02,170 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2023-11-04T04:52:02,170 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,171 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,171 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2023-11-04T04:52:02,172 to the `packages` configuration field. 2023-11-04T04:52:02,173 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,174 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,174 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,175 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,176 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,177 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2023-11-04T04:52:02,178 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2023-11-04T04:52:02,178 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,179 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,179 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,180 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,182 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,183 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,184 even if it does not contain any `.py` files. 2023-11-04T04:52:02,184 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,184 directory, all directories are treated like packages. 2023-11-04T04:52:02,185 ******************************************************************************** 2023-11-04T04:52:02,186 !! 2023-11-04T04:52:02,186 check.warn(importable) 2023-11-04T04:52:02,187 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2023-11-04T04:52:02,187 !! 2023-11-04T04:52:02,188 ******************************************************************************** 2023-11-04T04:52:02,189 ############################ 2023-11-04T04:52:02,189 # Package would be ignored # 2023-11-04T04:52:02,189 ############################ 2023-11-04T04:52:02,190 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2023-11-04T04:52:02,190 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,191 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,192 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2023-11-04T04:52:02,192 to the `packages` configuration field. 2023-11-04T04:52:02,193 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,194 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,194 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,195 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,196 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,197 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2023-11-04T04:52:02,198 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2023-11-04T04:52:02,198 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,199 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,199 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,200 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,201 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,202 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,203 even if it does not contain any `.py` files. 2023-11-04T04:52:02,203 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,204 directory, all directories are treated like packages. 2023-11-04T04:52:02,204 ******************************************************************************** 2023-11-04T04:52:02,205 !! 2023-11-04T04:52:02,206 check.warn(importable) 2023-11-04T04:52:02,206 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration. 2023-11-04T04:52:02,207 !! 2023-11-04T04:52:02,208 ******************************************************************************** 2023-11-04T04:52:02,208 ############################ 2023-11-04T04:52:02,209 # Package would be ignored # 2023-11-04T04:52:02,209 ############################ 2023-11-04T04:52:02,210 Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1], 2023-11-04T04:52:02,211 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,212 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,212 package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added 2023-11-04T04:52:02,213 to the `packages` configuration field. 2023-11-04T04:52:02,214 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,214 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,215 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,216 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,217 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,218 If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are 2023-11-04T04:52:02,218 already explicitly excluding 'deepspeed.ops.csrc.lion' via 2023-11-04T04:52:02,218 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,219 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,219 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,220 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,221 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,223 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,224 even if it does not contain any `.py` files. 2023-11-04T04:52:02,224 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,225 directory, all directories are treated like packages. 2023-11-04T04:52:02,226 ******************************************************************************** 2023-11-04T04:52:02,226 !! 2023-11-04T04:52:02,227 check.warn(importable) 2023-11-04T04:52:02,227 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2023-11-04T04:52:02,228 !! 2023-11-04T04:52:02,229 ******************************************************************************** 2023-11-04T04:52:02,230 ############################ 2023-11-04T04:52:02,230 # Package would be ignored # 2023-11-04T04:52:02,231 ############################ 2023-11-04T04:52:02,231 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2023-11-04T04:52:02,232 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,233 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,233 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2023-11-04T04:52:02,234 to the `packages` configuration field. 2023-11-04T04:52:02,235 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,235 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,236 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,237 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,238 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,239 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2023-11-04T04:52:02,239 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2023-11-04T04:52:02,240 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,241 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,241 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,242 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,243 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,244 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,245 even if it does not contain any `.py` files. 2023-11-04T04:52:02,245 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,245 directory, all directories are treated like packages. 2023-11-04T04:52:02,246 ******************************************************************************** 2023-11-04T04:52:02,247 !! 2023-11-04T04:52:02,247 check.warn(importable) 2023-11-04T04:52:02,248 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2023-11-04T04:52:02,248 !! 2023-11-04T04:52:02,249 ******************************************************************************** 2023-11-04T04:52:02,249 ############################ 2023-11-04T04:52:02,250 # Package would be ignored # 2023-11-04T04:52:02,250 ############################ 2023-11-04T04:52:02,251 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2023-11-04T04:52:02,251 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,252 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,253 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2023-11-04T04:52:02,253 to the `packages` configuration field. 2023-11-04T04:52:02,254 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,255 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,255 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,256 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,257 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,258 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2023-11-04T04:52:02,258 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2023-11-04T04:52:02,259 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,259 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,260 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,261 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,262 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,264 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,264 even if it does not contain any `.py` files. 2023-11-04T04:52:02,265 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,265 directory, all directories are treated like packages. 2023-11-04T04:52:02,266 ******************************************************************************** 2023-11-04T04:52:02,267 !! 2023-11-04T04:52:02,267 check.warn(importable) 2023-11-04T04:52:02,268 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2023-11-04T04:52:02,268 !! 2023-11-04T04:52:02,269 ******************************************************************************** 2023-11-04T04:52:02,270 ############################ 2023-11-04T04:52:02,270 # Package would be ignored # 2023-11-04T04:52:02,270 ############################ 2023-11-04T04:52:02,271 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2023-11-04T04:52:02,271 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,272 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,272 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2023-11-04T04:52:02,273 to the `packages` configuration field. 2023-11-04T04:52:02,274 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,274 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,275 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,276 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,276 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,277 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2023-11-04T04:52:02,278 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2023-11-04T04:52:02,278 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,279 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,279 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,280 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,281 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,283 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,283 even if it does not contain any `.py` files. 2023-11-04T04:52:02,283 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,284 directory, all directories are treated like packages. 2023-11-04T04:52:02,284 ******************************************************************************** 2023-11-04T04:52:02,285 !! 2023-11-04T04:52:02,286 check.warn(importable) 2023-11-04T04:52:02,286 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2023-11-04T04:52:02,287 !! 2023-11-04T04:52:02,288 ******************************************************************************** 2023-11-04T04:52:02,288 ############################ 2023-11-04T04:52:02,289 # Package would be ignored # 2023-11-04T04:52:02,289 ############################ 2023-11-04T04:52:02,290 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2023-11-04T04:52:02,290 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,291 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,292 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2023-11-04T04:52:02,293 to the `packages` configuration field. 2023-11-04T04:52:02,294 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,294 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,295 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,296 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,297 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,298 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2023-11-04T04:52:02,298 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2023-11-04T04:52:02,299 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,299 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,300 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,300 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,301 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,303 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,303 even if it does not contain any `.py` files. 2023-11-04T04:52:02,303 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,304 directory, all directories are treated like packages. 2023-11-04T04:52:02,304 ******************************************************************************** 2023-11-04T04:52:02,305 !! 2023-11-04T04:52:02,306 check.warn(importable) 2023-11-04T04:52:02,306 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2023-11-04T04:52:02,307 !! 2023-11-04T04:52:02,308 ******************************************************************************** 2023-11-04T04:52:02,308 ############################ 2023-11-04T04:52:02,309 # Package would be ignored # 2023-11-04T04:52:02,309 ############################ 2023-11-04T04:52:02,310 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2023-11-04T04:52:02,310 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,311 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,312 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2023-11-04T04:52:02,312 to the `packages` configuration field. 2023-11-04T04:52:02,313 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,313 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,314 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,315 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,316 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,317 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2023-11-04T04:52:02,317 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2023-11-04T04:52:02,318 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,318 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,319 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,320 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,321 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,323 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,323 even if it does not contain any `.py` files. 2023-11-04T04:52:02,323 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,324 directory, all directories are treated like packages. 2023-11-04T04:52:02,324 ******************************************************************************** 2023-11-04T04:52:02,325 !! 2023-11-04T04:52:02,326 check.warn(importable) 2023-11-04T04:52:02,326 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2023-11-04T04:52:02,327 !! 2023-11-04T04:52:02,327 ******************************************************************************** 2023-11-04T04:52:02,328 ############################ 2023-11-04T04:52:02,328 # Package would be ignored # 2023-11-04T04:52:02,329 ############################ 2023-11-04T04:52:02,329 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2023-11-04T04:52:02,329 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,330 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,331 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2023-11-04T04:52:02,331 to the `packages` configuration field. 2023-11-04T04:52:02,332 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,333 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,333 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,334 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,335 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,336 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2023-11-04T04:52:02,337 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2023-11-04T04:52:02,337 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,338 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,338 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,339 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,340 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,341 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,342 even if it does not contain any `.py` files. 2023-11-04T04:52:02,342 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,343 directory, all directories are treated like packages. 2023-11-04T04:52:02,343 ******************************************************************************** 2023-11-04T04:52:02,344 !! 2023-11-04T04:52:02,345 check.warn(importable) 2023-11-04T04:52:02,345 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2023-11-04T04:52:02,346 !! 2023-11-04T04:52:02,347 ******************************************************************************** 2023-11-04T04:52:02,347 ############################ 2023-11-04T04:52:02,348 # Package would be ignored # 2023-11-04T04:52:02,348 ############################ 2023-11-04T04:52:02,349 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2023-11-04T04:52:02,349 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,350 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,351 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2023-11-04T04:52:02,352 to the `packages` configuration field. 2023-11-04T04:52:02,353 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,353 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,353 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,354 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,355 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,356 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2023-11-04T04:52:02,357 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2023-11-04T04:52:02,357 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,357 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,358 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,359 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,360 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,361 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,361 even if it does not contain any `.py` files. 2023-11-04T04:52:02,362 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,363 directory, all directories are treated like packages. 2023-11-04T04:52:02,363 ******************************************************************************** 2023-11-04T04:52:02,364 !! 2023-11-04T04:52:02,364 check.warn(importable) 2023-11-04T04:52:02,365 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2023-11-04T04:52:02,365 !! 2023-11-04T04:52:02,366 ******************************************************************************** 2023-11-04T04:52:02,367 ############################ 2023-11-04T04:52:02,367 # Package would be ignored # 2023-11-04T04:52:02,368 ############################ 2023-11-04T04:52:02,368 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2023-11-04T04:52:02,369 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,370 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,371 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2023-11-04T04:52:02,371 to the `packages` configuration field. 2023-11-04T04:52:02,372 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,373 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,373 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,374 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,375 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,376 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2023-11-04T04:52:02,377 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2023-11-04T04:52:02,377 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,378 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,379 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,380 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,381 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,382 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,382 even if it does not contain any `.py` files. 2023-11-04T04:52:02,383 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,383 directory, all directories are treated like packages. 2023-11-04T04:52:02,384 ******************************************************************************** 2023-11-04T04:52:02,385 !! 2023-11-04T04:52:02,385 check.warn(importable) 2023-11-04T04:52:02,385 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2023-11-04T04:52:02,386 !! 2023-11-04T04:52:02,387 ******************************************************************************** 2023-11-04T04:52:02,387 ############################ 2023-11-04T04:52:02,388 # Package would be ignored # 2023-11-04T04:52:02,388 ############################ 2023-11-04T04:52:02,389 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2023-11-04T04:52:02,389 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:52:02,390 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:52:02,391 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2023-11-04T04:52:02,391 to the `packages` configuration field. 2023-11-04T04:52:02,392 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:52:02,392 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:52:02,393 instead of `find_packages(...)`/`find:`). 2023-11-04T04:52:02,394 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:52:02,395 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:52:02,396 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2023-11-04T04:52:02,396 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2023-11-04T04:52:02,397 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:52:02,397 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:52:02,398 combination with a more fine grained `package-data` configuration. 2023-11-04T04:52:02,399 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:52:02,400 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:52:02,402 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:52:02,402 even if it does not contain any `.py` files. 2023-11-04T04:52:02,402 On the other hand, currently there is no concept of package data 2023-11-04T04:52:02,403 directory, all directories are treated like packages. 2023-11-04T04:52:02,403 ******************************************************************************** 2023-11-04T04:52:02,404 !! 2023-11-04T04:52:02,405 check.warn(importable) 2023-11-04T04:52:02,406 creating build/lib/deepspeed/autotuning/config_templates 2023-11-04T04:52:02,406 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2023-11-04T04:52:02,406 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2023-11-04T04:52:02,407 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2023-11-04T04:52:02,408 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2023-11-04T04:52:02,408 creating build/lib/deepspeed/ops/csrc 2023-11-04T04:52:02,409 creating build/lib/deepspeed/ops/csrc/adagrad 2023-11-04T04:52:02,409 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2023-11-04T04:52:02,410 creating build/lib/deepspeed/ops/csrc/adam 2023-11-04T04:52:02,410 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-11-04T04:52:02,411 copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-11-04T04:52:02,411 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-11-04T04:52:02,412 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2023-11-04T04:52:02,412 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2023-11-04T04:52:02,412 creating build/lib/deepspeed/ops/csrc/aio 2023-11-04T04:52:02,413 creating build/lib/deepspeed/ops/csrc/aio/common 2023-11-04T04:52:02,413 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-04T04:52:02,414 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-04T04:52:02,414 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-04T04:52:02,415 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-04T04:52:02,415 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-04T04:52:02,416 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-04T04:52:02,416 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:02,417 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:02,417 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:02,418 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:02,418 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:02,419 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:02,419 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:02,420 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:02,420 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:02,421 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:02,421 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:02,422 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:02,422 creating build/lib/deepspeed/ops/csrc/aio/py_test 2023-11-04T04:52:02,423 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2023-11-04T04:52:02,423 creating build/lib/deepspeed/ops/csrc/common 2023-11-04T04:52:02,424 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2023-11-04T04:52:02,424 creating build/lib/deepspeed/ops/csrc/cpu 2023-11-04T04:52:02,425 creating build/lib/deepspeed/ops/csrc/cpu/adam 2023-11-04T04:52:02,426 copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam 2023-11-04T04:52:02,426 creating build/lib/deepspeed/ops/csrc/cpu/comm 2023-11-04T04:52:02,427 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2023-11-04T04:52:02,427 creating build/lib/deepspeed/ops/csrc/cpu/lion 2023-11-04T04:52:02,427 copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion 2023-11-04T04:52:02,428 creating build/lib/deepspeed/ops/csrc/deepspeed4science 2023-11-04T04:52:02,428 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:52:02,429 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:52:02,429 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:52:02,429 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:52:02,430 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:52:02,431 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:52:02,431 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:52:02,432 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:52:02,432 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:52:02,432 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:52:02,433 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:52:02,433 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:52:02,434 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:52:02,434 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:52:02,435 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:52:02,436 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:52:02,436 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:52:02,437 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:52:02,437 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:52:02,438 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:52:02,438 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:52:02,439 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:52:02,439 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:52:02,440 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:52:02,440 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:52:02,441 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:52:02,441 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:52:02,441 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:52:02,442 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-04T04:52:02,443 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-04T04:52:02,443 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-04T04:52:02,444 creating build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,444 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,445 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,445 copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,446 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,446 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,447 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,448 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,448 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,449 copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,449 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,450 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,450 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,451 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,452 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,452 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,453 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,453 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,454 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,455 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,455 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,456 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,456 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,457 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,457 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,458 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,459 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,459 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,460 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,460 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:52:02,461 creating build/lib/deepspeed/ops/csrc/lamb 2023-11-04T04:52:02,461 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2023-11-04T04:52:02,462 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2023-11-04T04:52:02,463 creating build/lib/deepspeed/ops/csrc/lion 2023-11-04T04:52:02,463 copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-11-04T04:52:02,464 copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-11-04T04:52:02,464 copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-11-04T04:52:02,465 copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion 2023-11-04T04:52:02,465 copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion 2023-11-04T04:52:02,466 creating build/lib/deepspeed/ops/csrc/quantization 2023-11-04T04:52:02,467 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-04T04:52:02,468 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-04T04:52:02,468 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2023-11-04T04:52:02,469 copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-04T04:52:02,469 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-04T04:52:02,470 copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-04T04:52:02,471 copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-04T04:52:02,471 creating build/lib/deepspeed/ops/csrc/random_ltd 2023-11-04T04:52:02,472 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-11-04T04:52:02,472 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2023-11-04T04:52:02,473 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-11-04T04:52:02,474 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-11-04T04:52:02,474 creating build/lib/deepspeed/ops/csrc/sparse_attention 2023-11-04T04:52:02,475 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2023-11-04T04:52:02,476 creating build/lib/deepspeed/ops/csrc/spatial 2023-11-04T04:52:02,476 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2023-11-04T04:52:02,477 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-11-04T04:52:02,478 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-11-04T04:52:02,479 creating build/lib/deepspeed/ops/csrc/spatial/includes 2023-11-04T04:52:02,479 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2023-11-04T04:52:02,480 creating build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:52:02,480 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:52:02,481 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:52:02,481 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:52:02,482 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:52:02,482 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:52:02,483 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:52:02,483 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:52:02,484 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:52:02,484 creating build/lib/deepspeed/ops/csrc/transformer/inference 2023-11-04T04:52:02,485 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:02,485 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:02,486 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:02,486 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:02,487 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:02,488 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:02,488 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:02,489 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:02,490 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:02,490 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:02,491 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:02,495 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-11-04T04:52:02,496 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-11-04T04:52:02,500 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-11-04T04:52:02,503 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-11-04T04:52:02,506 creating build/lib/deepspeed/ops/csrc/utils 2023-11-04T04:52:02,507 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2023-11-04T04:52:02,510 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:52:02,512 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:52:02,515 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:52:02,517 creating build/lib/deepspeed/inference/v2/ragged/csrc 2023-11-04T04:52:02,518 copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc 2023-11-04T04:52:02,521 copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc 2023-11-04T04:52:02,523 creating build/lib/deepspeed/inference/v2/ragged/includes 2023-11-04T04:52:02,524 copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes 2023-11-04T04:52:02,526 copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops 2023-11-04T04:52:02,529 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2023-11-04T04:52:02,531 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-04T04:52:02,532 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-04T04:52:02,534 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-04T04:52:02,537 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-04T04:52:02,539 copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-04T04:52:02,541 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-11-04T04:52:02,542 copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-11-04T04:52:02,545 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:52:02,548 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:52:02,551 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:52:02,554 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:52:02,556 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:52:02,559 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:52:02,561 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:52:02,563 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:52:02,565 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:52:02,567 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:52:02,570 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:52:02,572 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:52:02,573 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:52:02,576 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:52:02,577 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:52:02,579 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:52:02,581 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:52:02,583 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:52:02,585 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:52:02,587 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:52:02,589 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:52:02,591 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:52:02,593 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:52:02,595 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:52:02,597 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:52:02,599 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:52:02,600 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:52:02,602 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:52:02,605 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:52:02,607 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:52:02,609 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:52:02,611 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:52:02,613 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:52:02,615 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:52:02,617 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:52:02,619 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:52:02,622 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:52:02,624 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:52:02,626 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:52:02,628 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:52:02,630 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:52:02,632 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:52:02,634 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:52:02,636 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:52:02,638 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:52:02,640 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:52:02,642 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:52:02,644 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:52:02,646 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:52:02,648 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:52:02,691 running build_scripts 2023-11-04T04:52:02,692 creating build/scripts-3.11 2023-11-04T04:52:02,693 copying and adjusting bin/deepspeed -> build/scripts-3.11 2023-11-04T04:52:02,694 copying and adjusting bin/deepspeed.pt -> build/scripts-3.11 2023-11-04T04:52:02,696 copying and adjusting bin/ds -> build/scripts-3.11 2023-11-04T04:52:02,698 copying bin/ds_ssh -> build/scripts-3.11 2023-11-04T04:52:02,700 copying and adjusting bin/ds_report -> build/scripts-3.11 2023-11-04T04:52:02,701 copying and adjusting bin/ds_bench -> build/scripts-3.11 2023-11-04T04:52:02,702 copying and adjusting bin/dsr -> build/scripts-3.11 2023-11-04T04:52:02,704 copying and adjusting bin/ds_elastic -> build/scripts-3.11 2023-11-04T04:52:02,705 changing mode of build/scripts-3.11/deepspeed from 644 to 755 2023-11-04T04:52:02,706 changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755 2023-11-04T04:52:02,706 changing mode of build/scripts-3.11/ds from 644 to 755 2023-11-04T04:52:02,707 changing mode of build/scripts-3.11/ds_report from 644 to 755 2023-11-04T04:52:02,707 changing mode of build/scripts-3.11/ds_bench from 644 to 755 2023-11-04T04:52:02,708 changing mode of build/scripts-3.11/dsr from 644 to 755 2023-11-04T04:52:02,709 changing mode of build/scripts-3.11/ds_elastic from 644 to 755 2023-11-04T04:52:02,732 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-11-04T04:52:02,732 !! 2023-11-04T04:52:02,733 ******************************************************************************** 2023-11-04T04:52:02,734 Please avoid running ``setup.py`` directly. 2023-11-04T04:52:02,735 Instead, use pypa/build, pypa/installer or other 2023-11-04T04:52:02,735 standards-based tools. 2023-11-04T04:52:02,736 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-11-04T04:52:02,736 ******************************************************************************** 2023-11-04T04:52:02,737 !! 2023-11-04T04:52:02,738 self.initialize_options() 2023-11-04T04:52:02,758 installing to build/bdist.linux-armv7l/wheel 2023-11-04T04:52:02,758 running install 2023-11-04T04:52:02,782 running install_lib 2023-11-04T04:52:02,807 creating build/bdist.linux-armv7l 2023-11-04T04:52:02,808 creating build/bdist.linux-armv7l/wheel 2023-11-04T04:52:02,809 creating build/bdist.linux-armv7l/wheel/deepspeed 2023-11-04T04:52:02,811 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:52:02,812 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:52:02,813 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:52:02,816 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:52:02,818 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:52:02,820 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:52:02,822 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:52:02,824 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:52:02,825 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:52:02,828 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:52:02,829 copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-04T04:52:02,832 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:52:02,833 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:52:02,835 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:52:02,837 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:52:02,839 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:52:02,841 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:52:02,843 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:52:02,845 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:52:02,847 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:52:02,849 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:52:02,851 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:52:02,853 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:52:02,856 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:52:02,858 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:52:02,860 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:52:02,862 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-04T04:52:02,864 creating build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-11-04T04:52:02,865 copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-11-04T04:52:02,867 copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-11-04T04:52:02,869 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:52:02,871 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,871 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,874 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,876 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,878 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,880 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,882 copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,884 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,886 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,888 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,890 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,892 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,894 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,896 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,898 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,900 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,902 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,905 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,907 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,909 copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:52:02,912 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-04T04:52:02,913 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-04T04:52:02,915 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-04T04:52:02,917 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-04T04:52:02,919 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-04T04:52:02,921 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-04T04:52:02,923 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-04T04:52:02,925 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-04T04:52:02,927 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:52:02,929 copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:52:02,932 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:52:02,933 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:52:02,935 copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:52:02,937 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:52:02,940 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:52:02,942 copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:52:02,944 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:52:02,946 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:52:02,948 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:52:02,950 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:52:02,953 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:52:02,956 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-04T04:52:02,957 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-04T04:52:02,958 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-04T04:52:02,960 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-04T04:52:02,962 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-04T04:52:02,964 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-04T04:52:02,966 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-04T04:52:02,969 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-04T04:52:02,970 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-04T04:52:02,973 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-11-04T04:52:02,974 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-11-04T04:52:02,976 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-11-04T04:52:02,977 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-11-04T04:52:02,979 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-11-04T04:52:02,981 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-04T04:52:02,983 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-04T04:52:02,986 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-04T04:52:02,988 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-04T04:52:02,991 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-04T04:52:02,993 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-04T04:52:02,996 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-11-04T04:52:02,996 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-11-04T04:52:02,999 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-04T04:52:03,000 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-04T04:52:03,002 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-04T04:52:03,004 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-04T04:52:03,007 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-04T04:52:03,009 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-04T04:52:03,011 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-04T04:52:03,013 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-04T04:52:03,015 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-04T04:52:03,017 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-04T04:52:03,019 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-04T04:52:03,022 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-04T04:52:03,024 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-04T04:52:03,029 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-04T04:52:03,030 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-04T04:52:03,032 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-04T04:52:03,035 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-04T04:52:03,037 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-04T04:52:03,040 copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-04T04:52:03,043 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-04T04:52:03,045 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-04T04:52:03,048 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-11-04T04:52:03,049 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-11-04T04:52:03,052 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-11-04T04:52:03,054 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-11-04T04:52:03,057 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-04T04:52:03,059 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-11-04T04:52:03,061 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-11-04T04:52:03,063 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-11-04T04:52:03,065 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-11-04T04:52:03,067 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-11-04T04:52:03,070 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2023-11-04T04:52:03,071 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-11-04T04:52:03,073 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-11-04T04:52:03,075 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-11-04T04:52:03,076 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-11-04T04:52:03,080 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2023-11-04T04:52:03,081 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-11-04T04:52:03,082 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-11-04T04:52:03,085 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-11-04T04:52:03,088 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-11-04T04:52:03,089 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-11-04T04:52:03,092 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-04T04:52:03,093 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-04T04:52:03,095 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-04T04:52:03,098 copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-04T04:52:03,101 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-04T04:52:03,104 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-04T04:52:03,106 copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-04T04:52:03,109 copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-04T04:52:03,112 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-11-04T04:52:03,113 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-11-04T04:52:03,116 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu 2023-11-04T04:52:03,118 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-11-04T04:52:03,119 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-11-04T04:52:03,122 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2023-11-04T04:52:03,124 copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2023-11-04T04:52:03,127 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2023-11-04T04:52:03,128 copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2023-11-04T04:52:03,131 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,132 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,135 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,137 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,139 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,142 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,145 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,147 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,149 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,152 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,154 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,156 copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,158 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,161 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,164 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,167 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,169 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,175 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,177 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,180 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,182 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,211 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,214 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,216 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,218 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,220 copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,223 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,225 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,228 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,231 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:52:03,233 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-04T04:52:03,234 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-04T04:52:03,241 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-04T04:52:03,243 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-04T04:52:03,246 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-04T04:52:03,248 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-04T04:52:03,251 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-04T04:52:03,251 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-04T04:52:03,254 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-04T04:52:03,256 copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-04T04:52:03,258 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-04T04:52:03,261 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-04T04:52:03,264 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-11-04T04:52:03,265 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-11-04T04:52:03,268 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-11-04T04:52:03,271 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-11-04T04:52:03,274 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-11-04T04:52:03,277 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science 2023-11-04T04:52:03,279 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:52:03,281 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:52:03,282 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:52:03,286 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:52:03,289 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:52:03,292 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:52:03,294 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:52:03,299 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:52:03,302 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:52:03,305 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-04T04:52:03,307 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-04T04:52:03,310 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-04T04:52:03,312 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:52:03,315 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:52:03,317 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:52:03,323 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:52:03,325 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:52:03,328 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:52:03,330 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:52:03,333 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:52:03,336 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:52:03,340 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:52:03,344 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:52:03,345 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:52:03,348 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:52:03,352 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:52:03,355 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:52:03,358 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:52:03,361 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:52:03,364 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:52:03,367 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:52:03,370 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:52:03,371 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:52:03,374 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:52:03,376 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:52:03,379 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:52:03,381 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:52:03,384 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:52:03,387 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:52:03,390 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:52:03,395 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2023-11-04T04:52:03,396 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:03,397 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:03,400 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:03,403 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:03,406 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:03,408 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:03,411 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:03,413 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:03,417 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:03,419 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:03,421 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:52:03,424 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-11-04T04:52:03,425 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-11-04T04:52:03,427 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-11-04T04:52:03,430 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-11-04T04:52:03,433 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-11-04T04:52:03,434 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-11-04T04:52:03,436 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2023-11-04T04:52:03,438 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:03,439 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:03,441 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:03,443 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:03,445 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:03,447 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:03,449 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:03,451 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:03,453 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:03,455 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:03,457 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:03,459 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:52:03,461 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-04T04:52:03,462 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-04T04:52:03,464 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-04T04:52:03,466 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-04T04:52:03,468 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-04T04:52:03,470 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-04T04:52:03,471 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-04T04:52:03,474 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-11-04T04:52:03,475 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-11-04T04:52:03,477 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-11-04T04:52:03,478 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-11-04T04:52:03,480 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-11-04T04:52:03,483 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-11-04T04:52:03,484 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-11-04T04:52:03,486 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-11-04T04:52:03,488 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-11-04T04:52:03,490 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-11-04T04:52:03,492 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-11-04T04:52:03,493 copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-11-04T04:52:03,495 copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-11-04T04:52:03,497 copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-11-04T04:52:03,500 copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-11-04T04:52:03,502 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,503 copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,505 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,507 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,509 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,511 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,513 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-04T04:52:03,514 copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-04T04:52:03,516 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-04T04:52:03,518 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-04T04:52:03,519 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-04T04:52:03,521 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-04T04:52:03,523 copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-04T04:52:03,525 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,526 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,528 copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,530 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-11-04T04:52:03,531 copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-11-04T04:52:03,533 copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-11-04T04:52:03,535 copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-11-04T04:52:03,536 copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-11-04T04:52:03,538 copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,540 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,542 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,543 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,545 copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,548 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,550 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,551 copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,554 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,556 copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,557 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,559 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,562 copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,564 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:52:03,566 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-11-04T04:52:03,567 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-11-04T04:52:03,569 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-11-04T04:52:03,572 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2023-11-04T04:52:03,572 copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2023-11-04T04:52:03,574 copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2023-11-04T04:52:03,576 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-11-04T04:52:03,577 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-11-04T04:52:03,579 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-11-04T04:52:03,582 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:52:03,583 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:52:03,585 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:52:03,586 copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:52:03,589 copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:52:03,591 copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:52:03,593 copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:52:03,595 copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:52:03,597 copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:52:03,599 copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:52:03,601 copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:52:03,603 copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:52:03,606 copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:52:03,608 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:52:03,609 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:52:03,612 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:52:03,613 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:52:03,616 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:52:03,617 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:52:03,619 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:52:03,621 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:52:03,622 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:52:03,624 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:52:03,626 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:52:03,628 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:52:03,630 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:52:03,631 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:52:03,633 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:52:03,635 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:52:03,638 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:52:03,640 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:52:03,642 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:52:03,644 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:52:03,647 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-11-04T04:52:03,648 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-11-04T04:52:03,650 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-11-04T04:52:03,652 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-04T04:52:03,653 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-04T04:52:03,655 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-04T04:52:03,658 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:52:03,659 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:52:03,661 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:52:03,663 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:52:03,665 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:52:03,667 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-04T04:52:03,669 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-04T04:52:03,672 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-04T04:52:03,674 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-04T04:52:03,676 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-04T04:52:03,679 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-11-04T04:52:03,680 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-11-04T04:52:03,682 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-11-04T04:52:03,683 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-11-04T04:52:03,684 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-11-04T04:52:03,687 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:52:03,688 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:52:03,690 copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:52:03,693 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:52:03,695 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:52:03,697 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:52:03,699 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:52:03,701 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:52:03,703 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:52:03,705 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:52:03,707 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:52:03,709 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-04T04:52:03,710 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-04T04:52:03,712 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-04T04:52:03,714 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-04T04:52:03,715 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-04T04:52:03,717 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-04T04:52:03,719 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-04T04:52:03,721 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-04T04:52:03,723 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-04T04:52:03,724 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-04T04:52:03,726 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-04T04:52:03,728 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-04T04:52:03,730 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-04T04:52:03,732 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-04T04:52:03,734 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-04T04:52:03,737 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:52:03,737 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:52:03,741 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:52:03,742 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:52:03,744 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:52:03,746 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:52:03,749 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:52:03,751 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:52:03,753 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:52:03,756 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-04T04:52:03,759 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:52:03,760 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-11-04T04:52:03,761 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-11-04T04:52:03,763 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-11-04T04:52:03,765 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-11-04T04:52:03,767 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-11-04T04:52:03,769 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:52:03,770 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:52:03,773 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:52:03,775 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:52:03,777 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:52:03,779 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:52:03,781 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:52:03,783 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:52:03,785 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:52:03,788 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:52:03,791 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-11-04T04:52:03,792 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-11-04T04:52:03,794 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-11-04T04:52:03,796 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-11-04T04:52:03,798 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-11-04T04:52:03,800 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:52:03,802 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:52:03,805 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-04T04:52:03,805 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-04T04:52:03,807 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-04T04:52:03,810 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-04T04:52:03,813 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-04T04:52:03,815 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-04T04:52:03,818 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-04T04:52:03,821 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-11-04T04:52:03,822 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-11-04T04:52:03,824 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-11-04T04:52:03,827 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-11-04T04:52:03,829 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:52:03,831 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:52:03,834 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:52:03,835 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:52:03,839 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:52:03,843 copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:52:03,845 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:52:03,847 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:52:03,849 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:52:03,851 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:52:03,854 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:52:03,856 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:52:03,858 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:52:03,861 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:52:03,863 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:52:03,866 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:52:03,868 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:52:03,870 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:52:03,872 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:52:03,874 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:52:03,877 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:52:03,880 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:52:03,881 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:52:03,884 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-11-04T04:52:03,885 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-11-04T04:52:03,887 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-11-04T04:52:03,890 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:52:03,893 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:52:03,898 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:52:03,900 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:52:03,908 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:52:03,911 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-11-04T04:52:03,912 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-11-04T04:52:03,914 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-11-04T04:52:03,916 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-11-04T04:52:03,917 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-11-04T04:52:03,920 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-11-04T04:52:03,922 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-11-04T04:52:03,924 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-11-04T04:52:03,927 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-11-04T04:52:03,929 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-11-04T04:52:03,932 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:52:03,934 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-11-04T04:52:03,935 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-11-04T04:52:03,937 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-11-04T04:52:03,939 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:52:03,940 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:52:03,943 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:52:03,945 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:52:03,947 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:52:03,950 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:52:03,952 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-11-04T04:52:03,954 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:52:03,955 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:52:03,957 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:52:03,959 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:52:03,961 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:52:03,963 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:52:03,964 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-11-04T04:52:03,966 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:52:03,969 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:52:03,971 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-04T04:52:03,973 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-11-04T04:52:03,975 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:52:03,976 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:52:03,977 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:52:03,979 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:52:03,981 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:52:03,983 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:52:03,985 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:52:03,987 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:52:03,989 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:52:03,991 copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:52:03,993 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:52:03,995 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-11-04T04:52:03,997 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-11-04T04:52:03,997 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-11-04T04:52:03,999 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-11-04T04:52:04,001 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-11-04T04:52:04,004 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-11-04T04:52:04,005 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-11-04T04:52:04,007 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-11-04T04:52:04,010 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-11-04T04:52:04,011 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-11-04T04:52:04,013 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-04T04:52:04,014 copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-04T04:52:04,017 copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-04T04:52:04,019 copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-04T04:52:04,021 copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-04T04:52:04,024 copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-04T04:52:04,027 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:52:04,029 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-11-04T04:52:04,031 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-04T04:52:04,032 copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-04T04:52:04,034 copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-04T04:52:04,036 copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-04T04:52:04,038 copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-04T04:52:04,040 copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-04T04:52:04,043 copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-04T04:52:04,045 copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-04T04:52:04,047 copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-11-04T04:52:04,049 copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-11-04T04:52:04,051 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:52:04,053 copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:52:04,055 copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:52:04,057 copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:52:04,059 copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:52:04,060 copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:52:04,062 copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:52:04,064 copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:52:04,066 copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:52:04,069 copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-11-04T04:52:04,071 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2023-11-04T04:52:04,073 copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2023-11-04T04:52:04,075 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-11-04T04:52:04,076 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/cutlass_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-11-04T04:52:04,079 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-11-04T04:52:04,081 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-11-04T04:52:04,084 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:52:04,085 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:52:04,087 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:52:04,089 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:52:04,092 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/gate_fn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:52:04,094 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-04T04:52:04,095 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-04T04:52:04,097 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-04T04:52:04,100 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-04T04:52:04,102 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2023-11-04T04:52:04,103 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2023-11-04T04:52:04,105 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2023-11-04T04:52:04,108 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2023-11-04T04:52:04,109 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2023-11-04T04:52:04,112 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2023-11-04T04:52:04,115 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-04T04:52:04,116 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-04T04:52:04,118 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-04T04:52:04,121 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2023-11-04T04:52:04,122 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2023-11-04T04:52:04,124 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2023-11-04T04:52:04,126 copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-11-04T04:52:04,128 copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:52:04,131 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-04T04:52:04,132 copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-04T04:52:04,135 copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-04T04:52:04,138 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2023-11-04T04:52:04,139 copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2023-11-04T04:52:04,141 copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2023-11-04T04:52:04,143 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2023-11-04T04:52:04,144 copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2023-11-04T04:52:04,147 copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-04T04:52:04,149 copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-04T04:52:04,151 copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-04T04:52:04,154 copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-04T04:52:04,156 copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-04T04:52:04,159 copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:52:04,161 copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:52:04,163 copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:52:04,165 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2023-11-04T04:52:04,166 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2023-11-04T04:52:04,168 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:52:04,169 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:52:04,171 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:52:04,173 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:52:04,174 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:52:04,176 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:52:04,178 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:52:04,180 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:52:04,182 copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2023-11-04T04:52:04,183 copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2023-11-04T04:52:04,185 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:52:04,186 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:52:04,188 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:52:04,191 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:52:04,192 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:52:04,197 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:52:04,199 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:52:04,200 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:52:04,202 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:52:04,204 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:52:04,205 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:52:04,208 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:52:04,209 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:52:04,211 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:52:04,214 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:52:04,215 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:52:04,216 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:52:04,218 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:52:04,220 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:52:04,222 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:52:04,224 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:52:04,225 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:52:04,227 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:52:04,229 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:52:04,231 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:52:04,233 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:52:04,235 copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2023-11-04T04:52:04,237 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2023-11-04T04:52:04,238 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:52:04,239 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:52:04,241 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:52:04,242 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:52:04,244 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:52:04,246 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:52:04,248 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:52:04,249 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2023-11-04T04:52:04,251 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2023-11-04T04:52:04,253 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:52:04,254 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:52:04,256 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:52:04,259 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:52:04,260 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:52:04,262 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:52:04,264 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:52:04,266 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:52:04,267 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:52:04,269 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:52:04,271 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:52:04,273 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:52:04,274 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:52:04,276 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:52:04,278 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:52:04,279 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:52:04,281 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:52:04,282 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:52:04,284 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:52:04,286 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:52:04,288 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:52:04,290 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:52:04,291 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:52:04,294 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:52:04,295 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:52:04,297 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:52:04,299 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:52:04,301 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:52:04,303 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:52:04,304 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:52:04,306 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:52:04,308 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:52:04,310 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:52:04,311 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:52:04,313 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:52:04,315 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:52:04,318 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:52:04,320 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:52:04,321 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:52:04,322 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:52:04,324 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:52:04,326 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:52:04,328 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-04T04:52:04,329 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-04T04:52:04,331 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-04T04:52:04,333 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-04T04:52:04,335 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:52:04,336 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:52:04,338 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:52:04,340 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:52:04,342 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:52:04,343 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:52:04,345 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:52:04,346 copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2023-11-04T04:52:04,349 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-04T04:52:04,349 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-04T04:52:04,351 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:52:04,352 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:52:04,354 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:52:04,356 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:52:04,357 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:52:04,359 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:52:04,361 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-04T04:52:04,363 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-11-04T04:52:04,364 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-11-04T04:52:04,366 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:52:04,367 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:52:04,369 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:52:04,371 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:52:04,373 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:52:04,374 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:52:04,376 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:52:04,378 copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:52:04,380 copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:52:04,381 copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:52:04,384 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-11-04T04:52:04,384 copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-11-04T04:52:04,386 copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-11-04T04:52:04,388 copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-11-04T04:52:04,389 copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-11-04T04:52:04,391 copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:52:04,393 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-04T04:52:04,394 copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-04T04:52:04,397 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:52:04,398 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:52:04,400 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:52:04,402 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:52:04,403 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:52:04,405 copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-04T04:52:04,407 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:52:04,408 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:52:04,410 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:52:04,412 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:52:04,414 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:52:04,416 copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-04T04:52:04,418 copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-04T04:52:04,421 copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-04T04:52:04,423 copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-04T04:52:04,425 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:52:04,426 copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:52:04,428 copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:52:04,430 copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:52:04,431 copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:52:04,433 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:52:04,434 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:52:04,436 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:52:04,438 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:52:04,440 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:52:04,441 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:52:04,444 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:52:04,446 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:52:04,448 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:52:04,450 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:52:04,452 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:52:04,453 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:52:04,455 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:52:04,457 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:52:04,458 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:52:04,460 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:52:04,462 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:52:04,464 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:52:04,465 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:52:04,467 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:52:04,468 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-11-04T04:52:04,471 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-11-04T04:52:04,473 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-11-04T04:52:04,475 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-11-04T04:52:04,476 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-11-04T04:52:04,477 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-11-04T04:52:04,480 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-11-04T04:52:04,482 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-11-04T04:52:04,484 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-11-04T04:52:04,485 running install_egg_info 2023-11-04T04:52:04,518 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.12.1-py3.11.egg-info 2023-11-04T04:52:04,532 running install_scripts 2023-11-04T04:52:04,533 creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data 2023-11-04T04:52:04,533 creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data/scripts 2023-11-04T04:52:04,534 copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data/scripts 2023-11-04T04:52:04,536 copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data/scripts 2023-11-04T04:52:04,538 copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data/scripts 2023-11-04T04:52:04,540 copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data/scripts 2023-11-04T04:52:04,542 copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data/scripts 2023-11-04T04:52:04,543 copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data/scripts 2023-11-04T04:52:04,545 copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data/scripts 2023-11-04T04:52:04,547 copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data/scripts 2023-11-04T04:52:04,548 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data/scripts/ds_bench to 755 2023-11-04T04:52:04,549 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data/scripts/deepspeed to 755 2023-11-04T04:52:04,549 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data/scripts/deepspeed.pt to 755 2023-11-04T04:52:04,550 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data/scripts/ds_elastic to 755 2023-11-04T04:52:04,551 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data/scripts/dsr to 755 2023-11-04T04:52:04,551 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data/scripts/ds to 755 2023-11-04T04:52:04,551 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data/scripts/ds_report to 755 2023-11-04T04:52:04,552 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.data/scripts/ds_ssh to 755 2023-11-04T04:52:04,595 creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.1.dist-info/WHEEL 2023-11-04T04:52:04,597 creating '/tmp/pip-wheel-knxzdfpz/deepspeed-0.12.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-11-04T04:52:04,600 adding 'deepspeed/__init__.py' 2023-11-04T04:52:04,602 adding 'deepspeed/constants.py' 2023-11-04T04:52:04,603 adding 'deepspeed/env_report.py' 2023-11-04T04:52:04,604 adding 'deepspeed/git_version_info.py' 2023-11-04T04:52:04,606 adding 'deepspeed/git_version_info_installed.py' 2023-11-04T04:52:04,607 adding 'deepspeed/pydantic_v1.py' 2023-11-04T04:52:04,609 adding 'deepspeed/accelerator/__init__.py' 2023-11-04T04:52:04,610 adding 'deepspeed/accelerator/abstract_accelerator.py' 2023-11-04T04:52:04,612 adding 'deepspeed/accelerator/cpu_accelerator.py' 2023-11-04T04:52:04,614 adding 'deepspeed/accelerator/cuda_accelerator.py' 2023-11-04T04:52:04,615 adding 'deepspeed/accelerator/mps_accelerator.py' 2023-11-04T04:52:04,617 adding 'deepspeed/accelerator/npu_accelerator.py' 2023-11-04T04:52:04,619 adding 'deepspeed/accelerator/real_accelerator.py' 2023-11-04T04:52:04,620 adding 'deepspeed/autotuning/__init__.py' 2023-11-04T04:52:04,626 adding 'deepspeed/autotuning/autotuner.py' 2023-11-04T04:52:04,627 adding 'deepspeed/autotuning/config.py' 2023-11-04T04:52:04,629 adding 'deepspeed/autotuning/constants.py' 2023-11-04T04:52:04,631 adding 'deepspeed/autotuning/scheduler.py' 2023-11-04T04:52:04,633 adding 'deepspeed/autotuning/utils.py' 2023-11-04T04:52:04,635 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2023-11-04T04:52:04,636 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2023-11-04T04:52:04,637 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2023-11-04T04:52:04,639 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2023-11-04T04:52:04,640 adding 'deepspeed/autotuning/tuner/__init__.py' 2023-11-04T04:52:04,641 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2023-11-04T04:52:04,643 adding 'deepspeed/autotuning/tuner/cost_model.py' 2023-11-04T04:52:04,644 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2023-11-04T04:52:04,645 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2023-11-04T04:52:04,647 adding 'deepspeed/autotuning/tuner/utils.py' 2023-11-04T04:52:04,649 adding 'deepspeed/checkpoint/__init__.py' 2023-11-04T04:52:04,650 adding 'deepspeed/checkpoint/constants.py' 2023-11-04T04:52:04,653 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2023-11-04T04:52:04,655 adding 'deepspeed/checkpoint/ds_to_universal.py' 2023-11-04T04:52:04,656 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2023-11-04T04:52:04,658 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2023-11-04T04:52:04,660 adding 'deepspeed/checkpoint/reshape_utils.py' 2023-11-04T04:52:04,661 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2023-11-04T04:52:04,663 adding 'deepspeed/checkpoint/utils.py' 2023-11-04T04:52:04,664 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2023-11-04T04:52:04,666 adding 'deepspeed/comm/__init__.py' 2023-11-04T04:52:04,667 adding 'deepspeed/comm/backend.py' 2023-11-04T04:52:04,669 adding 'deepspeed/comm/ccl.py' 2023-11-04T04:52:04,672 adding 'deepspeed/comm/comm.py' 2023-11-04T04:52:04,673 adding 'deepspeed/comm/config.py' 2023-11-04T04:52:04,675 adding 'deepspeed/comm/constants.py' 2023-11-04T04:52:04,676 adding 'deepspeed/comm/reduce_op.py' 2023-11-04T04:52:04,678 adding 'deepspeed/comm/torch.py' 2023-11-04T04:52:04,679 adding 'deepspeed/comm/utils.py' 2023-11-04T04:52:04,681 adding 'deepspeed/compression/__init__.py' 2023-11-04T04:52:04,684 adding 'deepspeed/compression/basic_layer.py' 2023-11-04T04:52:04,686 adding 'deepspeed/compression/compress.py' 2023-11-04T04:52:04,688 adding 'deepspeed/compression/config.py' 2023-11-04T04:52:04,689 adding 'deepspeed/compression/constants.py' 2023-11-04T04:52:04,691 adding 'deepspeed/compression/helper.py' 2023-11-04T04:52:04,693 adding 'deepspeed/compression/scheduler.py' 2023-11-04T04:52:04,694 adding 'deepspeed/compression/utils.py' 2023-11-04T04:52:04,696 adding 'deepspeed/elasticity/__init__.py' 2023-11-04T04:52:04,697 adding 'deepspeed/elasticity/config.py' 2023-11-04T04:52:04,699 adding 'deepspeed/elasticity/constants.py' 2023-11-04T04:52:04,700 adding 'deepspeed/elasticity/elastic_agent.py' 2023-11-04T04:52:04,702 adding 'deepspeed/elasticity/elasticity.py' 2023-11-04T04:52:04,703 adding 'deepspeed/elasticity/utils.py' 2023-11-04T04:52:04,705 adding 'deepspeed/inference/__init__.py' 2023-11-04T04:52:04,707 adding 'deepspeed/inference/config.py' 2023-11-04T04:52:04,710 adding 'deepspeed/inference/engine.py' 2023-11-04T04:52:04,712 adding 'deepspeed/inference/quantization/__init__.py' 2023-11-04T04:52:04,713 adding 'deepspeed/inference/quantization/layers.py' 2023-11-04T04:52:04,715 adding 'deepspeed/inference/quantization/quantization.py' 2023-11-04T04:52:04,716 adding 'deepspeed/inference/quantization/quantization_context.py' 2023-11-04T04:52:04,718 adding 'deepspeed/inference/quantization/utils.py' 2023-11-04T04:52:04,720 adding 'deepspeed/inference/v2/__init__.py' 2023-11-04T04:52:04,721 adding 'deepspeed/inference/v2/allocator.py' 2023-11-04T04:52:04,722 adding 'deepspeed/inference/v2/config_v2.py' 2023-11-04T04:52:04,723 adding 'deepspeed/inference/v2/engine_factory.py' 2023-11-04T04:52:04,725 adding 'deepspeed/inference/v2/engine_v2.py' 2023-11-04T04:52:04,726 adding 'deepspeed/inference/v2/inference_utils.py' 2023-11-04T04:52:04,727 adding 'deepspeed/inference/v2/logging.py' 2023-11-04T04:52:04,728 adding 'deepspeed/inference/v2/scheduling_utils.py' 2023-11-04T04:52:04,730 adding 'deepspeed/inference/v2/checkpoint/__init__.py' 2023-11-04T04:52:04,732 adding 'deepspeed/inference/v2/checkpoint/base_engine.py' 2023-11-04T04:52:04,733 adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py' 2023-11-04T04:52:04,734 adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py' 2023-11-04T04:52:04,736 adding 'deepspeed/inference/v2/kernels/__init__.py' 2023-11-04T04:52:04,737 adding 'deepspeed/inference/v2/kernels/ds_kernel.py' 2023-11-04T04:52:04,739 adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py' 2023-11-04T04:52:04,740 adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp' 2023-11-04T04:52:04,742 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py' 2023-11-04T04:52:04,743 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp' 2023-11-04T04:52:04,745 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu' 2023-11-04T04:52:04,746 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h' 2023-11-04T04:52:04,747 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py' 2023-11-04T04:52:04,749 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py' 2023-11-04T04:52:04,750 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h' 2023-11-04T04:52:04,752 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py' 2023-11-04T04:52:04,753 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h' 2023-11-04T04:52:04,755 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py' 2023-11-04T04:52:04,756 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py' 2023-11-04T04:52:04,758 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py' 2023-11-04T04:52:04,759 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py' 2023-11-04T04:52:04,760 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py' 2023-11-04T04:52:04,762 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp' 2023-11-04T04:52:04,764 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu' 2023-11-04T04:52:04,765 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h' 2023-11-04T04:52:04,767 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py' 2023-11-04T04:52:04,768 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp' 2023-11-04T04:52:04,770 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu' 2023-11-04T04:52:04,771 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h' 2023-11-04T04:52:04,772 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py' 2023-11-04T04:52:04,773 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py' 2023-11-04T04:52:04,775 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py' 2023-11-04T04:52:04,776 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py' 2023-11-04T04:52:04,777 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py' 2023-11-04T04:52:04,779 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp' 2023-11-04T04:52:04,780 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu' 2023-11-04T04:52:04,781 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h' 2023-11-04T04:52:04,783 adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py' 2023-11-04T04:52:04,784 adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp' 2023-11-04T04:52:04,786 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py' 2023-11-04T04:52:04,787 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu' 2023-11-04T04:52:04,788 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h' 2023-11-04T04:52:04,790 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py' 2023-11-04T04:52:04,791 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h' 2023-11-04T04:52:04,793 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py' 2023-11-04T04:52:04,794 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py' 2023-11-04T04:52:04,795 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu' 2023-11-04T04:52:04,797 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h' 2023-11-04T04:52:04,798 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py' 2023-11-04T04:52:04,800 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h' 2023-11-04T04:52:04,801 adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h' 2023-11-04T04:52:04,803 adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py' 2023-11-04T04:52:04,804 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp' 2023-11-04T04:52:04,806 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py' 2023-11-04T04:52:04,807 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp' 2023-11-04T04:52:04,809 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h' 2023-11-04T04:52:04,810 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py' 2023-11-04T04:52:04,813 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py' 2023-11-04T04:52:04,814 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h' 2023-11-04T04:52:04,815 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp' 2023-11-04T04:52:04,816 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h' 2023-11-04T04:52:04,818 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py' 2023-11-04T04:52:04,819 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h' 2023-11-04T04:52:04,821 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py' 2023-11-04T04:52:04,822 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp' 2023-11-04T04:52:04,824 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu' 2023-11-04T04:52:04,825 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh' 2023-11-04T04:52:04,826 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h' 2023-11-04T04:52:04,828 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py' 2023-11-04T04:52:04,829 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py' 2023-11-04T04:52:04,831 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp' 2023-11-04T04:52:04,833 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu' 2023-11-04T04:52:04,834 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh' 2023-11-04T04:52:04,835 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h' 2023-11-04T04:52:04,836 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py' 2023-11-04T04:52:04,838 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py' 2023-11-04T04:52:04,839 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py' 2023-11-04T04:52:04,841 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py' 2023-11-04T04:52:04,842 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp' 2023-11-04T04:52:04,843 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu' 2023-11-04T04:52:04,844 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh' 2023-11-04T04:52:04,845 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h' 2023-11-04T04:52:04,847 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py' 2023-11-04T04:52:04,849 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py' 2023-11-04T04:52:04,850 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp' 2023-11-04T04:52:04,851 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu' 2023-11-04T04:52:04,852 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh' 2023-11-04T04:52:04,854 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h' 2023-11-04T04:52:04,855 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py' 2023-11-04T04:52:04,857 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py' 2023-11-04T04:52:04,858 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp' 2023-11-04T04:52:04,860 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu' 2023-11-04T04:52:04,861 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh' 2023-11-04T04:52:04,862 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h' 2023-11-04T04:52:04,863 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py' 2023-11-04T04:52:04,865 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h' 2023-11-04T04:52:04,866 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp' 2023-11-04T04:52:04,868 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h' 2023-11-04T04:52:04,869 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py' 2023-11-04T04:52:04,871 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp' 2023-11-04T04:52:04,872 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu' 2023-11-04T04:52:04,873 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh' 2023-11-04T04:52:04,874 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h' 2023-11-04T04:52:04,876 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py' 2023-11-04T04:52:04,878 adding 'deepspeed/inference/v2/model_implementations/__init__.py' 2023-11-04T04:52:04,879 adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py' 2023-11-04T04:52:04,881 adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py' 2023-11-04T04:52:04,884 adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py' 2023-11-04T04:52:04,886 adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py' 2023-11-04T04:52:04,888 adding 'deepspeed/inference/v2/model_implementations/parameter_base.py' 2023-11-04T04:52:04,890 adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py' 2023-11-04T04:52:04,891 adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py' 2023-11-04T04:52:04,892 adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py' 2023-11-04T04:52:04,893 adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py' 2023-11-04T04:52:04,895 adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py' 2023-11-04T04:52:04,896 adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py' 2023-11-04T04:52:04,897 adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py' 2023-11-04T04:52:04,898 adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py' 2023-11-04T04:52:04,899 adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py' 2023-11-04T04:52:04,901 adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py' 2023-11-04T04:52:04,902 adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py' 2023-11-04T04:52:04,904 adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py' 2023-11-04T04:52:04,905 adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py' 2023-11-04T04:52:04,907 adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py' 2023-11-04T04:52:04,908 adding 'deepspeed/inference/v2/model_implementations/mistral/container.py' 2023-11-04T04:52:04,910 adding 'deepspeed/inference/v2/model_implementations/mistral/model.py' 2023-11-04T04:52:04,911 adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py' 2023-11-04T04:52:04,913 adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py' 2023-11-04T04:52:04,914 adding 'deepspeed/inference/v2/model_implementations/opt/container.py' 2023-11-04T04:52:04,916 adding 'deepspeed/inference/v2/model_implementations/opt/model.py' 2023-11-04T04:52:04,917 adding 'deepspeed/inference/v2/model_implementations/opt/policy.py' 2023-11-04T04:52:04,919 adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py' 2023-11-04T04:52:04,920 adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py' 2023-11-04T04:52:04,921 adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py' 2023-11-04T04:52:04,923 adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py' 2023-11-04T04:52:04,924 adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py' 2023-11-04T04:52:04,926 adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py' 2023-11-04T04:52:04,927 adding 'deepspeed/inference/v2/model_implementations/sharding/types.py' 2023-11-04T04:52:04,928 adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py' 2023-11-04T04:52:04,929 adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py' 2023-11-04T04:52:04,931 adding 'deepspeed/inference/v2/modules/__init__.py' 2023-11-04T04:52:04,932 adding 'deepspeed/inference/v2/modules/ds_module.py' 2023-11-04T04:52:04,934 adding 'deepspeed/inference/v2/modules/heuristics.py' 2023-11-04T04:52:04,935 adding 'deepspeed/inference/v2/modules/module_registry.py' 2023-11-04T04:52:04,937 adding 'deepspeed/inference/v2/modules/configs/__init__.py' 2023-11-04T04:52:04,938 adding 'deepspeed/inference/v2/modules/configs/attention_configs.py' 2023-11-04T04:52:04,939 adding 'deepspeed/inference/v2/modules/configs/embedding_config.py' 2023-11-04T04:52:04,940 adding 'deepspeed/inference/v2/modules/configs/linear_config.py' 2023-11-04T04:52:04,941 adding 'deepspeed/inference/v2/modules/configs/moe_config.py' 2023-11-04T04:52:04,943 adding 'deepspeed/inference/v2/modules/configs/norm_config.py' 2023-11-04T04:52:04,944 adding 'deepspeed/inference/v2/modules/configs/unembed_config.py' 2023-11-04T04:52:04,945 adding 'deepspeed/inference/v2/modules/implementations/__init__.py' 2023-11-04T04:52:04,947 adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py' 2023-11-04T04:52:04,948 adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py' 2023-11-04T04:52:04,950 adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py' 2023-11-04T04:52:04,951 adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py' 2023-11-04T04:52:04,953 adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py' 2023-11-04T04:52:04,955 adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py' 2023-11-04T04:52:04,956 adding 'deepspeed/inference/v2/modules/implementations/linear/cutlass_fp_linear.py' 2023-11-04T04:52:04,958 adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py' 2023-11-04T04:52:04,959 adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py' 2023-11-04T04:52:04,961 adding 'deepspeed/inference/v2/modules/implementations/moe/gate_fn.py' 2023-11-04T04:52:04,962 adding 'deepspeed/inference/v2/modules/implementations/moe/test.py' 2023-11-04T04:52:04,963 adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py' 2023-11-04T04:52:04,965 adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py' 2023-11-04T04:52:04,966 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py' 2023-11-04T04:52:04,968 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py' 2023-11-04T04:52:04,969 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py' 2023-11-04T04:52:04,971 adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py' 2023-11-04T04:52:04,972 adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py' 2023-11-04T04:52:04,974 adding 'deepspeed/inference/v2/modules/interfaces/__init__.py' 2023-11-04T04:52:04,975 adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py' 2023-11-04T04:52:04,977 adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py' 2023-11-04T04:52:04,978 adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py' 2023-11-04T04:52:04,979 adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py' 2023-11-04T04:52:04,980 adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py' 2023-11-04T04:52:04,982 adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py' 2023-11-04T04:52:04,983 adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py' 2023-11-04T04:52:04,985 adding 'deepspeed/inference/v2/ragged/__init__.py' 2023-11-04T04:52:04,986 adding 'deepspeed/inference/v2/ragged/blocked_allocator.py' 2023-11-04T04:52:04,987 adding 'deepspeed/inference/v2/ragged/kv_cache.py' 2023-11-04T04:52:04,989 adding 'deepspeed/inference/v2/ragged/manager_configs.py' 2023-11-04T04:52:04,991 adding 'deepspeed/inference/v2/ragged/ragged_manager.py' 2023-11-04T04:52:04,993 adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py' 2023-11-04T04:52:04,994 adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py' 2023-11-04T04:52:04,996 adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu' 2023-11-04T04:52:04,997 adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp' 2023-11-04T04:52:04,998 adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h' 2023-11-04T04:52:05,000 adding 'deepspeed/launcher/__init__.py' 2023-11-04T04:52:05,001 adding 'deepspeed/launcher/constants.py' 2023-11-04T04:52:05,003 adding 'deepspeed/launcher/launch.py' 2023-11-04T04:52:05,005 adding 'deepspeed/launcher/multinode_runner.py' 2023-11-04T04:52:05,008 adding 'deepspeed/launcher/runner.py' 2023-11-04T04:52:05,010 adding 'deepspeed/model_implementations/__init__.py' 2023-11-04T04:52:05,011 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2023-11-04T04:52:05,013 adding 'deepspeed/model_implementations/diffusers/unet.py' 2023-11-04T04:52:05,014 adding 'deepspeed/model_implementations/diffusers/vae.py' 2023-11-04T04:52:05,016 adding 'deepspeed/model_implementations/features/__init__.py' 2023-11-04T04:52:05,017 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2023-11-04T04:52:05,018 adding 'deepspeed/model_implementations/transformers/__init__.py' 2023-11-04T04:52:05,020 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2023-11-04T04:52:05,021 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2023-11-04T04:52:05,022 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2023-11-04T04:52:05,023 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2023-11-04T04:52:05,024 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2023-11-04T04:52:05,026 adding 'deepspeed/model_implementations/transformers/ds_llama2.py' 2023-11-04T04:52:05,027 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2023-11-04T04:52:05,028 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2023-11-04T04:52:05,030 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2023-11-04T04:52:05,031 adding 'deepspeed/module_inject/__init__.py' 2023-11-04T04:52:05,034 adding 'deepspeed/module_inject/auto_tp.py' 2023-11-04T04:52:05,036 adding 'deepspeed/module_inject/auto_tp_model_utils.py' 2023-11-04T04:52:05,037 adding 'deepspeed/module_inject/fusedqkv_utils.py' 2023-11-04T04:52:05,038 adding 'deepspeed/module_inject/inject.py' 2023-11-04T04:52:05,040 adding 'deepspeed/module_inject/layers.py' 2023-11-04T04:52:05,042 adding 'deepspeed/module_inject/load_checkpoint.py' 2023-11-04T04:52:05,043 adding 'deepspeed/module_inject/module_quantize.py' 2023-11-04T04:52:05,045 adding 'deepspeed/module_inject/policy.py' 2023-11-04T04:52:05,048 adding 'deepspeed/module_inject/replace_module.py' 2023-11-04T04:52:05,049 adding 'deepspeed/module_inject/replace_policy.py' 2023-11-04T04:52:05,051 adding 'deepspeed/module_inject/tp_shard.py' 2023-11-04T04:52:05,052 adding 'deepspeed/module_inject/utils.py' 2023-11-04T04:52:05,054 adding 'deepspeed/module_inject/containers/__init__.py' 2023-11-04T04:52:05,056 adding 'deepspeed/module_inject/containers/base.py' 2023-11-04T04:52:05,058 adding 'deepspeed/module_inject/containers/base_moe.py' 2023-11-04T04:52:05,059 adding 'deepspeed/module_inject/containers/bert.py' 2023-11-04T04:52:05,060 adding 'deepspeed/module_inject/containers/bloom.py' 2023-11-04T04:52:05,062 adding 'deepspeed/module_inject/containers/clip.py' 2023-11-04T04:52:05,063 adding 'deepspeed/module_inject/containers/distil_bert.py' 2023-11-04T04:52:05,064 adding 'deepspeed/module_inject/containers/gpt2.py' 2023-11-04T04:52:05,066 adding 'deepspeed/module_inject/containers/gptj.py' 2023-11-04T04:52:05,067 adding 'deepspeed/module_inject/containers/gptneo.py' 2023-11-04T04:52:05,068 adding 'deepspeed/module_inject/containers/gptneox.py' 2023-11-04T04:52:05,070 adding 'deepspeed/module_inject/containers/internlm.py' 2023-11-04T04:52:05,071 adding 'deepspeed/module_inject/containers/llama.py' 2023-11-04T04:52:05,073 adding 'deepspeed/module_inject/containers/llama2.py' 2023-11-04T04:52:05,074 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2023-11-04T04:52:05,075 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2023-11-04T04:52:05,077 adding 'deepspeed/module_inject/containers/opt.py' 2023-11-04T04:52:05,078 adding 'deepspeed/module_inject/containers/unet.py' 2023-11-04T04:52:05,079 adding 'deepspeed/module_inject/containers/vae.py' 2023-11-04T04:52:05,081 adding 'deepspeed/module_inject/containers/features/__init__.py' 2023-11-04T04:52:05,082 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2023-11-04T04:52:05,084 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2023-11-04T04:52:05,085 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2023-11-04T04:52:05,086 adding 'deepspeed/module_inject/containers/features/megatron.py' 2023-11-04T04:52:05,088 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2023-11-04T04:52:05,089 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2023-11-04T04:52:05,091 adding 'deepspeed/moe/__init__.py' 2023-11-04T04:52:05,092 adding 'deepspeed/moe/experts.py' 2023-11-04T04:52:05,094 adding 'deepspeed/moe/layer.py' 2023-11-04T04:52:05,095 adding 'deepspeed/moe/mappings.py' 2023-11-04T04:52:05,098 adding 'deepspeed/moe/sharded_moe.py' 2023-11-04T04:52:05,099 adding 'deepspeed/moe/utils.py' 2023-11-04T04:52:05,101 adding 'deepspeed/monitor/__init__.py' 2023-11-04T04:52:05,102 adding 'deepspeed/monitor/config.py' 2023-11-04T04:52:05,104 adding 'deepspeed/monitor/csv_monitor.py' 2023-11-04T04:52:05,105 adding 'deepspeed/monitor/monitor.py' 2023-11-04T04:52:05,106 adding 'deepspeed/monitor/tensorboard.py' 2023-11-04T04:52:05,107 adding 'deepspeed/monitor/utils.py' 2023-11-04T04:52:05,109 adding 'deepspeed/monitor/wandb.py' 2023-11-04T04:52:05,110 adding 'deepspeed/nebula/__init__.py' 2023-11-04T04:52:05,111 adding 'deepspeed/nebula/config.py' 2023-11-04T04:52:05,113 adding 'deepspeed/nebula/constants.py' 2023-11-04T04:52:05,114 adding 'deepspeed/ops/__init__.py' 2023-11-04T04:52:05,116 adding 'deepspeed/ops/adagrad/__init__.py' 2023-11-04T04:52:05,117 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2023-11-04T04:52:05,119 adding 'deepspeed/ops/adam/__init__.py' 2023-11-04T04:52:05,121 adding 'deepspeed/ops/adam/cpu_adam.py' 2023-11-04T04:52:05,123 adding 'deepspeed/ops/adam/fused_adam.py' 2023-11-04T04:52:05,124 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2023-11-04T04:52:05,125 adding 'deepspeed/ops/aio/__init__.py' 2023-11-04T04:52:05,128 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2023-11-04T04:52:05,130 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2023-11-04T04:52:05,131 adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp' 2023-11-04T04:52:05,133 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2023-11-04T04:52:05,134 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2023-11-04T04:52:05,136 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2023-11-04T04:52:05,139 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2023-11-04T04:52:05,141 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2023-11-04T04:52:05,142 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2023-11-04T04:52:05,143 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2023-11-04T04:52:05,145 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2023-11-04T04:52:05,146 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2023-11-04T04:52:05,148 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2023-11-04T04:52:05,149 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2023-11-04T04:52:05,150 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2023-11-04T04:52:05,151 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2023-11-04T04:52:05,153 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2023-11-04T04:52:05,154 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2023-11-04T04:52:05,156 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2023-11-04T04:52:05,157 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2023-11-04T04:52:05,158 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2023-11-04T04:52:05,160 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2023-11-04T04:52:05,161 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2023-11-04T04:52:05,162 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2023-11-04T04:52:05,164 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2023-11-04T04:52:05,166 adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp' 2023-11-04T04:52:05,169 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2023-11-04T04:52:05,171 adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp' 2023-11-04T04:52:05,173 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp' 2023-11-04T04:52:05,175 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu' 2023-11-04T04:52:05,177 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu' 2023-11-04T04:52:05,179 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h' 2023-11-04T04:52:05,186 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h' 2023-11-04T04:52:05,192 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h' 2023-11-04T04:52:05,194 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h' 2023-11-04T04:52:05,197 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h' 2023-11-04T04:52:05,198 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h' 2023-11-04T04:52:05,200 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h' 2023-11-04T04:52:05,202 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h' 2023-11-04T04:52:05,204 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h' 2023-11-04T04:52:05,207 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h' 2023-11-04T04:52:05,209 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h' 2023-11-04T04:52:05,211 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h' 2023-11-04T04:52:05,213 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h' 2023-11-04T04:52:05,220 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h' 2023-11-04T04:52:05,224 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h' 2023-11-04T04:52:05,225 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h' 2023-11-04T04:52:05,230 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h' 2023-11-04T04:52:05,233 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h' 2023-11-04T04:52:05,237 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h' 2023-11-04T04:52:05,239 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h' 2023-11-04T04:52:05,241 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h' 2023-11-04T04:52:05,243 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h' 2023-11-04T04:52:05,244 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h' 2023-11-04T04:52:05,246 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2023-11-04T04:52:05,248 adding 'deepspeed/ops/csrc/includes/Timer.h' 2023-11-04T04:52:05,249 adding 'deepspeed/ops/csrc/includes/activation_type.h' 2023-11-04T04:52:05,250 adding 'deepspeed/ops/csrc/includes/compat.h' 2023-11-04T04:52:05,251 adding 'deepspeed/ops/csrc/includes/context.h' 2023-11-04T04:52:05,253 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2023-11-04T04:52:05,254 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2023-11-04T04:52:05,256 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2023-11-04T04:52:05,258 adding 'deepspeed/ops/csrc/includes/cpu_lion.h' 2023-11-04T04:52:05,259 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2023-11-04T04:52:05,261 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2023-11-04T04:52:05,262 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2023-11-04T04:52:05,263 adding 'deepspeed/ops/csrc/includes/dropout.h' 2023-11-04T04:52:05,265 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2023-11-04T04:52:05,266 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2023-11-04T04:52:05,267 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2023-11-04T04:52:05,269 adding 'deepspeed/ops/csrc/includes/gelu.h' 2023-11-04T04:52:05,270 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2023-11-04T04:52:05,271 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2023-11-04T04:52:05,274 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2023-11-04T04:52:05,275 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2023-11-04T04:52:05,277 adding 'deepspeed/ops/csrc/includes/quantization.h' 2023-11-04T04:52:05,279 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2023-11-04T04:52:05,280 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2023-11-04T04:52:05,282 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2023-11-04T04:52:05,284 adding 'deepspeed/ops/csrc/includes/simd.h' 2023-11-04T04:52:05,285 adding 'deepspeed/ops/csrc/includes/softmax.h' 2023-11-04T04:52:05,287 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2023-11-04T04:52:05,288 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2023-11-04T04:52:05,290 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2023-11-04T04:52:05,292 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2023-11-04T04:52:05,294 adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp' 2023-11-04T04:52:05,296 adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp' 2023-11-04T04:52:05,297 adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp' 2023-11-04T04:52:05,299 adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh' 2023-11-04T04:52:05,300 adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu' 2023-11-04T04:52:05,302 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2023-11-04T04:52:05,305 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2023-11-04T04:52:05,307 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2023-11-04T04:52:05,309 adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu' 2023-11-04T04:52:05,311 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2023-11-04T04:52:05,312 adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu' 2023-11-04T04:52:05,314 adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu' 2023-11-04T04:52:05,316 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2023-11-04T04:52:05,317 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2023-11-04T04:52:05,319 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2023-11-04T04:52:05,320 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2023-11-04T04:52:05,322 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2023-11-04T04:52:05,324 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2023-11-04T04:52:05,326 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2023-11-04T04:52:05,327 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2023-11-04T04:52:05,329 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2023-11-04T04:52:05,332 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2023-11-04T04:52:05,336 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2023-11-04T04:52:05,338 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2023-11-04T04:52:05,340 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2023-11-04T04:52:05,344 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2023-11-04T04:52:05,347 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2023-11-04T04:52:05,349 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2023-11-04T04:52:05,352 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2023-11-04T04:52:05,353 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2023-11-04T04:52:05,356 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2023-11-04T04:52:05,358 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2023-11-04T04:52:05,360 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2023-11-04T04:52:05,365 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2023-11-04T04:52:05,368 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2023-11-04T04:52:05,369 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2023-11-04T04:52:05,372 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2023-11-04T04:52:05,375 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2023-11-04T04:52:05,377 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2023-11-04T04:52:05,379 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2023-11-04T04:52:05,381 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2023-11-04T04:52:05,383 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2023-11-04T04:52:05,384 adding 'deepspeed/ops/deepspeed4science/__init__.py' 2023-11-04T04:52:05,386 adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py' 2023-11-04T04:52:05,387 adding 'deepspeed/ops/lamb/__init__.py' 2023-11-04T04:52:05,389 adding 'deepspeed/ops/lamb/fused_lamb.py' 2023-11-04T04:52:05,391 adding 'deepspeed/ops/lion/__init__.py' 2023-11-04T04:52:05,392 adding 'deepspeed/ops/lion/cpu_lion.py' 2023-11-04T04:52:05,394 adding 'deepspeed/ops/lion/fused_lion.py' 2023-11-04T04:52:05,395 adding 'deepspeed/ops/lion/multi_tensor_apply.py' 2023-11-04T04:52:05,397 adding 'deepspeed/ops/op_builder/__init__.py' 2023-11-04T04:52:05,399 adding 'deepspeed/ops/op_builder/all_ops.py' 2023-11-04T04:52:05,400 adding 'deepspeed/ops/op_builder/async_io.py' 2023-11-04T04:52:05,404 adding 'deepspeed/ops/op_builder/builder.py' 2023-11-04T04:52:05,405 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2023-11-04T04:52:05,407 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2023-11-04T04:52:05,408 adding 'deepspeed/ops/op_builder/cpu_lion.py' 2023-11-04T04:52:05,409 adding 'deepspeed/ops/op_builder/evoformer_attn.py' 2023-11-04T04:52:05,411 adding 'deepspeed/ops/op_builder/fused_adam.py' 2023-11-04T04:52:05,412 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2023-11-04T04:52:05,413 adding 'deepspeed/ops/op_builder/fused_lion.py' 2023-11-04T04:52:05,415 adding 'deepspeed/ops/op_builder/inference_core_ops.py' 2023-11-04T04:52:05,416 adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py' 2023-11-04T04:52:05,418 adding 'deepspeed/ops/op_builder/quantizer.py' 2023-11-04T04:52:05,419 adding 'deepspeed/ops/op_builder/ragged_ops.py' 2023-11-04T04:52:05,421 adding 'deepspeed/ops/op_builder/ragged_utils.py' 2023-11-04T04:52:05,422 adding 'deepspeed/ops/op_builder/random_ltd.py' 2023-11-04T04:52:05,423 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2023-11-04T04:52:05,424 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2023-11-04T04:52:05,426 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2023-11-04T04:52:05,427 adding 'deepspeed/ops/op_builder/transformer.py' 2023-11-04T04:52:05,428 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2023-11-04T04:52:05,430 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2023-11-04T04:52:05,431 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2023-11-04T04:52:05,432 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2023-11-04T04:52:05,433 adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py' 2023-11-04T04:52:05,435 adding 'deepspeed/ops/op_builder/cpu/fused_adam.py' 2023-11-04T04:52:05,436 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2023-11-04T04:52:05,437 adding 'deepspeed/ops/op_builder/npu/__init__.py' 2023-11-04T04:52:05,438 adding 'deepspeed/ops/op_builder/npu/builder.py' 2023-11-04T04:52:05,440 adding 'deepspeed/ops/op_builder/npu/fused_adam.py' 2023-11-04T04:52:05,441 adding 'deepspeed/ops/op_builder/npu/no_impl.py' 2023-11-04T04:52:05,442 adding 'deepspeed/ops/quantizer/__init__.py' 2023-11-04T04:52:05,444 adding 'deepspeed/ops/quantizer/quantizer.py' 2023-11-04T04:52:05,445 adding 'deepspeed/ops/random_ltd/__init__.py' 2023-11-04T04:52:05,447 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2023-11-04T04:52:05,448 adding 'deepspeed/ops/sparse_attention/__init__.py' 2023-11-04T04:52:05,450 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2023-11-04T04:52:05,453 adding 'deepspeed/ops/sparse_attention/matmul.py' 2023-11-04T04:52:05,456 adding 'deepspeed/ops/sparse_attention/softmax.py' 2023-11-04T04:52:05,458 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2023-11-04T04:52:05,459 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2023-11-04T04:52:05,462 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2023-11-04T04:52:05,465 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2023-11-04T04:52:05,466 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2023-11-04T04:52:05,468 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2023-11-04T04:52:05,469 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2023-11-04T04:52:05,471 adding 'deepspeed/ops/transformer/__init__.py' 2023-11-04T04:52:05,473 adding 'deepspeed/ops/transformer/transformer.py' 2023-11-04T04:52:05,475 adding 'deepspeed/ops/transformer/inference/__init__.py' 2023-11-04T04:52:05,476 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2023-11-04T04:52:05,478 adding 'deepspeed/ops/transformer/inference/config.py' 2023-11-04T04:52:05,479 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2023-11-04T04:52:05,481 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2023-11-04T04:52:05,483 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2023-11-04T04:52:05,485 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2023-11-04T04:52:05,487 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2023-11-04T04:52:05,489 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2023-11-04T04:52:05,491 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2023-11-04T04:52:05,493 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2023-11-04T04:52:05,494 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2023-11-04T04:52:05,495 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2023-11-04T04:52:05,497 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2023-11-04T04:52:05,498 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2023-11-04T04:52:05,500 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2023-11-04T04:52:05,501 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2023-11-04T04:52:05,502 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2023-11-04T04:52:05,504 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2023-11-04T04:52:05,505 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2023-11-04T04:52:05,507 adding 'deepspeed/ops/transformer/inference/triton/__init__.py' 2023-11-04T04:52:05,509 adding 'deepspeed/ops/transformer/inference/triton/attention.py' 2023-11-04T04:52:05,510 adding 'deepspeed/ops/transformer/inference/triton/gelu.py' 2023-11-04T04:52:05,512 adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py' 2023-11-04T04:52:05,514 adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py' 2023-11-04T04:52:05,515 adding 'deepspeed/ops/transformer/inference/triton/mlp.py' 2023-11-04T04:52:05,516 adding 'deepspeed/ops/transformer/inference/triton/ops.py' 2023-11-04T04:52:05,518 adding 'deepspeed/ops/transformer/inference/triton/residual_add.py' 2023-11-04T04:52:05,519 adding 'deepspeed/ops/transformer/inference/triton/softmax.py' 2023-11-04T04:52:05,521 adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py' 2023-11-04T04:52:05,523 adding 'deepspeed/pipe/__init__.py' 2023-11-04T04:52:05,524 adding 'deepspeed/profiling/__init__.py' 2023-11-04T04:52:05,525 adding 'deepspeed/profiling/config.py' 2023-11-04T04:52:05,526 adding 'deepspeed/profiling/constants.py' 2023-11-04T04:52:05,528 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2023-11-04T04:52:05,533 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2023-11-04T04:52:05,535 adding 'deepspeed/runtime/__init__.py' 2023-11-04T04:52:05,538 adding 'deepspeed/runtime/bf16_optimizer.py' 2023-11-04T04:52:05,542 adding 'deepspeed/runtime/config.py' 2023-11-04T04:52:05,544 adding 'deepspeed/runtime/config_utils.py' 2023-11-04T04:52:05,546 adding 'deepspeed/runtime/constants.py' 2023-11-04T04:52:05,547 adding 'deepspeed/runtime/dataloader.py' 2023-11-04T04:52:05,549 adding 'deepspeed/runtime/eigenvalue.py' 2023-11-04T04:52:05,566 adding 'deepspeed/runtime/engine.py' 2023-11-04T04:52:05,570 adding 'deepspeed/runtime/hybrid_engine.py' 2023-11-04T04:52:05,573 adding 'deepspeed/runtime/lr_schedules.py' 2023-11-04T04:52:05,575 adding 'deepspeed/runtime/progressive_layer_drop.py' 2023-11-04T04:52:05,576 adding 'deepspeed/runtime/quantize.py' 2023-11-04T04:52:05,578 adding 'deepspeed/runtime/sparse_tensor.py' 2023-11-04T04:52:05,580 adding 'deepspeed/runtime/state_dict_factory.py' 2023-11-04T04:52:05,584 adding 'deepspeed/runtime/utils.py' 2023-11-04T04:52:05,586 adding 'deepspeed/runtime/weight_quantizer.py' 2023-11-04T04:52:05,588 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2023-11-04T04:52:05,592 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2023-11-04T04:52:05,594 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2023-11-04T04:52:05,596 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2023-11-04T04:52:05,597 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2023-11-04T04:52:05,598 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2023-11-04T04:52:05,600 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2023-11-04T04:52:05,601 adding 'deepspeed/runtime/comm/__init__.py' 2023-11-04T04:52:05,603 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2023-11-04T04:52:05,604 adding 'deepspeed/runtime/comm/mpi.py' 2023-11-04T04:52:05,606 adding 'deepspeed/runtime/comm/nccl.py' 2023-11-04T04:52:05,608 adding 'deepspeed/runtime/compression/__init__.py' 2023-11-04T04:52:05,609 adding 'deepspeed/runtime/compression/cupy.py' 2023-11-04T04:52:05,616 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2023-11-04T04:52:05,617 adding 'deepspeed/runtime/data_pipeline/config.py' 2023-11-04T04:52:05,618 adding 'deepspeed/runtime/data_pipeline/constants.py' 2023-11-04T04:52:05,620 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2023-11-04T04:52:05,621 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2023-11-04T04:52:05,623 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2023-11-04T04:52:05,624 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2023-11-04T04:52:05,625 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2023-11-04T04:52:05,627 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2023-11-04T04:52:05,628 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2023-11-04T04:52:05,631 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2023-11-04T04:52:05,633 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2023-11-04T04:52:05,636 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2023-11-04T04:52:05,637 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2023-11-04T04:52:05,639 adding 'deepspeed/runtime/fp16/__init__.py' 2023-11-04T04:52:05,642 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2023-11-04T04:52:05,644 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2023-11-04T04:52:05,646 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2023-11-04T04:52:05,648 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2023-11-04T04:52:05,650 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2023-11-04T04:52:05,652 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2023-11-04T04:52:05,655 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2023-11-04T04:52:05,657 adding 'deepspeed/runtime/pipe/__init__.py' 2023-11-04T04:52:05,663 adding 'deepspeed/runtime/pipe/engine.py' 2023-11-04T04:52:05,666 adding 'deepspeed/runtime/pipe/module.py' 2023-11-04T04:52:05,668 adding 'deepspeed/runtime/pipe/p2p.py' 2023-11-04T04:52:05,670 adding 'deepspeed/runtime/pipe/schedule.py' 2023-11-04T04:52:05,673 adding 'deepspeed/runtime/pipe/topology.py' 2023-11-04T04:52:05,675 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2023-11-04T04:52:05,676 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2023-11-04T04:52:05,677 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2023-11-04T04:52:05,679 adding 'deepspeed/runtime/swap_tensor/constants.py' 2023-11-04T04:52:05,681 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2023-11-04T04:52:05,683 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2023-11-04T04:52:05,686 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2023-11-04T04:52:05,688 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2023-11-04T04:52:05,689 adding 'deepspeed/runtime/swap_tensor/utils.py' 2023-11-04T04:52:05,691 adding 'deepspeed/runtime/zero/__init__.py' 2023-11-04T04:52:05,693 adding 'deepspeed/runtime/zero/config.py' 2023-11-04T04:52:05,695 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2023-11-04T04:52:05,697 adding 'deepspeed/runtime/zero/linear.py' 2023-11-04T04:52:05,700 adding 'deepspeed/runtime/zero/mics.py' 2023-11-04T04:52:05,702 adding 'deepspeed/runtime/zero/mics_utils.py' 2023-11-04T04:52:05,703 adding 'deepspeed/runtime/zero/offload_config.py' 2023-11-04T04:52:05,706 adding 'deepspeed/runtime/zero/parameter_offload.py' 2023-11-04T04:52:05,717 adding 'deepspeed/runtime/zero/partition_parameters.py' 2023-11-04T04:52:05,721 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2023-11-04T04:52:05,722 adding 'deepspeed/runtime/zero/partitioned_param_profiler.py' 2023-11-04T04:52:05,736 adding 'deepspeed/runtime/zero/stage3.py' 2023-11-04T04:52:05,749 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2023-11-04T04:52:05,751 adding 'deepspeed/runtime/zero/test.py' 2023-11-04T04:52:05,753 adding 'deepspeed/runtime/zero/tiling.py' 2023-11-04T04:52:05,755 adding 'deepspeed/runtime/zero/utils.py' 2023-11-04T04:52:05,756 adding 'deepspeed/sequence/__init__.py' 2023-11-04T04:52:05,758 adding 'deepspeed/sequence/layer.py' 2023-11-04T04:52:05,759 adding 'deepspeed/utils/__init__.py' 2023-11-04T04:52:05,761 adding 'deepspeed/utils/comms_logging.py' 2023-11-04T04:52:05,762 adding 'deepspeed/utils/debug.py' 2023-11-04T04:52:05,763 adding 'deepspeed/utils/exceptions.py' 2023-11-04T04:52:05,766 adding 'deepspeed/utils/groups.py' 2023-11-04T04:52:05,767 adding 'deepspeed/utils/init_on_device.py' 2023-11-04T04:52:05,768 adding 'deepspeed/utils/logging.py' 2023-11-04T04:52:05,770 adding 'deepspeed/utils/mixed_precision_linkage.py' 2023-11-04T04:52:05,771 adding 'deepspeed/utils/numa.py' 2023-11-04T04:52:05,772 adding 'deepspeed/utils/nvtx.py' 2023-11-04T04:52:05,774 adding 'deepspeed/utils/tensor_fragment.py' 2023-11-04T04:52:05,776 adding 'deepspeed/utils/timer.py' 2023-11-04T04:52:05,777 adding 'deepspeed/utils/types.py' 2023-11-04T04:52:05,780 adding 'deepspeed/utils/zero_to_fp32.py' 2023-11-04T04:52:05,782 adding 'deepspeed-0.12.1.data/scripts/deepspeed' 2023-11-04T04:52:05,783 adding 'deepspeed-0.12.1.data/scripts/deepspeed.pt' 2023-11-04T04:52:05,784 adding 'deepspeed-0.12.1.data/scripts/ds' 2023-11-04T04:52:05,785 adding 'deepspeed-0.12.1.data/scripts/ds_bench' 2023-11-04T04:52:05,787 adding 'deepspeed-0.12.1.data/scripts/ds_elastic' 2023-11-04T04:52:05,788 adding 'deepspeed-0.12.1.data/scripts/ds_report' 2023-11-04T04:52:05,789 adding 'deepspeed-0.12.1.data/scripts/ds_ssh' 2023-11-04T04:52:05,790 adding 'deepspeed-0.12.1.data/scripts/dsr' 2023-11-04T04:52:05,795 adding 'deepspeed-0.12.1.dist-info/METADATA' 2023-11-04T04:52:05,796 adding 'deepspeed-0.12.1.dist-info/WHEEL' 2023-11-04T04:52:05,797 adding 'deepspeed-0.12.1.dist-info/entry_points.txt' 2023-11-04T04:52:05,798 adding 'deepspeed-0.12.1.dist-info/top_level.txt' 2023-11-04T04:52:05,810 adding 'deepspeed-0.12.1.dist-info/RECORD' 2023-11-04T04:52:05,832 removing build/bdist.linux-armv7l/wheel 2023-11-04T04:52:06,009 deepspeed build time = 8.70621633529663 secs 2023-11-04T04:52:06,129 Building wheel for deepspeed (setup.py): finished with status 'done' 2023-11-04T04:52:06,146 Created wheel for deepspeed: filename=deepspeed-0.12.1-py3-none-any.whl size=1265554 sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c 2023-11-04T04:52:06,147 Stored in directory: /tmp/pip-ephem-wheel-cache-_hrhc0na/wheels/f1/85/7f/f05d4c48694aea35eadd58ace1b0148cad007f87b4d2bf284e 2023-11-04T04:52:06,183 Successfully built deepspeed 2023-11-04T04:52:06,225 Removed build tracker: '/tmp/pip-build-tracker-r11la7ev'