2023-06-09T19:46:33,271 Created temporary directory: /tmp/pip-build-tracker-r58ezgl8 2023-06-09T19:46:33,274 Initialized build tracking at /tmp/pip-build-tracker-r58ezgl8 2023-06-09T19:46:33,275 Created build tracker: /tmp/pip-build-tracker-r58ezgl8 2023-06-09T19:46:33,275 Entered build tracker: /tmp/pip-build-tracker-r58ezgl8 2023-06-09T19:46:33,276 Created temporary directory: /tmp/pip-wheel-0ef8rioh 2023-06-09T19:46:33,284 Created temporary directory: /tmp/pip-ephem-wheel-cache-s1k42huf 2023-06-09T19:46:33,335 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-06-09T19:46:33,343 2 location(s) to search for versions of deepspeed: 2023-06-09T19:46:33,343 * https://pypi.org/simple/deepspeed/ 2023-06-09T19:46:33,343 * https://www.piwheels.org/simple/deepspeed/ 2023-06-09T19:46:33,345 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2023-06-09T19:46:33,346 Getting page https://pypi.org/simple/deepspeed/ 2023-06-09T19:46:33,350 Found index url https://pypi.org/simple/ 2023-06-09T19:46:33,738 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2023-06-09T19:46:33,772 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-06-09T19:46:33,772 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2023-06-09T19:46:33,773 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-06-09T19:46:33,774 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2023-06-09T19:46:33,774 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-06-09T19:46:33,775 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2023-06-09T19:46:33,776 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-06-09T19:46:33,776 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2023-06-09T19:46:33,777 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-06-09T19:46:33,778 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2023-06-09T19:46:33,778 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2023-06-09T19:46:33,779 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2023-06-09T19:46:33,780 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2023-06-09T19:46:33,780 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2023-06-09T19:46:33,781 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2023-06-09T19:46:33,782 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2023-06-09T19:46:33,783 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2023-06-09T19:46:33,783 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2023-06-09T19:46:33,784 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2023-06-09T19:46:33,785 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2023-06-09T19:46:33,785 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2023-06-09T19:46:33,786 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2023-06-09T19:46:33,787 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2023-06-09T19:46:33,787 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2023-06-09T19:46:33,788 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2023-06-09T19:46:33,789 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2023-06-09T19:46:33,789 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2023-06-09T19:46:33,790 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2023-06-09T19:46:33,791 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2023-06-09T19:46:33,791 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2023-06-09T19:46:33,792 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2023-06-09T19:46:33,793 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2023-06-09T19:46:33,793 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2023-06-09T19:46:33,794 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2023-06-09T19:46:33,795 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2023-06-09T19:46:33,795 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2023-06-09T19:46:33,796 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2023-06-09T19:46:33,797 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2023-06-09T19:46:33,797 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2023-06-09T19:46:33,798 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2023-06-09T19:46:33,799 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2023-06-09T19:46:33,799 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2023-06-09T19:46:33,800 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2023-06-09T19:46:33,801 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2023-06-09T19:46:33,801 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2023-06-09T19:46:33,802 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2023-06-09T19:46:33,803 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2023-06-09T19:46:33,803 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2023-06-09T19:46:33,804 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2023-06-09T19:46:33,805 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2023-06-09T19:46:33,806 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2023-06-09T19:46:33,806 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2023-06-09T19:46:33,807 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2023-06-09T19:46:33,808 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2023-06-09T19:46:33,808 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2023-06-09T19:46:33,809 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2023-06-09T19:46:33,809 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2023-06-09T19:46:33,810 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2023-06-09T19:46:33,811 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2023-06-09T19:46:33,812 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2023-06-09T19:46:33,812 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2023-06-09T19:46:33,813 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2023-06-09T19:46:33,814 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2023-06-09T19:46:33,814 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2023-06-09T19:46:33,815 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2023-06-09T19:46:33,816 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2023-06-09T19:46:33,816 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2023-06-09T19:46:33,817 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2023-06-09T19:46:33,818 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2023-06-09T19:46:33,818 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2023-06-09T19:46:33,819 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2023-06-09T19:46:33,820 Getting page https://www.piwheels.org/simple/deepspeed/ 2023-06-09T19:46:33,822 Found index url https://www.piwheels.org/simple/ 2023-06-09T19:46:34,043 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2023-06-09T19:46:34,077 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,077 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,078 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,078 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,079 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,079 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,080 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,081 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,081 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,082 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,082 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,083 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,083 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,084 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,084 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,085 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,085 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,086 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,086 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,087 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,087 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,088 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,088 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,089 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,089 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,090 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,090 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,091 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,091 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,092 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,092 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,093 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,093 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,094 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,094 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,095 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,096 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,096 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,097 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,097 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2023-06-09T19:46:34,098 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2023-06-09T19:46:34,098 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2023-06-09T19:46:34,152 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2023-06-09T19:46:34,183 Collecting deepspeed==0.9.4 2023-06-09T19:46:34,188 Created temporary directory: /tmp/pip-unpack-jpjbrdof 2023-06-09T19:46:34,364 Downloading deepspeed-0.9.4.tar.gz (808 kB) 2023-06-09T19:46:37,260 Added deepspeed==0.9.4 from https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz to build tracker '/tmp/pip-build-tracker-r58ezgl8' 2023-06-09T19:46:37,264 Running setup.py (path:/tmp/pip-wheel-0ef8rioh/deepspeed_bdd610c04c2848398dd7885908e2715c/setup.py) egg_info for package deepspeed 2023-06-09T19:46:37,265 Created temporary directory: /tmp/pip-pip-egg-info-3iyjec1i 2023-06-09T19:46:37,266 Preparing metadata (setup.py): started 2023-06-09T19:46:37,268 Running command python setup.py egg_info 2023-06-09T19:46:39,304 fatal: not a git repository (or any of the parent directories): .git 2023-06-09T19:46:39,961 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-06-09T19:46:39,962  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-06-09T19:46:39,962 DS_BUILD_OPS=0 2023-06-09T19:46:39,963  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-06-09T19:46:39,964  [WARNING]  async_io: please install the libaio-dev package with apt 2023-06-09T19:46:39,965  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-06-09T19:46:39,966  [WARNING]  unable to import torch, please install it first 2023-06-09T19:46:39,966  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-06-09T19:46:39,967  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-06-09T19:46:39,967 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False, 'utils': False} 2023-06-09T19:46:39,968 version=0.9.4, git_hash=unknown, git_branch=unknown 2023-06-09T19:46:39,969 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic<2.0.0', 'torch', 'tqdm'] 2023-06-09T19:46:39,970 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'utils': True} 2023-06-09T19:46:39,971 ext_modules=[] 2023-06-09T19:46:39,971 running egg_info 2023-06-09T19:46:39,972 creating /tmp/pip-pip-egg-info-3iyjec1i/deepspeed.egg-info 2023-06-09T19:46:40,032 writing /tmp/pip-pip-egg-info-3iyjec1i/deepspeed.egg-info/PKG-INFO 2023-06-09T19:46:40,038 writing dependency_links to /tmp/pip-pip-egg-info-3iyjec1i/deepspeed.egg-info/dependency_links.txt 2023-06-09T19:46:40,043 writing entry points to /tmp/pip-pip-egg-info-3iyjec1i/deepspeed.egg-info/entry_points.txt 2023-06-09T19:46:40,048 writing requirements to /tmp/pip-pip-egg-info-3iyjec1i/deepspeed.egg-info/requires.txt 2023-06-09T19:46:40,050 writing top-level names to /tmp/pip-pip-egg-info-3iyjec1i/deepspeed.egg-info/top_level.txt 2023-06-09T19:46:40,053 writing manifest file '/tmp/pip-pip-egg-info-3iyjec1i/deepspeed.egg-info/SOURCES.txt' 2023-06-09T19:46:40,427 reading manifest file '/tmp/pip-pip-egg-info-3iyjec1i/deepspeed.egg-info/SOURCES.txt' 2023-06-09T19:46:40,431 reading manifest template 'MANIFEST.in' 2023-06-09T19:46:41,801 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-06-09T19:46:42,822 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-06-09T19:46:43,493 warning: no files found matching '*.tr' under directory 'csrc' 2023-06-09T19:46:43,658 warning: no files found matching '*.cc' under directory 'csrc' 2023-06-09T19:46:43,694 warning: no files found matching '*.py' under directory 'benchmarks' 2023-06-09T19:46:43,705 adding license file 'LICENSE' 2023-06-09T19:46:43,764 writing manifest file '/tmp/pip-pip-egg-info-3iyjec1i/deepspeed.egg-info/SOURCES.txt' 2023-06-09T19:46:43,768 deepspeed build time = 4.45375657081604 secs 2023-06-09T19:46:43,899 Preparing metadata (setup.py): finished with status 'done' 2023-06-09T19:46:43,928 Source in /tmp/pip-wheel-0ef8rioh/deepspeed_bdd610c04c2848398dd7885908e2715c has version 0.9.4, which satisfies requirement deepspeed==0.9.4 from https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz 2023-06-09T19:46:43,930 Removed deepspeed==0.9.4 from https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz from build tracker '/tmp/pip-build-tracker-r58ezgl8' 2023-06-09T19:46:43,948 Created temporary directory: /tmp/pip-unpack-g06igf6n 2023-06-09T19:46:43,949 Building wheels for collected packages: deepspeed 2023-06-09T19:46:43,958 Created temporary directory: /tmp/pip-wheel-qlftvw30 2023-06-09T19:46:43,959 Building wheel for deepspeed (setup.py): started 2023-06-09T19:46:43,961 Destination directory: /tmp/pip-wheel-qlftvw30 2023-06-09T19:46:43,962 Running command python setup.py bdist_wheel 2023-06-09T19:46:45,072 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-06-09T19:46:45,096  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-06-09T19:46:45,193 DS_BUILD_OPS=0 2023-06-09T19:46:45,496  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-06-09T19:46:45,660  [WARNING]  async_io: please install the libaio-dev package with apt 2023-06-09T19:46:45,661  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-06-09T19:46:45,664  [WARNING]  unable to import torch, please install it first 2023-06-09T19:46:45,665  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-06-09T19:46:45,666  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-06-09T19:46:45,667 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False, 'utils': False} 2023-06-09T19:46:45,706 fatal: not a git repository (or any of the parent directories): .git 2023-06-09T19:46:45,712 version=0.9.4, git_hash=unknown, git_branch=unknown 2023-06-09T19:46:45,713 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic<2.0.0', 'torch', 'tqdm'] 2023-06-09T19:46:45,714 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'utils': True} 2023-06-09T19:46:45,715 ext_modules=[] 2023-06-09T19:46:46,440 running bdist_wheel 2023-06-09T19:46:47,183 running build 2023-06-09T19:46:47,183 running build_py 2023-06-09T19:46:47,264 creating build 2023-06-09T19:46:47,265 creating build/lib 2023-06-09T19:46:47,266 creating build/lib/deepspeed 2023-06-09T19:46:47,269 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2023-06-09T19:46:47,273 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2023-06-09T19:46:47,276 copying deepspeed/constants.py -> build/lib/deepspeed 2023-06-09T19:46:47,280 copying deepspeed/env_report.py -> build/lib/deepspeed 2023-06-09T19:46:47,284 copying deepspeed/__init__.py -> build/lib/deepspeed 2023-06-09T19:46:47,290 creating build/lib/deepspeed/pipe 2023-06-09T19:46:47,291 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2023-06-09T19:46:47,297 creating build/lib/deepspeed/moe 2023-06-09T19:46:47,298 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2023-06-09T19:46:47,302 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2023-06-09T19:46:47,308 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2023-06-09T19:46:47,312 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2023-06-09T19:46:47,315 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2023-06-09T19:46:47,320 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2023-06-09T19:46:47,325 creating build/lib/deepspeed/accelerator 2023-06-09T19:46:47,326 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2023-06-09T19:46:47,331 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2023-06-09T19:46:47,335 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2023-06-09T19:46:47,339 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2023-06-09T19:46:47,343 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2023-06-09T19:46:47,347 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2023-06-09T19:46:47,352 creating build/lib/deepspeed/launcher 2023-06-09T19:46:47,354 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2023-06-09T19:46:47,359 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2023-06-09T19:46:47,362 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2023-06-09T19:46:47,367 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2023-06-09T19:46:47,370 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2023-06-09T19:46:47,376 creating build/lib/deepspeed/ops 2023-06-09T19:46:47,378 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2023-06-09T19:46:47,383 creating build/lib/deepspeed/comm 2023-06-09T19:46:47,385 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2023-06-09T19:46:47,391 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2023-06-09T19:46:47,395 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2023-06-09T19:46:47,399 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2023-06-09T19:46:47,402 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2023-06-09T19:46:47,405 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2023-06-09T19:46:47,408 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2023-06-09T19:46:47,412 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2023-06-09T19:46:47,415 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2023-06-09T19:46:47,421 creating build/lib/deepspeed/runtime 2023-06-09T19:46:47,423 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2023-06-09T19:46:47,429 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2023-06-09T19:46:47,434 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2023-06-09T19:46:47,437 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2023-06-09T19:46:47,441 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2023-06-09T19:46:47,445 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2023-06-09T19:46:47,449 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2023-06-09T19:46:47,454 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2023-06-09T19:46:47,458 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2023-06-09T19:46:47,463 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2023-06-09T19:46:47,467 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2023-06-09T19:46:47,474 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2023-06-09T19:46:47,478 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2023-06-09T19:46:47,484 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2023-06-09T19:46:47,488 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2023-06-09T19:46:47,500 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2023-06-09T19:46:47,507 creating build/lib/deepspeed/nebula 2023-06-09T19:46:47,508 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2023-06-09T19:46:47,512 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2023-06-09T19:46:47,515 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2023-06-09T19:46:47,520 creating build/lib/deepspeed/inference 2023-06-09T19:46:47,521 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2023-06-09T19:46:47,526 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2023-06-09T19:46:47,529 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2023-06-09T19:46:47,536 creating build/lib/deepspeed/model_implementations 2023-06-09T19:46:47,537 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2023-06-09T19:46:47,543 creating build/lib/deepspeed/compression 2023-06-09T19:46:47,544 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2023-06-09T19:46:47,550 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2023-06-09T19:46:47,554 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2023-06-09T19:46:47,558 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2023-06-09T19:46:47,563 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2023-06-09T19:46:47,567 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2023-06-09T19:46:47,571 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2023-06-09T19:46:47,574 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2023-06-09T19:46:47,582 creating build/lib/deepspeed/utils 2023-06-09T19:46:47,584 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2023-06-09T19:46:47,587 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2023-06-09T19:46:47,592 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2023-06-09T19:46:47,597 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2023-06-09T19:46:47,600 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2023-06-09T19:46:47,606 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2023-06-09T19:46:47,610 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2023-06-09T19:46:47,614 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2023-06-09T19:46:47,618 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2023-06-09T19:46:47,622 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2023-06-09T19:46:47,625 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2023-06-09T19:46:47,629 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2023-06-09T19:46:47,634 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2023-06-09T19:46:47,638 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2023-06-09T19:46:47,644 creating build/lib/deepspeed/module_inject 2023-06-09T19:46:47,645 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2023-06-09T19:46:47,652 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2023-06-09T19:46:47,656 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2023-06-09T19:46:47,659 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2023-06-09T19:46:47,662 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2023-06-09T19:46:47,668 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2023-06-09T19:46:47,672 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2023-06-09T19:46:47,675 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2023-06-09T19:46:47,678 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2023-06-09T19:46:47,682 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2023-06-09T19:46:47,687 creating build/lib/deepspeed/elasticity 2023-06-09T19:46:47,689 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2023-06-09T19:46:47,693 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2023-06-09T19:46:47,697 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2023-06-09T19:46:47,701 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2023-06-09T19:46:47,705 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2023-06-09T19:46:47,708 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2023-06-09T19:46:47,713 creating build/lib/deepspeed/profiling 2023-06-09T19:46:47,715 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2023-06-09T19:46:47,719 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2023-06-09T19:46:47,722 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2023-06-09T19:46:47,727 creating build/lib/deepspeed/monitor 2023-06-09T19:46:47,728 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2023-06-09T19:46:47,732 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2023-06-09T19:46:47,737 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2023-06-09T19:46:47,740 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2023-06-09T19:46:47,743 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2023-06-09T19:46:47,747 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2023-06-09T19:46:47,750 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2023-06-09T19:46:47,755 creating build/lib/deepspeed/autotuning 2023-06-09T19:46:47,756 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2023-06-09T19:46:47,761 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2023-06-09T19:46:47,767 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2023-06-09T19:46:47,771 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2023-06-09T19:46:47,775 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2023-06-09T19:46:47,780 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2023-06-09T19:46:47,785 creating build/lib/deepspeed/checkpoint 2023-06-09T19:46:47,786 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-06-09T19:46:47,790 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-06-09T19:46:47,794 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2023-06-09T19:46:47,797 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2023-06-09T19:46:47,802 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-06-09T19:46:47,806 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2023-06-09T19:46:47,809 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2023-06-09T19:46:47,813 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2023-06-09T19:46:47,816 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2023-06-09T19:46:47,822 creating build/lib/deepspeed/ops/transformer 2023-06-09T19:46:47,823 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2023-06-09T19:46:47,827 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2023-06-09T19:46:47,834 creating build/lib/deepspeed/ops/sparse_attention 2023-06-09T19:46:47,835 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-06-09T19:46:47,840 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2023-06-09T19:46:47,846 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2023-06-09T19:46:47,850 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2023-06-09T19:46:47,855 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-06-09T19:46:47,858 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2023-06-09T19:46:47,862 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2023-06-09T19:46:47,870 creating build/lib/deepspeed/ops/quantizer 2023-06-09T19:46:47,872 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2023-06-09T19:46:47,875 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2023-06-09T19:46:47,879 creating build/lib/deepspeed/ops/adagrad 2023-06-09T19:46:47,881 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2023-06-09T19:46:47,884 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2023-06-09T19:46:47,889 creating build/lib/deepspeed/ops/aio 2023-06-09T19:46:47,891 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2023-06-09T19:46:47,896 creating build/lib/deepspeed/ops/lamb 2023-06-09T19:46:47,897 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2023-06-09T19:46:47,901 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2023-06-09T19:46:47,908 creating build/lib/deepspeed/ops/op_builder 2023-06-09T19:46:47,910 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2023-06-09T19:46:47,914 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2023-06-09T19:46:47,917 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2023-06-09T19:46:47,921 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2023-06-09T19:46:47,925 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2023-06-09T19:46:47,929 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2023-06-09T19:46:47,932 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2023-06-09T19:46:47,937 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2023-06-09T19:46:47,940 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2023-06-09T19:46:47,944 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2023-06-09T19:46:47,947 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2023-06-09T19:46:47,951 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2023-06-09T19:46:47,954 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2023-06-09T19:46:47,958 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2023-06-09T19:46:47,963 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2023-06-09T19:46:47,967 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2023-06-09T19:46:47,972 creating build/lib/deepspeed/ops/adam 2023-06-09T19:46:47,973 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2023-06-09T19:46:47,978 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2023-06-09T19:46:47,981 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2023-06-09T19:46:47,985 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2023-06-09T19:46:47,990 creating build/lib/deepspeed/ops/random_ltd 2023-06-09T19:46:47,992 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2023-06-09T19:46:47,996 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2023-06-09T19:46:48,002 creating build/lib/deepspeed/ops/transformer/inference 2023-06-09T19:46:48,005 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-09T19:46:48,010 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-09T19:46:48,014 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-09T19:46:48,018 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-09T19:46:48,022 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-09T19:46:48,028 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-09T19:46:48,032 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-09T19:46:48,035 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-09T19:46:48,039 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-09T19:46:48,043 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-09T19:46:48,050 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:48,052 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:48,056 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:48,059 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:48,063 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:48,067 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:48,072 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:48,076 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:48,079 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:48,083 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:48,087 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:48,092 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2023-06-09T19:46:48,093 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-06-09T19:46:48,098 creating build/lib/deepspeed/ops/op_builder/cpu 2023-06-09T19:46:48,101 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-06-09T19:46:48,105 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-06-09T19:46:48,108 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-06-09T19:46:48,112 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-06-09T19:46:48,118 creating build/lib/deepspeed/runtime/pipe 2023-06-09T19:46:48,120 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2023-06-09T19:46:48,126 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2023-06-09T19:46:48,131 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2023-06-09T19:46:48,135 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2023-06-09T19:46:48,140 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2023-06-09T19:46:48,144 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2023-06-09T19:46:48,154 creating build/lib/deepspeed/runtime/swap_tensor 2023-06-09T19:46:48,156 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-09T19:46:48,162 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-09T19:46:48,166 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-09T19:46:48,170 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-09T19:46:48,174 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-09T19:46:48,178 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-09T19:46:48,183 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-09T19:46:48,188 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-09T19:46:48,192 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-09T19:46:48,198 creating build/lib/deepspeed/runtime/comm 2023-06-09T19:46:48,200 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2023-06-09T19:46:48,204 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2023-06-09T19:46:48,209 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2023-06-09T19:46:48,213 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2023-06-09T19:46:48,218 creating build/lib/deepspeed/runtime/activation_checkpointing 2023-06-09T19:46:48,220 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-06-09T19:46:48,224 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-06-09T19:46:48,242 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-06-09T19:46:48,250 creating build/lib/deepspeed/runtime/compression 2023-06-09T19:46:48,252 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2023-06-09T19:46:48,255 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2023-06-09T19:46:48,260 creating build/lib/deepspeed/runtime/checkpoint_engine 2023-06-09T19:46:48,262 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-06-09T19:46:48,267 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-06-09T19:46:48,271 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-06-09T19:46:48,274 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-06-09T19:46:48,280 creating build/lib/deepspeed/runtime/zero 2023-06-09T19:46:48,283 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2023-06-09T19:46:48,287 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2023-06-09T19:46:48,292 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2023-06-09T19:46:48,305 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2023-06-09T19:46:48,311 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2023-06-09T19:46:48,316 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2023-06-09T19:46:48,320 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2023-06-09T19:46:48,326 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2023-06-09T19:46:48,330 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2023-06-09T19:46:48,335 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2023-06-09T19:46:48,338 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2023-06-09T19:46:48,347 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2023-06-09T19:46:48,351 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2023-06-09T19:46:48,356 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2023-06-09T19:46:48,361 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2023-06-09T19:46:48,374 creating build/lib/deepspeed/runtime/data_pipeline 2023-06-09T19:46:48,376 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2023-06-09T19:46:48,380 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2023-06-09T19:46:48,385 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2023-06-09T19:46:48,390 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2023-06-09T19:46:48,395 creating build/lib/deepspeed/runtime/fp16 2023-06-09T19:46:48,397 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-06-09T19:46:48,403 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-06-09T19:46:48,410 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2023-06-09T19:46:48,417 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2023-06-09T19:46:48,422 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-06-09T19:46:48,424 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-06-09T19:46:48,430 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-06-09T19:46:48,435 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-06-09T19:46:48,441 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-06-09T19:46:48,445 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-06-09T19:46:48,450 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-06-09T19:46:48,453 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-06-09T19:46:48,458 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-06-09T19:46:48,463 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-06-09T19:46:48,468 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-06-09T19:46:48,472 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-06-09T19:46:48,477 creating build/lib/deepspeed/runtime/fp16/onebit 2023-06-09T19:46:48,479 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-06-09T19:46:48,484 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-06-09T19:46:48,490 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-06-09T19:46:48,495 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-06-09T19:46:48,499 creating build/lib/deepspeed/model_implementations/features 2023-06-09T19:46:48,501 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2023-06-09T19:46:48,505 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2023-06-09T19:46:48,509 creating build/lib/deepspeed/model_implementations/diffusers 2023-06-09T19:46:48,511 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2023-06-09T19:46:48,515 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2023-06-09T19:46:48,519 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2023-06-09T19:46:48,524 creating build/lib/deepspeed/model_implementations/transformers 2023-06-09T19:46:48,526 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-09T19:46:48,529 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-09T19:46:48,533 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-09T19:46:48,536 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-09T19:46:48,539 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-09T19:46:48,543 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-09T19:46:48,547 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-09T19:46:48,551 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-09T19:46:48,554 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-09T19:46:48,561 creating build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,563 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,567 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,572 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,575 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,579 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,582 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,586 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,590 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,594 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,598 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,602 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,617 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,621 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,625 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,628 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,632 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,636 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2023-06-09T19:46:48,642 creating build/lib/deepspeed/module_inject/containers/features 2023-06-09T19:46:48,643 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-06-09T19:46:48,647 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2023-06-09T19:46:48,651 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2023-06-09T19:46:48,655 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2023-06-09T19:46:48,659 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-06-09T19:46:48,663 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2023-06-09T19:46:48,667 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2023-06-09T19:46:48,672 creating build/lib/deepspeed/profiling/flops_profiler 2023-06-09T19:46:48,674 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2023-06-09T19:46:48,682 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2023-06-09T19:46:48,687 creating build/lib/deepspeed/autotuning/tuner 2023-06-09T19:46:48,688 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-06-09T19:46:48,693 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2023-06-09T19:46:48,696 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-06-09T19:46:48,699 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2023-06-09T19:46:48,703 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2023-06-09T19:46:48,706 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-06-09T19:46:48,710 running egg_info 2023-06-09T19:46:48,841 writing deepspeed.egg-info/PKG-INFO 2023-06-09T19:46:48,848 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2023-06-09T19:46:48,852 writing entry points to deepspeed.egg-info/entry_points.txt 2023-06-09T19:46:48,857 writing requirements to deepspeed.egg-info/requires.txt 2023-06-09T19:46:48,859 writing top-level names to deepspeed.egg-info/top_level.txt 2023-06-09T19:46:49,021 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-06-09T19:46:49,081 reading manifest template 'MANIFEST.in' 2023-06-09T19:46:50,409 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-06-09T19:46:51,508 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-06-09T19:46:52,188 warning: no files found matching '*.tr' under directory 'csrc' 2023-06-09T19:46:52,357 warning: no files found matching '*.cc' under directory 'csrc' 2023-06-09T19:46:52,392 warning: no files found matching '*.py' under directory 'benchmarks' 2023-06-09T19:46:52,404 adding license file 'LICENSE' 2023-06-09T19:46:52,478 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-06-09T19:46:52,496 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2023-06-09T19:46:52,496 !! 2023-06-09T19:46:52,497 ******************************************************************************** 2023-06-09T19:46:52,497 ############################ 2023-06-09T19:46:52,498 # Package would be ignored # 2023-06-09T19:46:52,498 ############################ 2023-06-09T19:46:52,498 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2023-06-09T19:46:52,499 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,499 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,499 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2023-06-09T19:46:52,500 to the `packages` configuration field. 2023-06-09T19:46:52,500 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,501 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,501 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,502 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,502 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,503 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2023-06-09T19:46:52,503 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2023-06-09T19:46:52,504 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,504 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,504 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,505 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,505 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,506 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,507 even if it does not contain any `.py` files. 2023-06-09T19:46:52,507 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,507 directory, all directories are treated like packages. 2023-06-09T19:46:52,507 ******************************************************************************** 2023-06-09T19:46:52,508 !! 2023-06-09T19:46:52,508 check.warn(importable) 2023-06-09T19:46:52,509 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2023-06-09T19:46:52,509 !! 2023-06-09T19:46:52,510 ******************************************************************************** 2023-06-09T19:46:52,510 ############################ 2023-06-09T19:46:52,510 # Package would be ignored # 2023-06-09T19:46:52,511 ############################ 2023-06-09T19:46:52,511 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2023-06-09T19:46:52,511 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,512 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,512 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2023-06-09T19:46:52,512 to the `packages` configuration field. 2023-06-09T19:46:52,513 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,513 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,514 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,514 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,515 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,515 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2023-06-09T19:46:52,516 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2023-06-09T19:46:52,516 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,516 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,517 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,517 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,518 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,519 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,519 even if it does not contain any `.py` files. 2023-06-09T19:46:52,519 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,519 directory, all directories are treated like packages. 2023-06-09T19:46:52,520 ******************************************************************************** 2023-06-09T19:46:52,520 !! 2023-06-09T19:46:52,521 check.warn(importable) 2023-06-09T19:46:52,521 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2023-06-09T19:46:52,521 !! 2023-06-09T19:46:52,522 ******************************************************************************** 2023-06-09T19:46:52,522 ############################ 2023-06-09T19:46:52,523 # Package would be ignored # 2023-06-09T19:46:52,523 ############################ 2023-06-09T19:46:52,523 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2023-06-09T19:46:52,524 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,524 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,524 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2023-06-09T19:46:52,525 to the `packages` configuration field. 2023-06-09T19:46:52,525 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,526 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,526 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,527 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,527 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,528 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2023-06-09T19:46:52,528 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2023-06-09T19:46:52,528 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,529 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,529 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,530 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,530 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,531 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,531 even if it does not contain any `.py` files. 2023-06-09T19:46:52,532 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,532 directory, all directories are treated like packages. 2023-06-09T19:46:52,532 ******************************************************************************** 2023-06-09T19:46:52,533 !! 2023-06-09T19:46:52,533 check.warn(importable) 2023-06-09T19:46:52,533 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2023-06-09T19:46:52,534 !! 2023-06-09T19:46:52,534 ******************************************************************************** 2023-06-09T19:46:52,535 ############################ 2023-06-09T19:46:52,535 # Package would be ignored # 2023-06-09T19:46:52,535 ############################ 2023-06-09T19:46:52,535 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2023-06-09T19:46:52,536 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,536 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,537 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2023-06-09T19:46:52,537 to the `packages` configuration field. 2023-06-09T19:46:52,537 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,538 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,538 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,539 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,539 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,540 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2023-06-09T19:46:52,540 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2023-06-09T19:46:52,540 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,541 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,541 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,542 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,542 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,543 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,543 even if it does not contain any `.py` files. 2023-06-09T19:46:52,544 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,544 directory, all directories are treated like packages. 2023-06-09T19:46:52,544 ******************************************************************************** 2023-06-09T19:46:52,545 !! 2023-06-09T19:46:52,545 check.warn(importable) 2023-06-09T19:46:52,545 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2023-06-09T19:46:52,546 !! 2023-06-09T19:46:52,546 ******************************************************************************** 2023-06-09T19:46:52,546 ############################ 2023-06-09T19:46:52,547 # Package would be ignored # 2023-06-09T19:46:52,547 ############################ 2023-06-09T19:46:52,547 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2023-06-09T19:46:52,548 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,548 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,548 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2023-06-09T19:46:52,549 to the `packages` configuration field. 2023-06-09T19:46:52,549 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,550 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,550 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,550 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,551 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,552 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2023-06-09T19:46:52,552 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2023-06-09T19:46:52,552 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,552 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,553 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,553 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,554 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,555 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,555 even if it does not contain any `.py` files. 2023-06-09T19:46:52,555 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,556 directory, all directories are treated like packages. 2023-06-09T19:46:52,556 ******************************************************************************** 2023-06-09T19:46:52,557 !! 2023-06-09T19:46:52,557 check.warn(importable) 2023-06-09T19:46:52,557 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2023-06-09T19:46:52,557 !! 2023-06-09T19:46:52,558 ******************************************************************************** 2023-06-09T19:46:52,558 ############################ 2023-06-09T19:46:52,559 # Package would be ignored # 2023-06-09T19:46:52,559 ############################ 2023-06-09T19:46:52,559 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2023-06-09T19:46:52,559 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,560 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,560 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2023-06-09T19:46:52,561 to the `packages` configuration field. 2023-06-09T19:46:52,561 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,562 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,562 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,562 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,563 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,564 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2023-06-09T19:46:52,564 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2023-06-09T19:46:52,564 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,564 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,565 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,565 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,566 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,567 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,567 even if it does not contain any `.py` files. 2023-06-09T19:46:52,567 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,568 directory, all directories are treated like packages. 2023-06-09T19:46:52,568 ******************************************************************************** 2023-06-09T19:46:52,568 !! 2023-06-09T19:46:52,569 check.warn(importable) 2023-06-09T19:46:52,569 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration. 2023-06-09T19:46:52,569 !! 2023-06-09T19:46:52,570 ******************************************************************************** 2023-06-09T19:46:52,570 ############################ 2023-06-09T19:46:52,570 # Package would be ignored # 2023-06-09T19:46:52,571 ############################ 2023-06-09T19:46:52,571 Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1], 2023-06-09T19:46:52,571 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,572 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,572 package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added 2023-06-09T19:46:52,573 to the `packages` configuration field. 2023-06-09T19:46:52,573 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,574 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,574 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,575 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,575 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,576 If you don't want 'deepspeed.ops.csrc.common' to be distributed and are 2023-06-09T19:46:52,576 already explicitly excluding 'deepspeed.ops.csrc.common' via 2023-06-09T19:46:52,577 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,577 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,577 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,578 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,578 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,579 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,580 even if it does not contain any `.py` files. 2023-06-09T19:46:52,580 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,580 directory, all directories are treated like packages. 2023-06-09T19:46:52,581 ******************************************************************************** 2023-06-09T19:46:52,581 !! 2023-06-09T19:46:52,582 check.warn(importable) 2023-06-09T19:46:52,582 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2023-06-09T19:46:52,582 !! 2023-06-09T19:46:52,583 ******************************************************************************** 2023-06-09T19:46:52,583 ############################ 2023-06-09T19:46:52,584 # Package would be ignored # 2023-06-09T19:46:52,584 ############################ 2023-06-09T19:46:52,584 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2023-06-09T19:46:52,585 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,585 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,586 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2023-06-09T19:46:52,586 to the `packages` configuration field. 2023-06-09T19:46:52,587 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,587 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,587 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,588 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,589 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,589 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2023-06-09T19:46:52,589 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2023-06-09T19:46:52,590 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,590 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,590 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,591 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,592 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,593 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,593 even if it does not contain any `.py` files. 2023-06-09T19:46:52,593 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,594 directory, all directories are treated like packages. 2023-06-09T19:46:52,594 ******************************************************************************** 2023-06-09T19:46:52,595 !! 2023-06-09T19:46:52,595 check.warn(importable) 2023-06-09T19:46:52,595 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2023-06-09T19:46:52,596 !! 2023-06-09T19:46:52,596 ******************************************************************************** 2023-06-09T19:46:52,597 ############################ 2023-06-09T19:46:52,597 # Package would be ignored # 2023-06-09T19:46:52,597 ############################ 2023-06-09T19:46:52,598 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2023-06-09T19:46:52,598 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,599 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,599 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2023-06-09T19:46:52,599 to the `packages` configuration field. 2023-06-09T19:46:52,600 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,600 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,601 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,601 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,602 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,603 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2023-06-09T19:46:52,603 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2023-06-09T19:46:52,603 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,604 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,604 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,605 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,605 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,606 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,607 even if it does not contain any `.py` files. 2023-06-09T19:46:52,607 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,607 directory, all directories are treated like packages. 2023-06-09T19:46:52,608 ******************************************************************************** 2023-06-09T19:46:52,608 !! 2023-06-09T19:46:52,609 check.warn(importable) 2023-06-09T19:46:52,609 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2023-06-09T19:46:52,610 !! 2023-06-09T19:46:52,610 ******************************************************************************** 2023-06-09T19:46:52,611 ############################ 2023-06-09T19:46:52,611 # Package would be ignored # 2023-06-09T19:46:52,611 ############################ 2023-06-09T19:46:52,612 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2023-06-09T19:46:52,612 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,613 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,613 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2023-06-09T19:46:52,613 to the `packages` configuration field. 2023-06-09T19:46:52,614 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,614 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,615 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,615 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,616 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,617 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2023-06-09T19:46:52,617 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2023-06-09T19:46:52,617 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,618 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,618 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,619 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,619 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,620 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,621 even if it does not contain any `.py` files. 2023-06-09T19:46:52,621 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,621 directory, all directories are treated like packages. 2023-06-09T19:46:52,622 ******************************************************************************** 2023-06-09T19:46:52,622 !! 2023-06-09T19:46:52,623 check.warn(importable) 2023-06-09T19:46:52,623 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2023-06-09T19:46:52,623 !! 2023-06-09T19:46:52,624 ******************************************************************************** 2023-06-09T19:46:52,624 ############################ 2023-06-09T19:46:52,625 # Package would be ignored # 2023-06-09T19:46:52,625 ############################ 2023-06-09T19:46:52,625 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2023-06-09T19:46:52,626 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,626 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,627 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2023-06-09T19:46:52,627 to the `packages` configuration field. 2023-06-09T19:46:52,628 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,628 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,628 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,629 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,629 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,630 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2023-06-09T19:46:52,630 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2023-06-09T19:46:52,631 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,631 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,631 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,632 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,633 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,634 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,634 even if it does not contain any `.py` files. 2023-06-09T19:46:52,634 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,635 directory, all directories are treated like packages. 2023-06-09T19:46:52,635 ******************************************************************************** 2023-06-09T19:46:52,636 !! 2023-06-09T19:46:52,636 check.warn(importable) 2023-06-09T19:46:52,636 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2023-06-09T19:46:52,637 !! 2023-06-09T19:46:52,637 ******************************************************************************** 2023-06-09T19:46:52,638 ############################ 2023-06-09T19:46:52,638 # Package would be ignored # 2023-06-09T19:46:52,638 ############################ 2023-06-09T19:46:52,639 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2023-06-09T19:46:52,639 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,639 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,640 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2023-06-09T19:46:52,640 to the `packages` configuration field. 2023-06-09T19:46:52,641 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,641 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,641 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,642 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,643 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,643 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2023-06-09T19:46:52,644 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2023-06-09T19:46:52,644 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,644 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,645 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,645 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,646 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,647 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,647 even if it does not contain any `.py` files. 2023-06-09T19:46:52,648 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,648 directory, all directories are treated like packages. 2023-06-09T19:46:52,648 ******************************************************************************** 2023-06-09T19:46:52,649 !! 2023-06-09T19:46:52,649 check.warn(importable) 2023-06-09T19:46:52,649 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2023-06-09T19:46:52,650 !! 2023-06-09T19:46:52,650 ******************************************************************************** 2023-06-09T19:46:52,651 ############################ 2023-06-09T19:46:52,651 # Package would be ignored # 2023-06-09T19:46:52,651 ############################ 2023-06-09T19:46:52,652 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2023-06-09T19:46:52,652 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,653 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,653 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2023-06-09T19:46:52,654 to the `packages` configuration field. 2023-06-09T19:46:52,654 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,654 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,655 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,655 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,656 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,657 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2023-06-09T19:46:52,657 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2023-06-09T19:46:52,657 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,658 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,658 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,659 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,659 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,660 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,661 even if it does not contain any `.py` files. 2023-06-09T19:46:52,661 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,661 directory, all directories are treated like packages. 2023-06-09T19:46:52,662 ******************************************************************************** 2023-06-09T19:46:52,662 !! 2023-06-09T19:46:52,663 check.warn(importable) 2023-06-09T19:46:52,663 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2023-06-09T19:46:52,663 !! 2023-06-09T19:46:52,664 ******************************************************************************** 2023-06-09T19:46:52,664 ############################ 2023-06-09T19:46:52,665 # Package would be ignored # 2023-06-09T19:46:52,665 ############################ 2023-06-09T19:46:52,665 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2023-06-09T19:46:52,666 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,666 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,667 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2023-06-09T19:46:52,667 to the `packages` configuration field. 2023-06-09T19:46:52,668 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,668 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,668 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,669 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,669 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,670 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2023-06-09T19:46:52,670 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2023-06-09T19:46:52,671 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,671 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,672 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,672 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,673 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,674 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,674 even if it does not contain any `.py` files. 2023-06-09T19:46:52,674 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,675 directory, all directories are treated like packages. 2023-06-09T19:46:52,675 ******************************************************************************** 2023-06-09T19:46:52,676 !! 2023-06-09T19:46:52,676 check.warn(importable) 2023-06-09T19:46:52,676 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2023-06-09T19:46:52,677 !! 2023-06-09T19:46:52,677 ******************************************************************************** 2023-06-09T19:46:52,678 ############################ 2023-06-09T19:46:52,678 # Package would be ignored # 2023-06-09T19:46:52,678 ############################ 2023-06-09T19:46:52,679 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2023-06-09T19:46:52,679 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,680 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,680 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2023-06-09T19:46:52,680 to the `packages` configuration field. 2023-06-09T19:46:52,681 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,681 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,681 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,682 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,683 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,683 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2023-06-09T19:46:52,684 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2023-06-09T19:46:52,684 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,684 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,685 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,685 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,686 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,687 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,687 even if it does not contain any `.py` files. 2023-06-09T19:46:52,687 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,688 directory, all directories are treated like packages. 2023-06-09T19:46:52,688 ******************************************************************************** 2023-06-09T19:46:52,689 !! 2023-06-09T19:46:52,689 check.warn(importable) 2023-06-09T19:46:52,689 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2023-06-09T19:46:52,690 !! 2023-06-09T19:46:52,690 ******************************************************************************** 2023-06-09T19:46:52,691 ############################ 2023-06-09T19:46:52,691 # Package would be ignored # 2023-06-09T19:46:52,691 ############################ 2023-06-09T19:46:52,692 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2023-06-09T19:46:52,692 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,693 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,693 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2023-06-09T19:46:52,693 to the `packages` configuration field. 2023-06-09T19:46:52,694 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,694 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,695 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,695 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,696 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,696 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2023-06-09T19:46:52,697 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2023-06-09T19:46:52,697 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,697 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,698 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,698 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,699 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,700 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,700 even if it does not contain any `.py` files. 2023-06-09T19:46:52,701 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,701 directory, all directories are treated like packages. 2023-06-09T19:46:52,701 ******************************************************************************** 2023-06-09T19:46:52,702 !! 2023-06-09T19:46:52,702 check.warn(importable) 2023-06-09T19:46:52,703 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2023-06-09T19:46:52,703 !! 2023-06-09T19:46:52,703 ******************************************************************************** 2023-06-09T19:46:52,704 ############################ 2023-06-09T19:46:52,704 # Package would be ignored # 2023-06-09T19:46:52,704 ############################ 2023-06-09T19:46:52,705 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2023-06-09T19:46:52,705 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,706 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,706 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2023-06-09T19:46:52,706 to the `packages` configuration field. 2023-06-09T19:46:52,707 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,707 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,708 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,708 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,709 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,710 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2023-06-09T19:46:52,710 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2023-06-09T19:46:52,710 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,711 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,711 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,712 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,712 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,713 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,714 even if it does not contain any `.py` files. 2023-06-09T19:46:52,714 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,714 directory, all directories are treated like packages. 2023-06-09T19:46:52,715 ******************************************************************************** 2023-06-09T19:46:52,715 !! 2023-06-09T19:46:52,716 check.warn(importable) 2023-06-09T19:46:52,716 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2023-06-09T19:46:52,716 !! 2023-06-09T19:46:52,717 ******************************************************************************** 2023-06-09T19:46:52,717 ############################ 2023-06-09T19:46:52,717 # Package would be ignored # 2023-06-09T19:46:52,718 ############################ 2023-06-09T19:46:52,718 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2023-06-09T19:46:52,718 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,719 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,719 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2023-06-09T19:46:52,720 to the `packages` configuration field. 2023-06-09T19:46:52,720 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,721 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,721 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,722 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,722 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,723 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2023-06-09T19:46:52,723 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2023-06-09T19:46:52,724 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,724 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,724 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,725 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,725 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,726 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,727 even if it does not contain any `.py` files. 2023-06-09T19:46:52,727 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,727 directory, all directories are treated like packages. 2023-06-09T19:46:52,728 ******************************************************************************** 2023-06-09T19:46:52,728 !! 2023-06-09T19:46:52,729 check.warn(importable) 2023-06-09T19:46:52,729 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2023-06-09T19:46:52,729 !! 2023-06-09T19:46:52,730 ******************************************************************************** 2023-06-09T19:46:52,730 ############################ 2023-06-09T19:46:52,731 # Package would be ignored # 2023-06-09T19:46:52,731 ############################ 2023-06-09T19:46:52,731 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2023-06-09T19:46:52,732 but it is absent from setuptools' `packages` configuration. 2023-06-09T19:46:52,732 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-09T19:46:52,733 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2023-06-09T19:46:52,733 to the `packages` configuration field. 2023-06-09T19:46:52,734 Alternatively, you can also rely on setuptools' discovery methods 2023-06-09T19:46:52,734 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-09T19:46:52,734 instead of `find_packages(...)`/`find:`). 2023-06-09T19:46:52,735 You can read more about "package discovery" on setuptools documentation page: 2023-06-09T19:46:52,736 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-09T19:46:52,736 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2023-06-09T19:46:52,737 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2023-06-09T19:46:52,737 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-09T19:46:52,737 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-09T19:46:52,738 combination with a more fine grained `package-data` configuration. 2023-06-09T19:46:52,738 You can read more about "package data files" on setuptools documentation page: 2023-06-09T19:46:52,739 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-09T19:46:52,740 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-09T19:46:52,740 even if it does not contain any `.py` files. 2023-06-09T19:46:52,740 On the other hand, currently there is no concept of package data 2023-06-09T19:46:52,741 directory, all directories are treated like packages. 2023-06-09T19:46:52,741 ******************************************************************************** 2023-06-09T19:46:52,742 !! 2023-06-09T19:46:52,742 check.warn(importable) 2023-06-09T19:46:52,742 creating build/lib/deepspeed/ops/csrc 2023-06-09T19:46:52,743 creating build/lib/deepspeed/ops/csrc/adagrad 2023-06-09T19:46:52,743 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2023-06-09T19:46:52,743 creating build/lib/deepspeed/ops/csrc/adam 2023-06-09T19:46:52,744 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-06-09T19:46:52,744 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-06-09T19:46:52,744 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2023-06-09T19:46:52,745 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2023-06-09T19:46:52,745 creating build/lib/deepspeed/ops/csrc/aio 2023-06-09T19:46:52,745 creating build/lib/deepspeed/ops/csrc/aio/common 2023-06-09T19:46:52,746 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-06-09T19:46:52,746 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-06-09T19:46:52,746 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-06-09T19:46:52,747 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-06-09T19:46:52,747 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-06-09T19:46:52,747 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-06-09T19:46:52,748 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:52,748 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:52,748 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:52,748 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:52,749 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:52,749 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:52,749 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:52,750 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:52,750 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:52,750 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:52,751 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:52,751 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:52,751 creating build/lib/deepspeed/ops/csrc/aio/py_test 2023-06-09T19:46:52,752 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2023-06-09T19:46:52,752 creating build/lib/deepspeed/ops/csrc/common 2023-06-09T19:46:52,752 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2023-06-09T19:46:52,753 creating build/lib/deepspeed/ops/csrc/cpu 2023-06-09T19:46:52,753 creating build/lib/deepspeed/ops/csrc/cpu/comm 2023-06-09T19:46:52,754 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2023-06-09T19:46:52,754 creating build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,754 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,754 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,755 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,755 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,755 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,756 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,756 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,756 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,757 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,762 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,767 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,771 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,775 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,780 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,784 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,788 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,793 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,797 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,804 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,809 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,814 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,820 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,825 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,830 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,835 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,840 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,845 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-09T19:46:52,851 creating build/lib/deepspeed/ops/csrc/lamb 2023-06-09T19:46:52,853 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2023-06-09T19:46:52,857 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2023-06-09T19:46:52,863 creating build/lib/deepspeed/ops/csrc/quantization 2023-06-09T19:46:52,864 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-06-09T19:46:52,870 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-06-09T19:46:52,877 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2023-06-09T19:46:52,882 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-06-09T19:46:52,887 creating build/lib/deepspeed/ops/csrc/random_ltd 2023-06-09T19:46:52,889 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-06-09T19:46:52,894 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2023-06-09T19:46:52,899 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-06-09T19:46:52,904 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-06-09T19:46:52,909 creating build/lib/deepspeed/ops/csrc/sparse_attention 2023-06-09T19:46:52,911 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2023-06-09T19:46:52,916 creating build/lib/deepspeed/ops/csrc/spatial 2023-06-09T19:46:52,917 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2023-06-09T19:46:52,919 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-06-09T19:46:52,925 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-06-09T19:46:52,929 creating build/lib/deepspeed/ops/csrc/spatial/includes 2023-06-09T19:46:52,931 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2023-06-09T19:46:52,936 creating build/lib/deepspeed/ops/csrc/transformer 2023-06-09T19:46:52,938 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-06-09T19:46:52,944 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-06-09T19:46:52,950 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2023-06-09T19:46:52,958 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-06-09T19:46:52,963 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-06-09T19:46:52,969 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-06-09T19:46:52,979 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-06-09T19:46:52,985 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-06-09T19:46:52,992 creating build/lib/deepspeed/ops/csrc/transformer/inference 2023-06-09T19:46:52,994 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:52,996 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,002 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,007 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,014 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,021 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,026 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,038 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,043 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,048 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,055 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,062 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-06-09T19:46:53,063 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-06-09T19:46:53,069 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-06-09T19:46:53,075 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-06-09T19:46:53,081 creating build/lib/deepspeed/ops/csrc/utils 2023-06-09T19:46:53,083 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2023-06-09T19:46:53,088 creating build/lib/deepspeed/autotuning/config_templates 2023-06-09T19:46:53,090 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2023-06-09T19:46:53,095 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2023-06-09T19:46:53,100 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2023-06-09T19:46:53,105 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2023-06-09T19:46:53,110 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-06-09T19:46:53,115 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-06-09T19:46:53,120 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-06-09T19:46:53,203 running build_scripts 2023-06-09T19:46:53,204 creating build/scripts-3.7 2023-06-09T19:46:53,207 copying and adjusting bin/deepspeed -> build/scripts-3.7 2023-06-09T19:46:53,212 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2023-06-09T19:46:53,217 copying and adjusting bin/ds -> build/scripts-3.7 2023-06-09T19:46:53,220 copying bin/ds_ssh -> build/scripts-3.7 2023-06-09T19:46:53,225 copying and adjusting bin/ds_report -> build/scripts-3.7 2023-06-09T19:46:53,228 copying and adjusting bin/ds_bench -> build/scripts-3.7 2023-06-09T19:46:53,231 copying and adjusting bin/dsr -> build/scripts-3.7 2023-06-09T19:46:53,234 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2023-06-09T19:46:53,236 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2023-06-09T19:46:53,237 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2023-06-09T19:46:53,238 changing mode of build/scripts-3.7/ds from 644 to 755 2023-06-09T19:46:53,238 changing mode of build/scripts-3.7/ds_report from 644 to 755 2023-06-09T19:46:53,239 changing mode of build/scripts-3.7/ds_bench from 644 to 755 2023-06-09T19:46:53,240 changing mode of build/scripts-3.7/dsr from 644 to 755 2023-06-09T19:46:53,241 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2023-06-09T19:46:53,320 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-06-09T19:46:53,321 !! 2023-06-09T19:46:53,321 ******************************************************************************** 2023-06-09T19:46:53,322 Please avoid running ``setup.py`` directly. 2023-06-09T19:46:53,322 Instead, use pypa/build, pypa/installer, pypa/build or 2023-06-09T19:46:53,322 other standards-based tools. 2023-06-09T19:46:53,323 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-06-09T19:46:53,323 ******************************************************************************** 2023-06-09T19:46:53,324 !! 2023-06-09T19:46:53,324 self.initialize_options() 2023-06-09T19:46:53,390 installing to build/bdist.linux-armv7l/wheel 2023-06-09T19:46:53,390 running install 2023-06-09T19:46:53,449 running install_lib 2023-06-09T19:46:53,521 creating build/bdist.linux-armv7l 2023-06-09T19:46:53,522 creating build/bdist.linux-armv7l/wheel 2023-06-09T19:46:53,526 creating build/bdist.linux-armv7l/wheel/deepspeed 2023-06-09T19:46:53,528 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-06-09T19:46:53,534 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-06-09T19:46:53,536 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-06-09T19:46:53,540 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-06-09T19:46:53,542 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-06-09T19:46:53,546 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-06-09T19:46:53,552 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-06-09T19:46:53,556 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-06-09T19:46:53,560 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-06-09T19:46:53,565 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-06-09T19:46:53,568 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-06-09T19:46:53,573 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-06-09T19:46:53,575 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-06-09T19:46:53,580 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-06-09T19:46:53,584 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-06-09T19:46:53,589 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-06-09T19:46:53,593 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-06-09T19:46:53,597 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-06-09T19:46:53,603 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-06-09T19:46:53,604 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-06-09T19:46:53,610 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-06-09T19:46:53,614 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-06-09T19:46:53,619 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-06-09T19:46:53,623 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-06-09T19:46:53,629 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-06-09T19:46:53,632 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-06-09T19:46:53,635 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-09T19:46:53,638 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:53,640 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:53,645 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:53,648 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:53,652 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:53,656 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:53,660 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:53,664 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:53,668 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:53,672 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:53,676 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-09T19:46:53,679 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-09T19:46:53,684 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-09T19:46:53,689 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-09T19:46:53,693 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-09T19:46:53,697 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-09T19:46:53,702 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-09T19:46:53,707 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-09T19:46:53,710 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-09T19:46:53,714 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-09T19:46:53,718 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-09T19:46:53,722 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-06-09T19:46:53,726 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-06-09T19:46:53,733 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-06-09T19:46:53,734 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-06-09T19:46:53,739 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-06-09T19:46:53,744 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-06-09T19:46:53,749 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-06-09T19:46:53,753 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-06-09T19:46:53,757 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-06-09T19:46:53,761 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-06-09T19:46:53,768 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-06-09T19:46:53,770 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-06-09T19:46:53,775 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-06-09T19:46:53,780 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-06-09T19:46:53,784 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-06-09T19:46:53,789 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-06-09T19:46:53,791 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-06-09T19:46:53,796 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-06-09T19:46:53,801 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-06-09T19:46:53,803 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-06-09T19:46:53,807 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-06-09T19:46:53,812 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-06-09T19:46:53,814 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-06-09T19:46:53,819 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-06-09T19:46:53,821 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-06-09T19:46:53,825 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-06-09T19:46:53,829 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-06-09T19:46:53,834 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2023-06-09T19:46:53,837 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-06-09T19:46:53,839 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-06-09T19:46:53,844 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-06-09T19:46:53,848 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-06-09T19:46:53,852 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-06-09T19:46:53,858 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-09T19:46:53,859 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-09T19:46:53,864 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-09T19:46:53,870 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-09T19:46:53,877 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2023-06-09T19:46:53,880 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-06-09T19:46:53,882 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-06-09T19:46:53,887 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-06-09T19:46:53,892 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-06-09T19:46:53,898 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,901 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,907 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,912 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,916 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,921 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,925 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,929 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,934 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,938 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,943 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-09T19:46:53,951 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-09T19:46:53,956 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-09T19:46:53,964 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-09T19:46:53,968 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-09T19:46:53,973 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-09T19:46:53,980 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-06-09T19:46:53,982 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-06-09T19:46:53,989 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2023-06-09T19:46:53,992 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-06-09T19:46:53,995 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-06-09T19:46:54,000 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-06-09T19:46:54,002 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-06-09T19:46:54,008 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-06-09T19:46:54,014 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,016 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,022 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,027 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,034 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,038 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,043 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,048 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,052 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,057 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,061 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,065 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,070 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,075 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,079 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,084 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,089 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,094 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,097 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,101 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,104 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,109 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,113 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,117 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,122 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,127 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,130 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,134 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-09T19:46:54,139 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-06-09T19:46:54,141 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-06-09T19:46:54,147 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2023-06-09T19:46:54,149 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-06-09T19:46:54,151 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-06-09T19:46:54,156 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-06-09T19:46:54,158 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-06-09T19:46:54,162 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-06-09T19:46:54,166 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-06-09T19:46:54,169 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-06-09T19:46:54,173 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-06-09T19:46:54,178 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-06-09T19:46:54,183 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:54,185 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:54,188 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:54,193 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:54,196 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:54,200 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:54,204 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:54,208 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:54,212 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:54,216 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:54,220 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:54,224 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-09T19:46:54,229 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-06-09T19:46:54,231 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-06-09T19:46:54,236 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-06-09T19:46:54,241 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-06-09T19:46:54,242 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-06-09T19:46:54,247 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-06-09T19:46:54,249 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-06-09T19:46:54,254 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu 2023-06-09T19:46:54,256 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-06-09T19:46:54,258 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-06-09T19:46:54,264 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-06-09T19:46:54,266 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-06-09T19:46:54,271 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-06-09T19:46:54,275 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-06-09T19:46:54,279 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-06-09T19:46:54,284 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-06-09T19:46:54,286 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-06-09T19:46:54,290 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-06-09T19:46:54,295 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-06-09T19:46:54,299 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-06-09T19:46:54,305 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-09T19:46:54,307 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-09T19:46:54,310 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-09T19:46:54,314 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-09T19:46:54,318 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-09T19:46:54,321 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-09T19:46:54,325 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-09T19:46:54,329 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-09T19:46:54,332 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-09T19:46:54,336 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-09T19:46:54,339 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-09T19:46:54,343 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-09T19:46:54,346 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-09T19:46:54,351 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-06-09T19:46:54,353 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-06-09T19:46:54,356 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-06-09T19:46:54,360 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-06-09T19:46:54,363 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-06-09T19:46:54,367 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-09T19:46:54,370 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-09T19:46:54,376 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-09T19:46:54,379 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-09T19:46:54,384 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-06-09T19:46:54,386 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-06-09T19:46:54,390 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-06-09T19:46:54,395 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-06-09T19:46:54,399 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-06-09T19:46:54,403 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-06-09T19:46:54,405 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-06-09T19:46:54,409 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-06-09T19:46:54,414 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-09T19:46:54,416 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-09T19:46:54,423 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-09T19:46:54,428 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-09T19:46:54,432 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-09T19:46:54,435 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-09T19:46:54,439 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-09T19:46:54,442 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-09T19:46:54,445 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-09T19:46:54,449 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-09T19:46:54,454 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-09T19:46:54,456 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-09T19:46:54,462 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-09T19:46:54,466 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-09T19:46:54,471 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-06-09T19:46:54,473 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-06-09T19:46:54,478 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-06-09T19:46:54,483 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-06-09T19:46:54,487 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-06-09T19:46:54,492 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-06-09T19:46:54,495 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-06-09T19:46:54,502 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-09T19:46:54,505 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-09T19:46:54,509 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-09T19:46:54,514 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-09T19:46:54,516 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-09T19:46:54,521 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-09T19:46:54,525 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-09T19:46:54,528 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-09T19:46:54,532 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-09T19:46:54,536 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-09T19:46:54,540 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-09T19:46:54,545 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-09T19:46:54,548 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-09T19:46:54,553 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-06-09T19:46:54,555 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-06-09T19:46:54,559 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-06-09T19:46:54,563 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-06-09T19:46:54,567 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-06-09T19:46:54,570 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-09T19:46:54,575 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-09T19:46:54,580 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-09T19:46:54,585 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-06-09T19:46:54,587 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-06-09T19:46:54,591 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-06-09T19:46:54,594 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-06-09T19:46:54,600 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-06-09T19:46:54,602 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-06-09T19:46:54,605 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-06-09T19:46:54,609 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-09T19:46:54,614 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-06-09T19:46:54,616 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-06-09T19:46:54,620 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-06-09T19:46:54,623 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-06-09T19:46:54,627 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-06-09T19:46:54,632 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-09T19:46:54,634 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-09T19:46:54,638 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-09T19:46:54,642 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-09T19:46:54,652 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-09T19:46:54,657 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-09T19:46:54,661 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-09T19:46:54,665 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-09T19:46:54,671 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-09T19:46:54,675 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-09T19:46:54,678 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-09T19:46:54,682 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-09T19:46:54,689 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-09T19:46:54,692 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-09T19:46:54,697 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-09T19:46:54,702 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-09T19:46:54,712 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-09T19:46:54,719 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-09T19:46:54,724 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-06-09T19:46:54,726 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-06-09T19:46:54,732 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-06-09T19:46:54,733 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-06-09T19:46:54,738 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-06-09T19:46:54,744 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-06-09T19:46:54,749 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-06-09T19:46:54,752 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-06-09T19:46:54,756 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-06-09T19:46:54,761 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-06-09T19:46:54,763 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-06-09T19:46:54,767 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-06-09T19:46:54,773 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-06-09T19:46:54,778 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-06-09T19:46:54,782 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-06-09T19:46:54,786 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-06-09T19:46:54,791 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-06-09T19:46:54,795 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-09T19:46:54,801 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-09T19:46:54,804 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-09T19:46:54,817 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-09T19:46:54,823 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-06-09T19:46:54,825 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-06-09T19:46:54,830 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-06-09T19:46:54,836 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-06-09T19:46:54,838 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-06-09T19:46:54,844 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-06-09T19:46:54,850 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-06-09T19:46:54,855 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-06-09T19:46:54,858 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-06-09T19:46:54,863 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-06-09T19:46:54,867 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-06-09T19:46:54,871 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-06-09T19:46:54,873 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-06-09T19:46:54,877 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-06-09T19:46:54,881 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-06-09T19:46:54,886 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-06-09T19:46:54,887 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-06-09T19:46:54,892 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-06-09T19:46:54,896 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-06-09T19:46:54,903 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-06-09T19:46:54,906 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-06-09T19:46:54,908 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-06-09T19:46:54,912 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-06-09T19:46:54,916 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-06-09T19:46:54,918 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-06-09T19:46:54,922 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-06-09T19:46:54,926 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-06-09T19:46:54,929 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-06-09T19:46:54,934 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-09T19:46:54,936 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-09T19:46:54,939 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-09T19:46:54,943 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-09T19:46:54,947 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-09T19:46:54,950 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-09T19:46:54,954 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-09T19:46:54,957 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-09T19:46:54,961 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-09T19:46:54,965 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-09T19:46:54,970 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-09T19:46:54,972 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-09T19:46:54,979 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-09T19:46:54,984 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-09T19:46:54,988 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-09T19:46:54,994 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-09T19:46:54,998 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-09T19:46:55,002 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-09T19:46:55,006 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-09T19:46:55,012 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-09T19:46:55,013 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-09T19:46:55,017 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-09T19:46:55,021 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-09T19:46:55,026 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-09T19:46:55,029 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-09T19:46:55,034 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-09T19:46:55,039 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-09T19:46:55,043 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-09T19:46:55,047 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-09T19:46:55,050 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-09T19:46:55,054 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-09T19:46:55,058 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-09T19:46:55,063 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-09T19:46:55,067 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-09T19:46:55,072 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-09T19:46:55,074 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-09T19:46:55,082 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,084 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,088 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,093 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,096 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,100 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,103 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,108 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,112 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,117 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,122 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,127 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,131 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,137 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-06-09T19:46:55,139 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-06-09T19:46:55,144 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-06-09T19:46:55,148 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-06-09T19:46:55,153 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-06-09T19:46:55,158 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-06-09T19:46:55,163 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-06-09T19:46:55,168 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-06-09T19:46:55,172 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,176 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,180 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,184 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,189 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-09T19:46:55,194 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-09T19:46:55,199 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-09T19:46:55,203 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-09T19:46:55,208 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-09T19:46:55,213 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-09T19:46:55,218 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-09T19:46:55,223 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-09T19:46:55,227 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-09T19:46:55,232 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-09T19:46:55,238 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-06-09T19:46:55,240 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-06-09T19:46:55,245 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-06-09T19:46:55,250 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-06-09T19:46:55,255 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-06-09T19:46:55,260 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-06-09T19:46:55,264 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-06-09T19:46:55,269 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-06-09T19:46:55,272 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-06-09T19:46:55,277 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-06-09T19:46:55,280 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-06-09T19:46:55,288 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-06-09T19:46:55,291 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-06-09T19:46:55,295 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-06-09T19:46:55,299 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-06-09T19:46:55,301 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-06-09T19:46:55,305 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-06-09T19:46:55,309 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-06-09T19:46:55,313 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-06-09T19:46:55,317 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-06-09T19:46:55,320 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-06-09T19:46:55,324 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-06-09T19:46:55,327 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-06-09T19:46:55,333 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-06-09T19:46:55,334 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-06-09T19:46:55,339 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-06-09T19:46:55,346 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-06-09T19:46:55,348 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-06-09T19:46:55,353 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-06-09T19:46:55,356 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-06-09T19:46:55,360 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-06-09T19:46:55,363 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-06-09T19:46:55,367 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-06-09T19:46:55,371 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-06-09T19:46:55,375 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-06-09T19:46:55,380 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-06-09T19:46:55,385 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-06-09T19:46:55,390 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-06-09T19:46:55,391 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-06-09T19:46:55,395 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-06-09T19:46:55,399 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-06-09T19:46:55,402 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-06-09T19:46:55,406 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-06-09T19:46:55,412 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-09T19:46:55,414 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-09T19:46:55,418 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-09T19:46:55,422 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-09T19:46:55,425 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-09T19:46:55,429 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-09T19:46:55,433 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-09T19:46:55,437 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-09T19:46:55,440 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-09T19:46:55,445 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-09T19:46:55,449 running install_egg_info 2023-06-09T19:46:55,529 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.9.4-py3.7.egg-info 2023-06-09T19:46:55,569 running install_scripts 2023-06-09T19:46:55,572 creating build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data 2023-06-09T19:46:55,573 creating build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data/scripts 2023-06-09T19:46:55,575 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data/scripts 2023-06-09T19:46:55,580 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data/scripts 2023-06-09T19:46:55,583 copying build/scripts-3.7/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data/scripts 2023-06-09T19:46:55,587 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data/scripts 2023-06-09T19:46:55,590 copying build/scripts-3.7/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data/scripts 2023-06-09T19:46:55,593 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data/scripts 2023-06-09T19:46:55,597 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data/scripts 2023-06-09T19:46:55,600 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data/scripts 2023-06-09T19:46:55,603 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data/scripts/deepspeed to 755 2023-06-09T19:46:55,603 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data/scripts/ds_ssh to 755 2023-06-09T19:46:55,604 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data/scripts/ds_bench to 755 2023-06-09T19:46:55,605 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data/scripts/ds_elastic to 755 2023-06-09T19:46:55,606 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data/scripts/dsr to 755 2023-06-09T19:46:55,606 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data/scripts/deepspeed.pt to 755 2023-06-09T19:46:55,607 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data/scripts/ds_report to 755 2023-06-09T19:46:55,608 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.data/scripts/ds to 755 2023-06-09T19:46:55,726 creating build/bdist.linux-armv7l/wheel/deepspeed-0.9.4.dist-info/WHEEL 2023-06-09T19:46:55,731 creating '/tmp/pip-wheel-qlftvw30/deepspeed-0.9.4-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-06-09T19:46:55,739 adding 'deepspeed/__init__.py' 2023-06-09T19:46:55,742 adding 'deepspeed/constants.py' 2023-06-09T19:46:55,745 adding 'deepspeed/env_report.py' 2023-06-09T19:46:55,748 adding 'deepspeed/git_version_info.py' 2023-06-09T19:46:55,750 adding 'deepspeed/git_version_info_installed.py' 2023-06-09T19:46:55,754 adding 'deepspeed/accelerator/__init__.py' 2023-06-09T19:46:55,757 adding 'deepspeed/accelerator/abstract_accelerator.py' 2023-06-09T19:46:55,760 adding 'deepspeed/accelerator/cpu_accelerator.py' 2023-06-09T19:46:55,764 adding 'deepspeed/accelerator/cuda_accelerator.py' 2023-06-09T19:46:55,768 adding 'deepspeed/accelerator/npu_accelerator.py' 2023-06-09T19:46:55,771 adding 'deepspeed/accelerator/real_accelerator.py' 2023-06-09T19:46:55,775 adding 'deepspeed/autotuning/__init__.py' 2023-06-09T19:46:55,788 adding 'deepspeed/autotuning/autotuner.py' 2023-06-09T19:46:55,792 adding 'deepspeed/autotuning/config.py' 2023-06-09T19:46:55,795 adding 'deepspeed/autotuning/constants.py' 2023-06-09T19:46:55,800 adding 'deepspeed/autotuning/scheduler.py' 2023-06-09T19:46:55,806 adding 'deepspeed/autotuning/utils.py' 2023-06-09T19:46:55,810 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2023-06-09T19:46:55,812 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2023-06-09T19:46:55,815 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2023-06-09T19:46:55,817 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2023-06-09T19:46:55,821 adding 'deepspeed/autotuning/tuner/__init__.py' 2023-06-09T19:46:55,824 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2023-06-09T19:46:55,827 adding 'deepspeed/autotuning/tuner/cost_model.py' 2023-06-09T19:46:55,829 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2023-06-09T19:46:55,833 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2023-06-09T19:46:55,836 adding 'deepspeed/autotuning/tuner/utils.py' 2023-06-09T19:46:55,840 adding 'deepspeed/checkpoint/__init__.py' 2023-06-09T19:46:55,843 adding 'deepspeed/checkpoint/constants.py' 2023-06-09T19:46:55,847 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2023-06-09T19:46:55,850 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2023-06-09T19:46:55,854 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2023-06-09T19:46:55,857 adding 'deepspeed/checkpoint/reshape_utils.py' 2023-06-09T19:46:55,860 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2023-06-09T19:46:55,864 adding 'deepspeed/checkpoint/utils.py' 2023-06-09T19:46:55,867 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2023-06-09T19:46:55,871 adding 'deepspeed/comm/__init__.py' 2023-06-09T19:46:55,873 adding 'deepspeed/comm/backend.py' 2023-06-09T19:46:55,876 adding 'deepspeed/comm/ccl.py' 2023-06-09T19:46:55,883 adding 'deepspeed/comm/comm.py' 2023-06-09T19:46:55,887 adding 'deepspeed/comm/config.py' 2023-06-09T19:46:55,889 adding 'deepspeed/comm/constants.py' 2023-06-09T19:46:55,892 adding 'deepspeed/comm/reduce_op.py' 2023-06-09T19:46:55,896 adding 'deepspeed/comm/torch.py' 2023-06-09T19:46:55,899 adding 'deepspeed/comm/utils.py' 2023-06-09T19:46:55,903 adding 'deepspeed/compression/__init__.py' 2023-06-09T19:46:55,911 adding 'deepspeed/compression/basic_layer.py' 2023-06-09T19:46:55,916 adding 'deepspeed/compression/compress.py' 2023-06-09T19:46:55,921 adding 'deepspeed/compression/config.py' 2023-06-09T19:46:55,925 adding 'deepspeed/compression/constants.py' 2023-06-09T19:46:55,929 adding 'deepspeed/compression/helper.py' 2023-06-09T19:46:55,933 adding 'deepspeed/compression/scheduler.py' 2023-06-09T19:46:55,936 adding 'deepspeed/compression/utils.py' 2023-06-09T19:46:55,940 adding 'deepspeed/elasticity/__init__.py' 2023-06-09T19:46:55,943 adding 'deepspeed/elasticity/config.py' 2023-06-09T19:46:55,946 adding 'deepspeed/elasticity/constants.py' 2023-06-09T19:46:55,950 adding 'deepspeed/elasticity/elastic_agent.py' 2023-06-09T19:46:55,956 adding 'deepspeed/elasticity/elasticity.py' 2023-06-09T19:46:55,959 adding 'deepspeed/elasticity/utils.py' 2023-06-09T19:46:55,963 adding 'deepspeed/inference/__init__.py' 2023-06-09T19:46:55,967 adding 'deepspeed/inference/config.py' 2023-06-09T19:46:55,976 adding 'deepspeed/inference/engine.py' 2023-06-09T19:46:55,980 adding 'deepspeed/launcher/__init__.py' 2023-06-09T19:46:55,983 adding 'deepspeed/launcher/constants.py' 2023-06-09T19:46:55,988 adding 'deepspeed/launcher/launch.py' 2023-06-09T19:46:55,993 adding 'deepspeed/launcher/multinode_runner.py' 2023-06-09T19:46:55,999 adding 'deepspeed/launcher/runner.py' 2023-06-09T19:46:56,003 adding 'deepspeed/model_implementations/__init__.py' 2023-06-09T19:46:56,007 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2023-06-09T19:46:56,009 adding 'deepspeed/model_implementations/diffusers/unet.py' 2023-06-09T19:46:56,013 adding 'deepspeed/model_implementations/diffusers/vae.py' 2023-06-09T19:46:56,016 adding 'deepspeed/model_implementations/features/__init__.py' 2023-06-09T19:46:56,019 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2023-06-09T19:46:56,022 adding 'deepspeed/model_implementations/transformers/__init__.py' 2023-06-09T19:46:56,025 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2023-06-09T19:46:56,028 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2023-06-09T19:46:56,030 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2023-06-09T19:46:56,033 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2023-06-09T19:46:56,035 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2023-06-09T19:46:56,038 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2023-06-09T19:46:56,040 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2023-06-09T19:46:56,044 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2023-06-09T19:46:56,048 adding 'deepspeed/module_inject/__init__.py' 2023-06-09T19:46:56,051 adding 'deepspeed/module_inject/auto_tp.py' 2023-06-09T19:46:56,055 adding 'deepspeed/module_inject/inject.py' 2023-06-09T19:46:56,058 adding 'deepspeed/module_inject/layers.py' 2023-06-09T19:46:56,062 adding 'deepspeed/module_inject/load_checkpoint.py' 2023-06-09T19:46:56,065 adding 'deepspeed/module_inject/module_quantize.py' 2023-06-09T19:46:56,069 adding 'deepspeed/module_inject/policy.py' 2023-06-09T19:46:56,080 adding 'deepspeed/module_inject/replace_module.py' 2023-06-09T19:46:56,083 adding 'deepspeed/module_inject/replace_policy.py' 2023-06-09T19:46:56,086 adding 'deepspeed/module_inject/utils.py' 2023-06-09T19:46:56,090 adding 'deepspeed/module_inject/containers/__init__.py' 2023-06-09T19:46:56,094 adding 'deepspeed/module_inject/containers/base.py' 2023-06-09T19:46:56,098 adding 'deepspeed/module_inject/containers/base_moe.py' 2023-06-09T19:46:56,101 adding 'deepspeed/module_inject/containers/bert.py' 2023-06-09T19:46:56,104 adding 'deepspeed/module_inject/containers/bloom.py' 2023-06-09T19:46:56,107 adding 'deepspeed/module_inject/containers/clip.py' 2023-06-09T19:46:56,109 adding 'deepspeed/module_inject/containers/distil_bert.py' 2023-06-09T19:46:56,112 adding 'deepspeed/module_inject/containers/gpt2.py' 2023-06-09T19:46:56,115 adding 'deepspeed/module_inject/containers/gptj.py' 2023-06-09T19:46:56,119 adding 'deepspeed/module_inject/containers/gptneo.py' 2023-06-09T19:46:56,122 adding 'deepspeed/module_inject/containers/gptneox.py' 2023-06-09T19:46:56,125 adding 'deepspeed/module_inject/containers/llama.py' 2023-06-09T19:46:56,128 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2023-06-09T19:46:56,131 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2023-06-09T19:46:56,135 adding 'deepspeed/module_inject/containers/opt.py' 2023-06-09T19:46:56,137 adding 'deepspeed/module_inject/containers/unet.py' 2023-06-09T19:46:56,140 adding 'deepspeed/module_inject/containers/vae.py' 2023-06-09T19:46:56,144 adding 'deepspeed/module_inject/containers/features/__init__.py' 2023-06-09T19:46:56,147 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2023-06-09T19:46:56,150 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2023-06-09T19:46:56,154 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2023-06-09T19:46:56,156 adding 'deepspeed/module_inject/containers/features/megatron.py' 2023-06-09T19:46:56,159 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2023-06-09T19:46:56,163 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2023-06-09T19:46:56,166 adding 'deepspeed/moe/__init__.py' 2023-06-09T19:46:56,169 adding 'deepspeed/moe/experts.py' 2023-06-09T19:46:56,173 adding 'deepspeed/moe/layer.py' 2023-06-09T19:46:56,176 adding 'deepspeed/moe/mappings.py' 2023-06-09T19:46:56,182 adding 'deepspeed/moe/sharded_moe.py' 2023-06-09T19:46:56,185 adding 'deepspeed/moe/utils.py' 2023-06-09T19:46:56,189 adding 'deepspeed/monitor/__init__.py' 2023-06-09T19:46:56,192 adding 'deepspeed/monitor/config.py' 2023-06-09T19:46:56,195 adding 'deepspeed/monitor/csv_monitor.py' 2023-06-09T19:46:56,197 adding 'deepspeed/monitor/monitor.py' 2023-06-09T19:46:56,200 adding 'deepspeed/monitor/tensorboard.py' 2023-06-09T19:46:56,203 adding 'deepspeed/monitor/utils.py' 2023-06-09T19:46:56,205 adding 'deepspeed/monitor/wandb.py' 2023-06-09T19:46:56,209 adding 'deepspeed/nebula/__init__.py' 2023-06-09T19:46:56,211 adding 'deepspeed/nebula/config.py' 2023-06-09T19:46:56,214 adding 'deepspeed/nebula/constants.py' 2023-06-09T19:46:56,218 adding 'deepspeed/ops/__init__.py' 2023-06-09T19:46:56,221 adding 'deepspeed/ops/adagrad/__init__.py' 2023-06-09T19:46:56,225 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2023-06-09T19:46:56,228 adding 'deepspeed/ops/adam/__init__.py' 2023-06-09T19:46:56,232 adding 'deepspeed/ops/adam/cpu_adam.py' 2023-06-09T19:46:56,236 adding 'deepspeed/ops/adam/fused_adam.py' 2023-06-09T19:46:56,239 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2023-06-09T19:46:56,242 adding 'deepspeed/ops/aio/__init__.py' 2023-06-09T19:46:56,248 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2023-06-09T19:46:56,253 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2023-06-09T19:46:56,256 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2023-06-09T19:46:56,259 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2023-06-09T19:46:56,263 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2023-06-09T19:46:56,269 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2023-06-09T19:46:56,272 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2023-06-09T19:46:56,275 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2023-06-09T19:46:56,277 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2023-06-09T19:46:56,280 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2023-06-09T19:46:56,284 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2023-06-09T19:46:56,288 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2023-06-09T19:46:56,291 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2023-06-09T19:46:56,294 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2023-06-09T19:46:56,296 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2023-06-09T19:46:56,299 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2023-06-09T19:46:56,302 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2023-06-09T19:46:56,305 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2023-06-09T19:46:56,308 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2023-06-09T19:46:56,312 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2023-06-09T19:46:56,314 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2023-06-09T19:46:56,317 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2023-06-09T19:46:56,320 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2023-06-09T19:46:56,324 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2023-06-09T19:46:56,330 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2023-06-09T19:46:56,335 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2023-06-09T19:46:56,337 adding 'deepspeed/ops/csrc/includes/Timer.h' 2023-06-09T19:46:56,340 adding 'deepspeed/ops/csrc/includes/compat.h' 2023-06-09T19:46:56,343 adding 'deepspeed/ops/csrc/includes/context.h' 2023-06-09T19:46:56,347 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2023-06-09T19:46:56,350 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2023-06-09T19:46:56,354 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2023-06-09T19:46:56,357 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2023-06-09T19:46:56,361 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2023-06-09T19:46:56,365 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2023-06-09T19:46:56,367 adding 'deepspeed/ops/csrc/includes/dropout.h' 2023-06-09T19:46:56,370 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2023-06-09T19:46:56,373 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2023-06-09T19:46:56,376 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2023-06-09T19:46:56,379 adding 'deepspeed/ops/csrc/includes/gelu.h' 2023-06-09T19:46:56,382 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2023-06-09T19:46:56,385 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2023-06-09T19:46:56,390 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2023-06-09T19:46:56,394 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2023-06-09T19:46:56,397 adding 'deepspeed/ops/csrc/includes/quantization.h' 2023-06-09T19:46:56,402 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2023-06-09T19:46:56,405 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2023-06-09T19:46:56,409 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2023-06-09T19:46:56,413 adding 'deepspeed/ops/csrc/includes/simd.h' 2023-06-09T19:46:56,429 adding 'deepspeed/ops/csrc/includes/softmax.h' 2023-06-09T19:46:56,432 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2023-06-09T19:46:56,435 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2023-06-09T19:46:56,439 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2023-06-09T19:46:56,444 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2023-06-09T19:46:56,448 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2023-06-09T19:46:56,454 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2023-06-09T19:46:56,458 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2023-06-09T19:46:56,462 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2023-06-09T19:46:56,466 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2023-06-09T19:46:56,470 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2023-06-09T19:46:56,473 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2023-06-09T19:46:56,477 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2023-06-09T19:46:56,481 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2023-06-09T19:46:56,486 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2023-06-09T19:46:56,489 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2023-06-09T19:46:56,493 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2023-06-09T19:46:56,498 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2023-06-09T19:46:56,504 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2023-06-09T19:46:56,514 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2023-06-09T19:46:56,518 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2023-06-09T19:46:56,523 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2023-06-09T19:46:56,533 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2023-06-09T19:46:56,541 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2023-06-09T19:46:56,547 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2023-06-09T19:46:56,553 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2023-06-09T19:46:56,556 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2023-06-09T19:46:56,563 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2023-06-09T19:46:56,568 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2023-06-09T19:46:56,571 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2023-06-09T19:46:56,585 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2023-06-09T19:46:56,589 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2023-06-09T19:46:56,593 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2023-06-09T19:46:56,599 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2023-06-09T19:46:56,605 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2023-06-09T19:46:56,611 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2023-06-09T19:46:56,615 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2023-06-09T19:46:56,619 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2023-06-09T19:46:56,622 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2023-06-09T19:46:56,626 adding 'deepspeed/ops/lamb/__init__.py' 2023-06-09T19:46:56,630 adding 'deepspeed/ops/lamb/fused_lamb.py' 2023-06-09T19:46:56,634 adding 'deepspeed/ops/op_builder/__init__.py' 2023-06-09T19:46:56,637 adding 'deepspeed/ops/op_builder/all_ops.py' 2023-06-09T19:46:56,640 adding 'deepspeed/ops/op_builder/async_io.py' 2023-06-09T19:46:56,648 adding 'deepspeed/ops/op_builder/builder.py' 2023-06-09T19:46:56,651 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2023-06-09T19:46:56,654 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2023-06-09T19:46:56,656 adding 'deepspeed/ops/op_builder/fused_adam.py' 2023-06-09T19:46:56,659 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2023-06-09T19:46:56,662 adding 'deepspeed/ops/op_builder/quantizer.py' 2023-06-09T19:46:56,664 adding 'deepspeed/ops/op_builder/random_ltd.py' 2023-06-09T19:46:56,667 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2023-06-09T19:46:56,670 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2023-06-09T19:46:56,673 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2023-06-09T19:46:56,675 adding 'deepspeed/ops/op_builder/transformer.py' 2023-06-09T19:46:56,678 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2023-06-09T19:46:56,681 adding 'deepspeed/ops/op_builder/utils.py' 2023-06-09T19:46:56,684 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2023-06-09T19:46:56,687 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2023-06-09T19:46:56,690 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2023-06-09T19:46:56,692 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2023-06-09T19:46:56,696 adding 'deepspeed/ops/quantizer/__init__.py' 2023-06-09T19:46:56,698 adding 'deepspeed/ops/quantizer/quantizer.py' 2023-06-09T19:46:56,702 adding 'deepspeed/ops/random_ltd/__init__.py' 2023-06-09T19:46:56,705 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2023-06-09T19:46:56,709 adding 'deepspeed/ops/sparse_attention/__init__.py' 2023-06-09T19:46:56,712 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2023-06-09T19:46:56,720 adding 'deepspeed/ops/sparse_attention/matmul.py' 2023-06-09T19:46:56,726 adding 'deepspeed/ops/sparse_attention/softmax.py' 2023-06-09T19:46:56,730 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2023-06-09T19:46:56,734 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2023-06-09T19:46:56,742 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2023-06-09T19:46:56,746 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2023-06-09T19:46:56,750 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2023-06-09T19:46:56,753 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2023-06-09T19:46:56,756 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2023-06-09T19:46:56,759 adding 'deepspeed/ops/transformer/__init__.py' 2023-06-09T19:46:56,766 adding 'deepspeed/ops/transformer/transformer.py' 2023-06-09T19:46:56,772 adding 'deepspeed/ops/transformer/inference/__init__.py' 2023-06-09T19:46:56,775 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2023-06-09T19:46:56,778 adding 'deepspeed/ops/transformer/inference/config.py' 2023-06-09T19:46:56,781 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2023-06-09T19:46:56,784 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2023-06-09T19:46:56,787 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2023-06-09T19:46:56,792 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2023-06-09T19:46:56,796 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2023-06-09T19:46:56,801 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2023-06-09T19:46:56,805 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2023-06-09T19:46:56,810 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2023-06-09T19:46:56,814 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2023-06-09T19:46:56,817 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2023-06-09T19:46:56,820 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2023-06-09T19:46:56,823 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2023-06-09T19:46:56,826 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2023-06-09T19:46:56,829 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2023-06-09T19:46:56,832 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2023-06-09T19:46:56,835 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2023-06-09T19:46:56,838 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2023-06-09T19:46:56,841 adding 'deepspeed/pipe/__init__.py' 2023-06-09T19:46:56,845 adding 'deepspeed/profiling/__init__.py' 2023-06-09T19:46:56,847 adding 'deepspeed/profiling/config.py' 2023-06-09T19:46:56,850 adding 'deepspeed/profiling/constants.py' 2023-06-09T19:46:56,855 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2023-06-09T19:46:56,869 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2023-06-09T19:46:56,874 adding 'deepspeed/runtime/__init__.py' 2023-06-09T19:46:56,880 adding 'deepspeed/runtime/bf16_optimizer.py' 2023-06-09T19:46:56,889 adding 'deepspeed/runtime/config.py' 2023-06-09T19:46:56,894 adding 'deepspeed/runtime/config_utils.py' 2023-06-09T19:46:56,898 adding 'deepspeed/runtime/constants.py' 2023-06-09T19:46:56,902 adding 'deepspeed/runtime/dataloader.py' 2023-06-09T19:46:56,905 adding 'deepspeed/runtime/eigenvalue.py' 2023-06-09T19:46:56,946 adding 'deepspeed/runtime/engine.py' 2023-06-09T19:46:56,955 adding 'deepspeed/runtime/hybrid_engine.py' 2023-06-09T19:46:56,963 adding 'deepspeed/runtime/lr_schedules.py' 2023-06-09T19:46:56,966 adding 'deepspeed/runtime/progressive_layer_drop.py' 2023-06-09T19:46:56,970 adding 'deepspeed/runtime/quantize.py' 2023-06-09T19:46:56,973 adding 'deepspeed/runtime/sparse_tensor.py' 2023-06-09T19:46:56,978 adding 'deepspeed/runtime/state_dict_factory.py' 2023-06-09T19:46:56,988 adding 'deepspeed/runtime/utils.py' 2023-06-09T19:46:56,992 adding 'deepspeed/runtime/weight_quantizer.py' 2023-06-09T19:46:56,996 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2023-06-09T19:46:57,005 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2023-06-09T19:46:57,008 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2023-06-09T19:46:57,012 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2023-06-09T19:46:57,014 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2023-06-09T19:46:57,017 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2023-06-09T19:46:57,020 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2023-06-09T19:46:57,024 adding 'deepspeed/runtime/comm/__init__.py' 2023-06-09T19:46:57,027 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2023-06-09T19:46:57,030 adding 'deepspeed/runtime/comm/mpi.py' 2023-06-09T19:46:57,034 adding 'deepspeed/runtime/comm/nccl.py' 2023-06-09T19:46:57,038 adding 'deepspeed/runtime/compression/__init__.py' 2023-06-09T19:46:57,040 adding 'deepspeed/runtime/compression/cupy.py' 2023-06-09T19:46:57,044 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2023-06-09T19:46:57,047 adding 'deepspeed/runtime/data_pipeline/config.py' 2023-06-09T19:46:57,050 adding 'deepspeed/runtime/data_pipeline/constants.py' 2023-06-09T19:46:57,053 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2023-06-09T19:46:57,057 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2023-06-09T19:46:57,060 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2023-06-09T19:46:57,063 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2023-06-09T19:46:57,066 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2023-06-09T19:46:57,069 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2023-06-09T19:46:57,072 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2023-06-09T19:46:57,078 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2023-06-09T19:46:57,084 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2023-06-09T19:46:57,090 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2023-06-09T19:46:57,093 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2023-06-09T19:46:57,097 adding 'deepspeed/runtime/fp16/__init__.py' 2023-06-09T19:46:57,103 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2023-06-09T19:46:57,107 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2023-06-09T19:46:57,113 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2023-06-09T19:46:57,117 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2023-06-09T19:46:57,122 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2023-06-09T19:46:57,136 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2023-06-09T19:46:57,142 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2023-06-09T19:46:57,146 adding 'deepspeed/runtime/pipe/__init__.py' 2023-06-09T19:46:57,161 adding 'deepspeed/runtime/pipe/engine.py' 2023-06-09T19:46:57,170 adding 'deepspeed/runtime/pipe/module.py' 2023-06-09T19:46:57,174 adding 'deepspeed/runtime/pipe/p2p.py' 2023-06-09T19:46:57,178 adding 'deepspeed/runtime/pipe/schedule.py' 2023-06-09T19:46:57,184 adding 'deepspeed/runtime/pipe/topology.py' 2023-06-09T19:46:57,188 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2023-06-09T19:46:57,191 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2023-06-09T19:46:57,194 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2023-06-09T19:46:57,197 adding 'deepspeed/runtime/swap_tensor/constants.py' 2023-06-09T19:46:57,202 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2023-06-09T19:46:57,206 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2023-06-09T19:46:57,212 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2023-06-09T19:46:57,216 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2023-06-09T19:46:57,220 adding 'deepspeed/runtime/swap_tensor/utils.py' 2023-06-09T19:46:57,224 adding 'deepspeed/runtime/zero/__init__.py' 2023-06-09T19:46:57,228 adding 'deepspeed/runtime/zero/config.py' 2023-06-09T19:46:57,232 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2023-06-09T19:46:57,236 adding 'deepspeed/runtime/zero/linear.py' 2023-06-09T19:46:57,242 adding 'deepspeed/runtime/zero/mics.py' 2023-06-09T19:46:57,246 adding 'deepspeed/runtime/zero/mics_utils.py' 2023-06-09T19:46:57,249 adding 'deepspeed/runtime/zero/offload_config.py' 2023-06-09T19:46:57,255 adding 'deepspeed/runtime/zero/parameter_offload.py' 2023-06-09T19:46:57,276 adding 'deepspeed/runtime/zero/partition_parameters.py' 2023-06-09T19:46:57,285 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2023-06-09T19:46:57,317 adding 'deepspeed/runtime/zero/stage3.py' 2023-06-09T19:46:57,349 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2023-06-09T19:46:57,354 adding 'deepspeed/runtime/zero/test.py' 2023-06-09T19:46:57,359 adding 'deepspeed/runtime/zero/tiling.py' 2023-06-09T19:46:57,362 adding 'deepspeed/runtime/zero/utils.py' 2023-06-09T19:46:57,366 adding 'deepspeed/utils/__init__.py' 2023-06-09T19:46:57,370 adding 'deepspeed/utils/comms_logging.py' 2023-06-09T19:46:57,373 adding 'deepspeed/utils/debug.py' 2023-06-09T19:46:57,376 adding 'deepspeed/utils/exceptions.py' 2023-06-09T19:46:57,380 adding 'deepspeed/utils/groups.py' 2023-06-09T19:46:57,383 adding 'deepspeed/utils/init_on_device.py' 2023-06-09T19:46:57,387 adding 'deepspeed/utils/logging.py' 2023-06-09T19:46:57,389 adding 'deepspeed/utils/mixed_precision_linkage.py' 2023-06-09T19:46:57,393 adding 'deepspeed/utils/numa.py' 2023-06-09T19:46:57,395 adding 'deepspeed/utils/nvtx.py' 2023-06-09T19:46:57,399 adding 'deepspeed/utils/tensor_fragment.py' 2023-06-09T19:46:57,403 adding 'deepspeed/utils/timer.py' 2023-06-09T19:46:57,406 adding 'deepspeed/utils/types.py' 2023-06-09T19:46:57,412 adding 'deepspeed/utils/zero_to_fp32.py' 2023-06-09T19:46:57,417 adding 'deepspeed-0.9.4.data/scripts/deepspeed' 2023-06-09T19:46:57,419 adding 'deepspeed-0.9.4.data/scripts/deepspeed.pt' 2023-06-09T19:46:57,422 adding 'deepspeed-0.9.4.data/scripts/ds' 2023-06-09T19:46:57,424 adding 'deepspeed-0.9.4.data/scripts/ds_bench' 2023-06-09T19:46:57,427 adding 'deepspeed-0.9.4.data/scripts/ds_elastic' 2023-06-09T19:46:57,429 adding 'deepspeed-0.9.4.data/scripts/ds_report' 2023-06-09T19:46:57,432 adding 'deepspeed-0.9.4.data/scripts/ds_ssh' 2023-06-09T19:46:57,434 adding 'deepspeed-0.9.4.data/scripts/dsr' 2023-06-09T19:46:57,442 adding 'deepspeed-0.9.4.dist-info/LICENSE' 2023-06-09T19:46:57,450 adding 'deepspeed-0.9.4.dist-info/METADATA' 2023-06-09T19:46:57,453 adding 'deepspeed-0.9.4.dist-info/WHEEL' 2023-06-09T19:46:57,455 adding 'deepspeed-0.9.4.dist-info/entry_points.txt' 2023-06-09T19:46:57,457 adding 'deepspeed-0.9.4.dist-info/top_level.txt' 2023-06-09T19:46:57,473 adding 'deepspeed-0.9.4.dist-info/RECORD' 2023-06-09T19:46:57,525 removing build/bdist.linux-armv7l/wheel 2023-06-09T19:46:57,755 deepspeed build time = 12.039245128631592 secs 2023-06-09T19:46:57,923 Building wheel for deepspeed (setup.py): finished with status 'done' 2023-06-09T19:46:57,955 Created wheel for deepspeed: filename=deepspeed-0.9.4-py3-none-any.whl size=843956 sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 2023-06-09T19:46:57,957 Stored in directory: /tmp/pip-ephem-wheel-cache-s1k42huf/wheels/d5/75/df/621446f016665ba8fe4a8058cdc7963ded670671788b5f98a2 2023-06-09T19:46:58,025 Successfully built deepspeed 2023-06-09T19:46:58,096 Removed build tracker: '/tmp/pip-build-tracker-r58ezgl8'